Yes, that was what I was referring to. However, this is assuming that Lemmy has properly implemented webfinger and doesn’t store direct links (which I haven’t checked).
Alternatively, you could proxy all requests with application/activity+json in the Accept or Content-type headers.