What about Jellyfin do you prefer? I remember jellyfin not having the greatest hw encoding when I tried but that may be different now.
I use Intel Quick Sync and getting that to work with Plex through Unraid was a breeze. I certainly did not have the same experience with Jellyfin at the time.