You can edit the hosts file on your local device, but I would recommend you take a look at using the rpi for a pihole/ DNS server. Then you can edit the hosts file on the PI to make it so that any device on your network redirects with the custom name.
Hell if you want to have fun install nginx proxy manager then you can set up routing so that anything is easily accessible from inside you net ie: rpi/jellyfin or rpi/soju.
If youre interested in doing anything like that and youre stuck ill help with any questions. I setup docker containers with proxies all the time