Restart your ssh server to be sure (probably sudo systemctl restart sshd). No need to reboot your server for this.
I don’t know how reliable this is, but I usually go into htop to check if stuff needs to be restarted. Processes in red have been replaced or removed since starting.
That said, regular server reboots are a good idea to make sure kernel patches are applied. Can’t go wrong with a reboot just in case.