I used to do this before streaming services and it was not bad at all. At the time there was only one type of mini keyboard plus touchpad available, now there are a lot more options in that category.
It’s a little less convenient, but like you can also do things you can’t with no streaming box such as pirate live streams of channels from across the country for free.
Edit: you can also get usb-cec devices to make it so it switches inputs for you.