I’m happily running an Intel NUC as TV computer since 2013, and it’s awesome for exactly the reasons you state. I invested in it when I realized how fully crap the “smart” features of my Samsung TV are. The ultimate controller for it is a combo keyboard and touchpad, I have the Logitech K400r.
The NUC is starting to show it’s age now with its 4th gen i5, and I’m in the process of replacing it with a mini PC with an Intel N100.