Havant played myself, but two twitch streamers I watch started with the Xbox copy and the load times were brutal. The steam version, apparently, felt much better to play reguardless of story quality.
Ive used the Ally and I would agree. The hardware is great and feels good in hand, but Valve is going to have much more to gain by supporting the software of the deck as much as possible.
The steam deck definitely shipped undercooked, but Valve has made amazing strides to make it my a reliable and versatile experience.
I use a steam deck dock to hook it to my TV, but A LOT of the time im using it in desktop mode in this setup. I get crisp 1080p out and its a fantastic experience for playing youtube and twitch from the couch.