Inverted y for anything first person. I grew up with a joystick for flight sims, and that felt natural to me when I later played FPS games on controller.
Inverted x makes no sense to me (and yes, I read your explanation below), but I can ignore that setting just fine, so every game should have it.