This is an actual proposed solution to the Fermi Paradox. We’re still relatively early on a universal scale. It’s possible we’re just… first. Or so early that hardly anybody else is out there yet. Could be that a billion years later, advanced life is all over the place.
In your formulation, we would also be the explanation for another species’ dark forest hypothesis…