“Whatever is causing gravity to work differently at a galaxy scale than at a solar system scale”.
Nothing is. Gravity works the same. We don’t just infer dark matter from gravity fields. We can detect and map the exact locations of dark matter thru gravitational lensing.
We can indirectly detect dark matter thru gravitational lensing. That is how NASA created this map showing the actual locations of dark matter in tinted blue.