GeoBench Exposes AI’s Geography Gap

GeoBench turns a familiar game into a useful multimodal stress test, revealing that recognizing a country is far easier than pinpointing a location.

• –Measures visual clues, spatial reasoning, text recognition, and geographic knowledge together
• –Distance-based scoring captures meaningful differences that simple accuracy misses
• –Muse’s strong country accuracy but 202 km median error suggests coarse localization remains easier than precise geolocation
• –A standardized public leaderboard makes progress easier to track across vision-language models