Research Editor selected
NaijaFacts: Benchmark Reveals AI Knowledge Gap on Nigerian Facts
NaijaFacts is a new benchmark of factual and statistical questions about Nigeria, authored by native speakers and available in five languages. Testing eight models shows a dominant knowledge effect: English-query accuracy is only 20% for Nigeria versus 49-50% for US/UK, while language effects are smaller. The gap persists across all 54 African countries, with models scoring 96% on culture and 98% on politics but only 26% on statistics.
Why it matters: Provides concrete evidence of a major AI knowledge gap for African facts, with actionable insights for multilingual and knowledge-aware model development.
AI evaluationMultilingual NLPKnowledge representation