Live intelligence

Latest AI updates

2 updates

Research Editor selected

NaijaFacts: Benchmark Reveals AI Knowledge Gap on Nigerian Facts

NaijaFacts is a new benchmark of factual and statistical questions about Nigeria, authored by native speakers and available in five languages. Testing eight models shows a dominant knowledge effect: English-query accuracy is only 20% for Nigeria versus 49-50% for US/UK, while language effects are smaller. The gap persists across all 54 African countries, with models scoring 96% on culture and 98% on politics but only 26% on statistics.

Why it matters: Provides concrete evidence of a major AI knowledge gap for African facts, with actionable insights for multilingual and knowledge-aware model development.

arxiv16h agoScore 85

AI evaluationMultilingual NLPKnowledge representation

Research Editor selected

MSafeTemp: Template-Based Multilingual Safety Alignment Across 60 Languages

Researchers propose a scalable template-based augmentation pipeline that extracts safe templates from harmful prompts, translates them, and fills slots with culturally authentic harmful and benign entities. The work releases MSafeTemp, a validated corpus spanning 60 languages for multilingual safety alignment and evaluation. Experiments show English-only evaluation can misjudge multilingual safety: attacks that fail in English may succeed when translated, and culturally localized variants expose additional failures. Template-based augmentation also improves safety performance beyond English.

Why it matters: It provides a concrete multilingual safety dataset and pipeline that exposes gaps in English-only safety evaluation and training.

arxiv6d agoScore 80

LLM safetymultilingual NLPsafety alignment