LLMs Outperform Most Humans in Pronoun Disambiguation but Need Human Oversight
A study compared 73 human annotators and over 40 LLM configurations on disambiguating 174 authentic uses of 'they' from Reddit. The best LLM, Kimi K3, achieved 94.5% accuracy, surpassing the human majority vote...