[Research, NeurIPS 2021] Is Topic Model Evaluation Broken? The Incoherence of Coherence

Опубликовано: 15 Март 2026
на канале: Jordan Boyd-Graber
4,678
274

Topic models help historians, journalists, and analysts make sense of large text collections. But how do you know if you have a good one? The field has settled on using “Automatic Coherence”, but this paper argues that maybe that isn’t the right choice if you want to actually make real users happy.

NeurIPS didn't give us enough time to execute my original idea, and the students went in the different direction. During Winter Break, I wanted to execute my original "vision".

The original "official" NeurIPS video done by students:
   • Is Topic Model Evaluation Broken? The Inco...  

To read the full paper and to get links to other resources:
http://umiacs.umd.edu/~jbg//docs/2021...

Code:
http://github.com/ahoho/topics

Music: Double Violin Concerto 1st Movement – J.S. Bach performed by Jon Sayles

Copyright: CC BY