Berkeley AI Research: Closed-Form Theory Explains What Word2vec Learns
Researchers at Berkeley AI Research have developed a quantitative theory showing that, under mild approximations, word2vec's learning problem reduces to unweighted least-squares matrix factorization. They prove that...