Shared temperature assumption challenged in contrastive learning preprint
The work builds on the ProCo framework, which uses exact von Mises-Fisher (vMF) scores for probabilistic contrastive learning. The authors prove that the leading-order term in the score is \(A_c/\tau\), where \(A_c\) is the mean resultant length, a measure of class concentration.