We can use clustering for Dimensionality Reduction of text data
- most frequent terms in the centroids are the basis
- they are almost orthogonal - they shouldn't appear a lot in other clusters
- then represent each document in terms of this basis
- Aggarwal, Charu C., and ChengXiang Zhai. "A survey of text clustering algorithms." Mining Text Data. Springer US, 2012.