ML Wiki
Machine Learning Wiki - A collection of ML concepts, algorithms, and resources.

Problems in Text Mining

Problems in Text Mining

COOL STUFF

problems of polysemy, homonymy and synonymy: semantic relations between words

Polysemy is the capacity for a sign (such as a word, phrase, or symbol) to have multiple meanings (that is, multiple semes or sememes and thus multiple senses)

The state of being a homonym is called homonymy. In linguistics, a homonym is, in the strict sense, one of a group of words that share the same spelling and pronunciation but have different meanings.[1] http://dictionary.reference.com/browse/homonym

Words that are synonyms are said to be synonymous, and the state of being a synonym is called synonymy.

The analysis of synonymy, polysemy, and hyponymy and hypernymy is vital to taxonomy and ontology in the information-science senses of those terms.

Related terms

Homonyms are words that have the same pronunciation and spelling, but have different meanings. For example, rose (a type of flower) and rose (past tense of rise) are homonyms.

Term Extraction techniques:

  • these techniques create “artificial” terms that aren’t really terms - they are generated, and not the ones that actually occurred in the text
  • The original terms don’t have the optimal dimensionality for document content representation
    • because of the problems of polysemy, homonymy and synonymy
  • so we want to find better representation that doesn’t suffer from these issues

  • Sebastiani, Fabrizio. “Machine learning in automated text categorization.” (2002). [http://arxiv.org/pdf/cs/0110053.pdf]