Linguistic Models

A natural language consists of two parts:

  • lexicon: vocabulary of the language
  • grammar: set of rules to combine words from the lexicon in a meaningful way

Shallow Model

Machine Learning techniques in NLP are usually shallow

  • don't care much about grammar

Shallow Parsing:

  • JMLR Special Issue on Shallow Parsing [1]
  • Machine Learning Approaches to Shallow Parsing [2]

Deep Model

  • Deep linguistic processing is a natural language processing framework which draws on theoretical and descriptive linguistics.
  • It models language predominantly by way of theoretical syntactic/semantic theory