Part-of-speech tagging is the natural language processing task of assigning each word in a sentence a grammatical category, such as noun, verb or adjective, based on its definition and surrounding context. It is a foundational preprocessing step for downstream tasks such as parsing and information extraction, and has historically been solved with statistical sequence models, including hidden Markov models, before being subsumed by neural sequence labelling approaches. Accurate tagging disambiguates words whose part of speech depends on context.
Content
- Part-of-speech tagging is the natural language processing task of assigning each word in a sentence a grammatical category, such as noun, verb or adjective, based on its definition and surrounding context. It is a foundational preprocessing step for downstream tasks such as parsing and information extraction, and has historically been solved with statistical sequence models, including hidden Markov models, before being subsumed by neural sequence labelling approaches. Accurate tagging disambiguates words whose part of speech depends on context.