Tagging and chunking for parts of speech
So far, we have covered several approaches for representing words and sentences, including bag-of-words, embeddings, and n-grams. However, these representations fail to capture the structure of any given sentence. Within natural language, different words can have different functions within a sentence. Consider the following:
The big dog is sleeping on the bed
We can "tag" the various words of this text, depending on the function of each word in the sentence. So, the preceding sentence becomes as follows:
The -> big -> dog -> is -> sleeping -> on -> the -> bed
Determiner -> Adjective -> Noun -> Verb -> Verb -> Preposition -> Determiner-> Noun
These parts of speech include, but are not limited to, the following:
These different parts of speech can be used to better understand the structure of sentences. For example,...