Book Image

Mastering Natural Language Processing with Python

By : Deepti Chopra, Nisheeth Joshi, Iti Mathur
Book Image

Mastering Natural Language Processing with Python

By: Deepti Chopra, Nisheeth Joshi, Iti Mathur

Overview of this book

<p>Natural Language Processing is one of the fields of computational linguistics and artificial intelligence that is concerned with human-computer interaction. It provides a seamless interaction between computers and human beings and gives computers the ability to understand human speech with the help of machine learning.</p> <p>This book will give you expertise on how to employ various NLP tasks in Python, giving you an insight into the best practices when designing and building NLP-based applications using Python. It will help you become an expert in no time and assist you in creating your own NLP projects using NLTK.</p> <p>You will sequentially be guided through applying machine learning tools to develop various models. We’ll give you clarity on how to create training data and how to implement major NLP applications such as Named Entity Recognition, Question Answering System, Discourse Analysis, Transliteration, Word Sense disambiguation, Information Retrieval, Sentiment Analysis, Text Summarization, and Anaphora Resolution.</p>

Related Content you might be interested in

Current Title:

Small book image
Mastering Natural Language Processing with Python
Deepti Chopra | Nisheeth Joshi | Iti Mathur
Jun, 2016 | 238 pages
No titles found
Table of Contents (17 chapters)
Mastering Natural Language Processing with Python
Mastering Natural Language Processing with Python
Credits
Credits
About the Authors
About the Authors
About the Reviewer
About the Reviewer
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Working with Strings
Working with Strings
Tokenization
Normalization
Substituting and correcting tokens
Applying Zipf's law to text
Similarity measures
Summary
2
Statistical Language Modeling
Statistical Language Modeling
Understanding word frequency
Applying smoothing on the MLE model
Develop a back-off mechanism for MLE
Applying interpolation on data to get mix and match
Evaluate a language model through perplexity
Applying metropolis hastings in modeling languages
Applying Gibbs sampling in language processing
Summary
3
Morphology – Getting Our Feet Wet
Morphology – Getting Our Feet Wet
Introducing morphology
Understanding stemmer
Understanding lemmatization
Developing a stemmer for non-English language
Morphological analyzer
Morphological generator
Search engine
Summary
4
Parts-of-Speech Tagging – Identifying Words
Parts-of-Speech Tagging – Identifying Words
Introducing parts-of-speech tagging
Creating POS-tagged corpora
Selecting a machine learning algorithm
Statistical modeling involving the n-gram approach
Developing a chunker using pos-tagged corpora
Summary
5
Parsing – Analyzing Training Data
Parsing – Analyzing Training Data
Introducing parsing
Treebank construction
Extracting Context Free Grammar (CFG) rules from Treebank
Creating a probabilistic Context Free Grammar from CFG
CYK chart parsing algorithm
Earley chart parsing algorithm
Summary
6
Semantic Analysis – Meaning Matters
Semantic Analysis – Meaning Matters
Introducing semantic analysis
Generation of the synset id from Wordnet
Disambiguating senses using Wordnet
Summary
7
Sentiment Analysis – I Am Happy
Sentiment Analysis – I Am Happy
Introducing sentiment analysis
Summary
8
Information Retrieval – Accessing Information
Information Retrieval – Accessing Information
Introducing information retrieval
Vector space scoring and query operator interaction
Developing an IR system using latent semantic indexing
Text summarization
Question-answering system
Summary
9
Discourse Analysis – Knowing Is Believing
Discourse Analysis – Knowing Is Believing
Introducing discourse analysis
Summary
10
Evaluation of NLP Systems – Analyzing Performance
Evaluation of NLP Systems – Analyzing Performance
The need for evaluation of NLP systems
Evaluation of IR system
Metrics for error identification
Metrics based on lexical matching
Metrics based on syntactic matching
Metrics using shallow semantic matching
Summary
Index
Index

About the Authors

Deepti Chopra is an Assistant Professor at Banasthali University. Her primary area of research is computational linguistics, Natural Language Processing, and artificial intelligence. She is also involved in the development of MT engines for English to Indian languages. She has several publications in various journals and conferences and also serves on the program committees of several conferences and journals.

Nisheeth Joshi works as an Associate Professor at Banasthali University. His areas of interest include computational linguistics, Natural Language Processing, and artificial intelligence. Besides this, he is also very actively involved in the development of MT engines for English to Indian languages. He is one of the experts empaneled with the TDIL program, Department of Information Technology, Govt. of India, a premier organization that oversees Language Technology Funding and Research in India. He has several publications in various journals and conferences and also serves on the program committees and editorial boards of several conferences and journals.

Iti Mathur is an Assistant Professor at Banasthali University. Her areas of interest are computational semantics and ontological engineering. Besides this, she is also involved in the development of MT engines for English to Indian languages. She is one of the experts empaneled with TDIL program, Department of Electronics and Information Technology (DeitY), Govt. of India, a premier organization that oversees Language Technology Funding and Research in India. She has several publications in various journals and conferences and also serves on the program committees and editorial boards of several conferences and journals.

We acknowledge with gratitude and sincerely thank all our friends and relatives for the blessings conveyed to us to achieve the goal to publishing this Natural Language Processing-based book.

Previous Section
Next Chapter