Book Image

Hands-On Python Natural Language Processing

By : Aman Kedia, Mayank Rasu
4 (1)
Book Image

Hands-On Python Natural Language Processing

4 (1)
By: Aman Kedia, Mayank Rasu

Overview of this book

Natural Language Processing (NLP) is the subfield in computational linguistics that enables computers to understand, process, and analyze text. This book caters to the unmet demand for hands-on training of NLP concepts and provides exposure to real-world applications along with a solid theoretical grounding. This book starts by introducing you to the field of NLP and its applications, along with the modern Python libraries that you'll use to build your NLP-powered apps. With the help of practical examples, you’ll learn how to build reasonably sophisticated NLP applications, and cover various methodologies and challenges in deploying NLP applications in the real world. You'll cover key NLP tasks such as text classification, semantic embedding, sentiment analysis, machine translation, and developing a chatbot using machine learning and deep learning techniques. The book will also help you discover how machine learning techniques play a vital role in making your linguistic apps smart. Every chapter is accompanied by examples of real-world applications to help you build impressive NLP applications of your own. By the end of this NLP book, you’ll be able to work with language data, use machine learning to identify patterns in text, and get acquainted with the advancements in NLP.
Table of Contents (16 chapters)
1
Section 1: Introduction
4
Section 2: Natural Language Representation and Mathematics
9
Section 3: NLP and Learning

Understanding regularization

During model training, two problems come up quite often: underfitting and overfitting. Let's learn about them next:

  • Underfitting: When our model performs poorly on both training and test data, it is said to be underfitting. This basically means that the model was not able to capture patterns or underlying trends in our data, and so it could not generalize well when working with unseen data. For such models, we can try out the tuning of various hyperparameters so that it can fit data well. In the case of neural networks, we can add more layers and create a bigger network so that the model can capture complex patterns in data.
  • Overfitting: Overfitting is another problem that can happen during model training. When the model performs very well on training data, but does not generalize well and performs poorly on test data, it is said to be overfitting. Basically, the model is trying to memorize data here rather than learn patterns. It can, at times, model...