-
Book Overview & Buying
-
Table Of Contents
Deep Learning and XAI Techniques for Anomaly Detection
By :
Amazon released a new MASSIVE dataset in 2022, https://www.amazon.science/blog/amazon-releases-51-language-dataset-for-language-understanding, containing 1 million labeled utterances in 51 languages, available at https://github.com/alexa/massive.
MASSIVE provides tools and open source code for multilingual natural language understanding (NLU) modeling, such as intent classification. You can read more about MASSIVE’s paper at arXiv, https://doi.org/10.48550/arXiv.2204.08582.
Using this dataset, you can practice with the chapter3_MASSIVE_get_started.ipynb exercise notebook, available at the GitHub repo. After downloading and decompressing the MASSIVE dataset, load a JSON Lines (.jsonl) file containing a specific language’s utterances. For example, en-US.jsonl contains utterances in English. Let’s cover the getting started steps in the sample notebook:
import json
with open('en-US.jsonl') as...