Summary
This chapter covered a lot of topics to ingest… I mean digest – pardon the pun. We started by learning about data ingestion in general, discussing the different types of data, such as structured, semi-structured, and unstructured. We then looked at the data management service in more detail to understand its role with regard to data ingestion. We also looked at the difference between batching and streaming data. We introduced the main ingestion categories: SDKs, managed pipelines such as Azure Event Grid, connections and plugins, and tools such as Azure Data Factory and one-click ingestion.
Then we learned about schema mapping, how they map external data to the columns in our ADX tables, and how to write our own schema maps for both CSV and JSON data. We created two schema maps for the English Premier League football results data, one for the CSV-based data and one for the JSON data, where we excluded the betting information and kept the actual football match...