Data is generally stored in flat files, relational databases, NoSQL databases and other locations in multiple formats, such as JSON, XML, CSV, text files, and binary. Moreover, each data store defines its own model to store data. An employee ID in one data store is named EMPIDID in another data store and EID in the third data store within the same organization. There are multiple facets for the same data within different data stores. Azure data factory is a data integration service that helps in authoring orchestration and workflow scenarios for the ETL of data. Azure data factory works with data from any location-cloud, on-premise, and works at the cloud scale. It works with large volumes of data with varied formats.
The workflows in Azure data factory are known as data pipelines and Azure data factory helps in creating, deploying, monitoring, and scheduling...