Using Synapse pipelines to import data
Data ingestion is one of the most critical aspects of data analytics, and there are many tools available for data movement. The challenge is to decide which tool is more efficient for your environment. In this section, we are going to show how can you use inbuilt orchestration tools available in Synapse for data ingestion. There are two options available under the Orchestrate tab: the first one is Pipeline, which can be used for data ingestion, but also allows you to add transformation logic. The second option is to use Copy Data tool, which gives you the option to only move data without implementing any data transformation logic. So, in a nutshell, you can use Copy Data tool if you require a pipeline just for data ingestion, but you have the option to use Pipeline if you need to add business logic to your data.
The following screenshot shows the Integrate hub of Synapse Studio, where we are going to use the Copy Data tool or Pipeline options...