To sum up, for sending large amounts of data over the internet, you can consider the following tools:
- azcopy, which is a command-line tool for copying data to the Azure Storage service.
- REST APIs of Azure Storage: Instead of using additional tools, you can implement your own applications that will leverage available REST APIs and copy the data over HTTP.
- Azure Data Factory: If you need an orchestration, you can use Azure Data Factory to organize the work for you. It can be used in addition to the previous tools to ensure that everything happens in a controlled manner.
Whichever option you will choose, you should consider the following things:
- When copying data online, you will have to ensure that the connection is stable.
- In the case of any errors, which may happen during the copy operation, you will have to implement some kind of retry to avoid corrupted data.
- The ideal solution for online transfer is having a dedicated connection between your systems and...