Creating multiple storage accounts
You can provision as many storage accounts as you like. There are four high-level considerations when it comes to choosing how many storage accounts you need:
- DTAP
- Data diversity
- Cost sensitivity
- Management overhead
Let's look at each of them in a little more detail.
Considering DTAP
DTAP stands for development, testing, acceptance, and production. Each stands for a separate environment used in a separate stage in the creation of, and working with, a data lake. You probably need to create some code to move data from the source systems into the data lake and then through the different data lake zones. This is a work in progress that should be separated from business processes working with data already in the data lake. You will most likely want to have small test datasets to create the logic and workflow to save development time.
After new software is written, it must be tested. You may have separate datasets...