Design brainstorming
The following few sections will try to better articulate the requirements and come up with a technical solution that could satisfy these requirements.
Data ingestion
The first task for any data practitioner is to look for data, collect it, clean it, validate it, and then start the exciting part of data discovery and exploration. For the current scenario, you need to define the data sources you need to pull data from. You also need to look at how you can load data from different sources to create a single dataset that can be explored and queried easily by data analysts. Some of the source systems that you need for this use case include:
- Sales transactions: The sales transactions can not only tell what and how many products were sold at a particular store, but they can also indicate what customers bought what products. This is because Coolies already has a loyalty program where customers scan their loyalty card as part of the checkout procedure. Coolies...