ETL Map
ETL AssessmentOutline your main data sources, transformations, and loading processes.
| Questions | Example | Data Source 1 | Data Source 2 | Data Source 3 | Data Source 4 | Data Source 5 |
|---|---|---|---|---|---|---|
| What is your data source? | Point of Sale System | |||||
| What type and format of data does this source contain? | XML | |||||
| How do you extract data from this source? | Automatically | |||||
| What tools/scripts are used for extraction? | Apache NiFi | |||||
| What transformations are needed? | All currencies standardized to USD. | |||||
| What tools are used for transformation? | Apache NiFi | |||||
| What validation checks are in place? | Data type validation: price is a decimal. | |||||
| Where is the data loaded? | Data warehouse. | |||||
| What is the frequency of loading? | Real-time. |