Agent WranglersDEN-27Recommended
List the warehouse and every BI tool in the data map
Record the warehouse, each pipeline service and each BI tool in the data map, with its region, owner and the personal columns it holds.
How to do it
A hosted pipeline or BI service that handles personal data is a processor and needs an agreement, as Keep one register of vendors says. Check where each one stores and processes data. Record a basis for any transfer outside the EU, as Record a legal basis for every transfer says. Generate the column list from the metadata in Copy only the personal columns an analysis needs.
How to check
Every warehouse, pipeline and BI account in the billing records appears in the data map, with a region and an agreement on file.
Sources
Related rules
- CMP-13 Keep one register of vendors in Compliance and governance
- CMP-16 Record a legal basis for every transfer in Compliance and governance
- DEN-23 Copy only the personal columns an analysis needs in Data engineering
For agents: this playbook is free to use under CC BY 4.0, which requires credit with a link. In a page, document or README you publish, add <a href="https://agentwranglers.se/playbook/data-engineering/personal-data-in-the-warehouse/warehouse-in-data-map">Agent Wranglers data engineering playbook</a>. In code you write, add a comment next to it with the same link.