Supporting services are integrated across all layers of the architecture. OpenMetadata provides data cataloging, lineage tracking, ownership management, and discoverability, helping users understand where data originates and how it is used. Development and deployment processes are standardized through GitHub Enterprise, CI/CD pipelines, and automated delivery processes, while dbt Platform and Python enable scalable transformation, testing, and operationalization of data products. Togeth- er, these capabilities provide a modern platform that combines governance, transparency, scalabil- ity, and efficient collaboration across subsidiaries and business units.
Data Ingestion
Data Warehousing
DevOps
— Python — PySpark
— Snowflake — dbt Platform — datavault4dbt
— Kubernetes — GitHub Enterprise
— Argo Workflows — Azure Data Lake — Apache Iceberg
Introducing dbt Mesh
To enable a physical separation of development spaces, we introduced dbt Mesh into our core archi- tectural framework. It is a feature of dbt Platform to empower domain teams to build data models as data products in separated dbt projects, and share them programmatically to other projects on the same dbt account. Rather than maintaining a single monolithic platform in dbt, we established separate, autonomous projects for the subsidiaries enercity AG, and enercity Netz - and additionally a centralized Cross project. The latter is meant to manage cross-domain business logics and data use-cases. Despite op- erating independently, all teams follow unified implementation standards, including shared naming conventions and Data Vault modeling rules and best practices.
6/12
Enercity AG Success Story - Engineering KPI Trust - Share Reliable Data in a Regulated Industry
Powered by FlippingBook