BI,Case Study
ENHANCING THE DATA VAULT IMPLEMENTATION FOR A LEADING PHOTONICS COMPANY
INTRODUCTION A photonics manufacturer wanted to speed up the delivering reports and dashboards to their business users, after migrating to a cloud database provider and a SaaS data warehouse automation tool. CASE DESCRIPTION After modernizing both the database platform and the automation tool, the manufacturer had trouble leveraging the advantages of the new platforms. An existing Data Vault 2.0 implementation did not strictly follow the standards, which prevented high scalability and fast implementation because repeatability and transparency of the implementation process was lacking. This increased the time required to implement new features for delivering requested business reports. A major challenge was a lack of common understanding of the Data Vault 2.0 standard, especially regarding the implementation of it. The Data Warehouse Automation was based on loading patterns provided by another consulting company. Because these were not completely working out of the box, they needed to be changed over time. After many adjustments, the team ended up with a poorly documented, mainly self-built solution. This led to confusion about using and configuring the code. Our suggested solution included using our publicly available dbt package “datavault4dbt” to have a well-documented and highly-configurable set of Data Vault loading patterns. To confirm the feasibility of this solution, we successfully implemented datavault4dbt in a selection of custom near- edge scenarios. These solutions achieved a same-or-better loading performance, while providing a standardized and well-documented user interface.
ENHANCING THE DATA VAULT IMPLEMENTATION FOR A LEADING PHOTONICS COMPANY © SCALEFREE INTERNATIONAL GMBH 2024
2/3
Additionally, standards for naming conventions, deployment processes, and sprint organization have been implemented. The defined standards minimized the room for interpretation when team members worked on new development tasks. Therefore, tangible results in the shape of deployable Information Marts, could be delivered to business users faster than before. The usage of datavault4dbt reduced time for maintaining and extending the loading patterns to a minimum, allowing the team to focus on delivering business value. The proposed tool stack included Snowflake as the core data platform. Transformations are handled by dbt cloud, which leverages Datavault4dbt for a highly standardized Data Vault implementation.
Scalefree International GmbH Schützenallee 3 30519 Hannover Germany
P: +49 (511) 879 893 41 M:+49 (175) 811 0336 F: +49 (511) 879 893 49
info@scalefree.com www.scalefree.com
CEOs: Michael Olschimke & Christof Wenzeritt
Page 1 Page 2 Page 3Powered by FlippingBook