INTRODUCTION A photonics manufacturer wanted to speed up the delivering reports and dashboards to their business users, after migrating to a cloud database provider and a SaaS data warehouse automation tool. CASE DESCRIPTION After modernizing both the database platform and the automation tool, the manufacturer had trouble leveraging the advantages of the new platforms. An existing Data Vault 2.0 implementation did not strictly follow the standards, which prevented high scalability and fast implementation because repeatability and transparency of the implementation process was lacking. This increased the time required to implement new features for delivering requested business reports. A major challenge was a lack of common understanding of the Data Vault 2.0 standard, especially regarding the implementation of it. The Data Warehouse Automation was based on loading patterns provided by another consulting company. Because these were not completely working out of the box, they needed to be changed over time. After many adjustments, the team ended up with a poorly documented, mainly self-built solution. This led to confusion about using and configuring the code. Our suggested solution included using our publicly available dbt package “datavault4dbt” to have a well-documented and highly-configurable set of Data Vault loading patterns. To confirm the feasibility of this solution, we successfully implemented datavault4dbt in a selection of custom near- edge scenarios. These solutions achieved a same-or-better loading performance, while providing a standardized and well-documented user interface.
ENHANCING THE DATA VAULT IMPLEMENTATION FOR A LEADING PHOTONICS COMPANY © SCALEFREE INTERNATIONAL GMBH 2024
2/3
Powered by FlippingBook