INTRODUCTION In today’s rapidly evolving business landscape, organizations are increasingly turning to cloud-based solutions to improve their data management capabilities and gain competitive advantages. Recognizing this need, Sparebank 1 - Sør-Norge embarked on a transformative journey in 2023 by partnering with Scalefree International GmbH to migrate their on-premise BI solution to the cloud by additionally following new methodologies. This strategic move aimed to enhance data agility, optimize performance, and align with industry best practices. INITIAL SITUATION AND CHALLENGES Prior to the migration, Sparebank 1 - Sør-Norge faced several challenges with the on- premise infrastructure. The lack of automation, code generation, a scalable data model, and general scalability of the infrastructure resulted in fragmented data management practices. Furthermore, the migration project presented its own set of challenges, primarily related to identifying and validating new technologies and methodologies. After researching and a proof of concept, the team decided in Q1 2023 to migrate into the Snowflake Cloud by using dbt Core as a data transformation tool and Data Vault 2 as methodology. The team then needed to acquire knowledge in Data Vault 2, Snowflake, dbt, Dev- Ops, Data Mesh, and agile methodologies while also increasing their general understanding of data management in the cloud.
OBJECTIVES AND HOW THEY GOT REACHED
The primary objectives of the migration project were to:
— Setup standards at the beginning
— Define a Migration Strategy for Information Marts from the on-premise solution to the Snowflake Cloud
— Usage of a Medallion Architecture within a Data Fabric
— Refactor inefficiencies and improve code quality
— Development, Testing, and Deployment Strategy
— Adopt a Data Mesh-like approach to facilitate organizational scalability
— Governed data sharing
— Cost monitoring
SUCCESS STORY: MIGRATION TO A CLOUD-BASED DATA FABRIC - PEOPLE, TECHNOLOGY & METHODOLOGY
2/12
Powered by FlippingBook