BI,Case Study
IDENTIFYING DATA QUALITY ISSUES WITH A ONE-DAY-SPRINT APPROACH
INTRODUCTION A car insurance company wanted to achieve higher data quality and faster system response times when reporting. Additionally, they wanted to create a system which had the ability to store the data. CASE DESCRIPTION The project consisted of migrating data from an old legacy system to a new one. This was necessary as the client’s legacy system was not able to support the business case any longer. Additionally, there were challenges within the migration and processing of microservice data. Kafka was used for real-time processing which normally was intended for real-time processing of high volume data-streams, for example IoT data. In this case, the client only transmitted master data. This led to data quality and performance issues.
The knowledge of the old system was scarce on the client side and the architecture was really com- plex which led to more effort when updating the system. Also, the distribution of business rules was unclear in the different layers. This is why there was a need for a more sophisticated system which was able to adapt to changes in the structure more efficiently and with more agility. For this, a one day sprint was conducted to show the advantages of a data vault approach and solve the problems the client was facing before. On this day, the client was introduced to a virtual data vault which was used to show the data model. Through this, the client was able to see how the sys- tem could adjust to modifying structures in their data. Additionally, they were shown a problem with file formatting and a larger problem in which the business keys were not used correctly as well as data types that were not correctly shown by the old system. Those issues could be resolved with a migration to another system.
As a result of the One Day Sprint, the client received knowledge regarding example data and how it could be used in the context of a new system with Data Vault. They would be empowered to keep the system updated by themselves without having scarce knowledge spread across only a small group of employees. With this, they would also be able to focus on new features and reduce costs.
Identifying Data Quality Issues with a One-Day-Sprint Approach I © Scalefree International GmbH 2023 2/3
Scalefree International GmbH Schützenallee 3, 30519 Hannover, Germany
P: +49 (511) 879 893 41 M:+49 (175) 811 0336 F: +49 (511) 879 893 49
info@scalefree.com www.scalefree.com
CEOs: Michael Olschimke & Christof Wenzeritt
Page 1 Page 2 Page 3Powered by FlippingBook