Cloud Data Lake with Reporting Implementation for a Leading Insurance Client to Enable Real-Time Insights and Data-Driven Decisions.
Background

A leading global life, mutual fund and wealth management for both B2B and B2C & a Fortune 500 firm faced challenges in managing and analyzing their data due to a lack of integration across legacy systems. The bank required a modern data solution to bring omnichannel data into a unified Cloud Data Lake, leverage data on the fly for business analysis, and build useful insights using AI/ML for analytics and cross-selling.

Approach
  • Data Backbone Construction: Built a data backbone as a foundation layer, integrating all curated data, data warehouse, and datamart layers with AI/ML capabilities.
  • Dashboard and Reporting Layer: Developed dashboards and reporting tools based on curated and reporting layers. Converted existing Excel and Adhoc reporting into interactive dashboards using Tableau and QuickSight.
  • Reusable Data Mesh Architecture: Implemented a reusable Data Mesh architecture that can be extended to other markets and regions.
  • Automation and Security: Automated data loading processes. Ensured data security compliance with GDPR standards.
Results
  • 100% improvement in data accessibility and digital transformation of the bank's business.
  • Real-time data availability for streaming and reporting purposes.
  • Enhanced data security compliant with GDPR standards.
  • 35% cost savings through decommissioning duplicate systems, reducing license costs, and leveraging cloud infrastructure.
  • Test automation resulted in 80% faster testing and shorter time to delivery.
Tech Stack
  • Informatica, AWS Glue, S3, Redshift
  • Tableau, QuickSight, SageMaker

Business/Solution Architecture

  • Designed a layered architecture with Data Lake, Warehouse, and DataMart components
  • Implemented Data Mesh for decentralized data ownership and reuse
  • Used AWS Glue, S3, and Redshift for ingestion, storage, and analytics
  • Integrated Tableau and QuickSight for real-time reporting
  • Automated data loads and validation with GDPR-compliant controls