A large regional health payer accelerated data ingestion, enabling faster insights in multiple functional areas

Business Need

The health payer had an immense volume of data and information assets collected over decades and spanning a multitude of software and sources. The health payer therefore suffered from operational inefficiencies, lacked data governance, and struggled to adapt to new business models, incurring significant costs in the process. Key challenges for the health payer were ingesting data to unify longitudinal member information, accessing data, gaining insights, and monetizing information to capture key market opportunities.

Tools and Technology

Leveraging ValueMomentum’s expertise, the health payer developed a fast-moving data ingestion pipeline that was capable of ingesting any identified source with speed of up to 10x faster. The solution uses AWS S3 for storage, Athena and Jupyter Notebooks for data lake and exploration, AWS Glue for metadate cataloguing and AWS Logging, CloudTrail, and QuickSight for auditing and logging. The pipeline supports SCD Type 2 with row versioning, and also unifies data from multiple sources for the same functional area (e.g., Membership, Claims).

Success Factors

By establishing a robust ingestion pipeline and a unified data repository, the health payer was able to eliminate redundant data pipelines, cut down on data storage and maintenance costs, and become more responsive to changing business models.

Impact

The health payer is now able to seamlessly ingest disparate data sources with minimal data loss, as the data ingestion pipeline enables data unification across digital and legacy data sources, as well as enhance the quality and rate of insights from their data to improve decision-making.