Senior Data Engineer

Job Title: SSE

Primary Skill: AWS, DynamoDB, Aurora PostgreSQL, AWS Sagemaker, Scala/Python

Location: Hyderabad/Pune / Coimbatore

Mode of work: Work from Office

Experience: 4-8 years

About the job:

We are looking for a Senior Data Engineer who will be responsible for building AWS Data pipelines as per requirements. Should have strong analytical skills, design capabilities, and problem solving skills. Based on stakeholders’ requirements, should be able to propose solutions to the customer for review. Discuss pros/cons of different solution designs and optimization strategies.

Know your team:

At ValueMomentum’s Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.

Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You’ll have the opportunity to showcase your talents by contributing to impactful projects.

Responsibilities:

  • Provide technical and development support to clients to build and maintain data pipelines
  • Develop data mapping documents listing business and transformational rules.
  • Develop, unit test, deploy and maintain data pipelines.
  • Design a Storage Layer for storing tabular/semi-structured/unstructured data.
  • Design pipelines for batch/real-time processing of large data volumes.
  • Analyze source specifications and build data mapping documents.
  • Identify and document applicable non-functional code sets and reference data across insurance domains.
  • Understand profiling results and validate data quality rules.
  • Utilize data analysis tools to construct and manipulate datasets to support analyses.
  • Collaborate with and support Quality Assurance (QA) in building functional scenarios and validating results.

Requirements:

  • 5+ years’ experience developing and maintaining modern ingestion pipeline using technologies like (AWS pipelines, Lamda, Apache Nifi etc).
  • Basic understanding of the MLOPs lifecycle (Data prep -> model training -> model deployment -> model inference -> model re-training).
  • Should be able to design data pipelines for batch/real time using Lambda, Step Functions, API Gateway, SNS, S3.
  • Hands on experience on AWS Cloud and its Native components like S3, Athena, Redshift & Jupyter Notebooks.
  • Requirements Gathering – Active involvement during requirements discussions with project sponsors, defining the project scope and delivery timelines, Design & Development.
  • Strong in Python pipelines (ETL & Streaming).
  • Strong experience in metadata management tools like AWS Glue.
  • Strong experience in coding with languages like Java, Python.
  • Good-to-have AWS Developer certified.
  • Good-to-have Postman-API and Apache Airflow or similar schedulers experience.
  • Working with cross-functional teams to meet strategic goals.
  • Experience in high volume data environments.
  • Critical thinking and excellent verbal and written communication skills.
  • Strong problem-solving and analytical abilities should be able to work and deliver individually.
  • Good knowledge of data warehousing concepts.

Good to have:

Lambda, Step Functions, API Gateway, SNS, S3 (unstructured data), DynamoDB (semi-structured data), Aurora PostgreSQL (tabular data), AWS Sagemaker, AWS CodeCommit/GitLab, AWS CodeBuild, AWS Code Pipeline, AWS ECR.

About ValueMomentum:

ValueMomentum is a leading solutions provider for the global property & casualty insurance industry, supported by deep domain and technology capabilities. We offer a comprehensive suite of advisory, development, implementation, and maintenance services across the entire P&C insurance value chain. This includes Underwriting, Claims, Distribution, and more, empowering insurers to stay ahead with sustained growth, high performance, and enhanced stakeholder value.  Trusted by over 75 insurers, ValueMomentum is one of the largest standalone insurance-focused solutions providers to the US insurance industry.

Our culture – Our fuel:

At ValueMomentum, we believe in making employees win by nurturing them from within, collaborating and looking out for each other.

  • People first – Empower employees to succeed.
  • Nurture leaders – Nurture from within.
  • Enjoy wins – Recognize and celebrate wins.
  • Collaboration – Foster a culture of collaboration and people-centricity.
  • Diversity – Committed to diversity, equity, and inclusion.
  • Fun – Create a fun and engaging work environment.
  • Warm welcome – Provide a personalized onboarding experience.

Company Benefits:

  • Compensation – Competitive compensation package comparable to the best in the industry.
  • Career Growth – Career development, comprehensive training & certification programs, and fast track growth for high potential associates.
  • Benefits: Comprehensive health benefits and life insurance.

    Apply for this Job