Abacus Insights logoAbacus Insights logo

Senior Data Engineer at Abacus Insights | Pune, India

Abacus InsightsPune, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Senior

Qualifications

To succeed in this role, you should have a strong background in data engineering, including experience with cloud platforms such as AWS. Proficiency in programming languages, particularly Python, is essential. Familiarity with data modeling concepts, ETL processes, and data warehousing is required, alongside a proven track record in building scalable data solutions. Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment are also necessary.

About the job

About Us

At Abacus Insights, we are revolutionizing the management of data for health plans. Our mission is straightforward: to make healthcare data accessible and actionable, enabling decision-makers in care and cost management to respond swiftly and confidently.  
We facilitate the dismantling of data silos to establish a unified, trustworthy data infrastructure. This foundation enhances decision-making, leading to improved outcomes, minimized waste, and superior experiences for both members and providers.  

Supported by $100M in funding from leading investors, we are addressing significant challenges within a transformative industry. Our platform empowers GenAI initiatives by providing clean, interconnected, and reliable healthcare data that underpins automation, prioritization, and decision workflows, positioning us at the forefront of innovation.  

Our innovative spirit is fueled by our people. We embrace boldness, curiosity, and collaboration, believing that the best ideas emerge from teamwork. Are you ready to make a difference? Join us and let's shape the future together.

About the Role

We are on the lookout for a skilled Data Engineer to join our vibrant and rapidly growing Tech Ops team. With significant growth on the horizon, this role presents a unique opportunity to make a substantial technical impact. You will collaborate with clients, data vendors, and internal engineering teams to design, implement, and optimize intricate data integration solutions within a modern, large-scale cloud setting.

Utilizing your advanced expertise in distributed computing, data architecture, and cloud-native engineering, you will create scalable, resilient, and high-performance data ingestion and transformation pipelines. As a trusted technical advisor, you will assist clients in adopting Abacus’s core data management platform and ensure high-quality, compliant data operations throughout the lifecycle.

Your Day-to-Day Responsibilities

  • Architect, design, and implement high-volume batch and real-time data pipelines using PySpark, SparkSQL, Databricks Workflows, and distributed processing frameworks.
  • Develop comprehensive ingestion frameworks that integrate with Databricks, Snowflake, AWS services (S3, SQS, Lambda), and vendor data APIs, ensuring data quality, lineage, and schema evolution.
  • Establish data modeling frameworks, including star/snowflake schemas and more.

About Abacus Insights

Abacus Insights is dedicated to transforming healthcare data management, aiming to create a more efficient and effective health plan landscape. Our team is committed to innovation, collaboration, and making a significant impact in the healthcare industry.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages. View directory listings: all jobs, search results, location & role pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.