company

Data Engineer at Irth Solutions | Remote - India

Irth SolutionsRemote — India
Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Key ResponsibilitiesData Pipeline DevelopmentDesign and maintain data ingestion pipelines across AWS, Azure, and GCP. Develop batch and streaming pipelines using Databricks, Spark/PySpark, SQL, Delta Live Tables, and Lakeflow. Utilize medallion architecture patterns for effective structured data transformation. Implement Change Data Capture (CDC), Slowly Changing Dimensions (SCD) Type 1/2, schema evolution, and data validation. Platform & Storage ManagementOversee Delta Lake storage, including tables, partitions, and performance optimization techniques such as OPTIMIZE, Z-ORDER, and VACUUM. Support metadata management, lineage tracking, and cataloging using Unity Catalog. Assist in multi-cloud integrations between various cloud storage solutions and Databricks. Governance, Quality & ComplianceEstablish data quality validation, profiling, and monitoring protocols in line with governance standards. Implement security measures including Role-Based Access Control (RBAC), encryption, and data classification. Facilitate metadata and lineage implementation using tools like Unity Catalog and Purview. Orchestration, Automation & OperationsCreate and manage workflows utilizing Databricks Workflows, Delta Live Tables, Azure Data Factory, and other tools.

About the job

Irth Solutions is at the forefront of innovation, developing state-of-the-art technology platforms that consistently redefine industry standards. Our dynamic product-centric culture fosters collaboration and offers significant growth opportunities, making it an exciting place to work on advanced enterprise-scale data solutions.

We are in the process of creating a sophisticated, multi-cloud enterprise data estate utilizing Databricks to unify data across AWS, Azure, and GCP. We are seeking a Data Engineer to facilitate the implementation and operationalization of this integrated data platform.

Position Overview

As part of our team, you will contribute to the development of a cutting-edge Databricks-based Lakehouse platform designed to streamline and govern data across diverse cloud environments and applications.

In this hands-on role, you will be responsible for constructing scalable data pipelines, enforcing governance and quality standards, and enhancing the enterprise data architecture. Collaborating closely with the Senior Data Architect, you will design robust, secure, and efficient data pipelines leveraging Databricks, Spark, and other cloud-native technologies.

This role is perfect for mid-level engineers eager to deepen their expertise in Databricks, Spark, Delta Lake, and contemporary lakehouse architecture.

About Irth Solutions

Irth Solutions specializes in developing pioneering software products that push the limits of technology and innovation. Our commitment to excellence and a collaborative working environment ensures that we are always setting new benchmarks in the industry.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.