companyaccellor logo

Senior Data Engineer - Microsoft Azure Fabric

accellorHyderabad, Telangana, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Requirements:Experience: Minimum of 5 years in data engineering with at least 2 years specifically in Data Fabric. Microsoft Fabric Expertise:Proficient in managing Fabric notebooks, pipelines, and workspace configurations. Experience in implementing and orchestrating Fabric Data Agents. Familiarity with Fabric CLI and CI/CD deployment practices. Programming & Development Skills:Advanced proficiency in Python. Experience with PySpark for distributed data processing. Skilled in using Pandas and Polars for data manipulation. Knowledge of Python libraries for data engineering workflows. Experience with REST API development and integration. Data Platform & Storage Knowledge:Experience with Delta Lake and Iceberg table formats. Knowledge of Delta table optimization techniques. Expertise in Spark performance tuning and SQL query optimization. Development Environment:Experience with Visual Studio Code. Proficient in Azure DevOps for CI/CD and deployment pipelines. Experience with both code-first and low-code development approaches. Data Modeling Proficiency:Expertise in dimensional modeling for data warehouses. Knowledge of slowly changing dimensions (SCD Type 1, 2, 3). Familiarity with modern lakehouse architecture patterns and metadata-driven approaches.

About the job

Join our dynamic team at accellor as a Senior Data Engineer. In this pivotal role, you will leverage your extensive experience to design, develop, and optimize innovative data solutions utilizing Microsoft Fabric. Your deep technical expertise in modern data engineering practices and familiarity with Microsoft's unified analytics platform will be essential. Experience with Data Bricks will also be valued.

Key Responsibilities:

  • Architect and implement scalable data pipelines and ETL/ELT processes within Microsoft Fabric, adopting a code-first approach.
  • Create and maintain notebooks, data pipelines, workspaces, and other configurations within Fabric.
  • Design and enhance data architectures using delta tables, lakehouse methodologies, and advanced data warehouse patterns.
  • Develop data modeling solutions, including star and snowflake schemas, as well as manage slowly changing dimensions (SCDs).
  • Optimize performance of Delta, Spark, and SQL workloads through advanced techniques like partitioning and liquid clustering.
  • Utilize CI/CD practices via Azure DevOps for the development and deployment of Fabric solutions.
  • Integrate data workflows using Fabric Data Agents and REST APIs.
  • Collaborate cross-functionally with development teams and stakeholders to translate business requirements into technical solutions.

About accellor

accellor is a forward-thinking technology company focused on delivering cutting-edge data solutions. Our team thrives on innovation and is dedicated to leveraging the latest technologies to empower businesses and enhance data-driven decision-making.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.