companyUBDS Group logo

Senior Data Engineer - Multi-Cloud

UBDS GroupManchester, England, United Kingdom
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Skills & ExperienceEssential Proven expertise in data engineering and architecture on complex projects. Demonstrated ability to construct and manage automated data pipelines using technologies such as Spark. Experience with event-driven architectures and optimizing data pipeline performance. Strong understanding of ETL processes and data integration patterns, including self-service data onboarding. Practical experience with cloud platforms AWS and Azure (both required). Familiarity with key services including: AWS: EC2, EMR, S3, Lambda Azure: Blob Storage and associated services Knowledge of cloud networking concepts within AWS and Azure frameworks. Experience with Terraform (IaC) and GitLab (CI/CD pipelines). Strong foundation in DevOps and modern software engineering practices. Desirable Background in government or regulated environments. Understanding of large-scale data platforms and advanced analytics.

About the job

Join UBDS Group as a Senior Data Engineer, where you will be at the forefront of designing, developing, and enhancing scalable data platforms within intricate transformation initiatives. This pivotal role demands extensive knowledge in cloud data engineering, architecture, and DevOps methodologies, with proficiency in both AWS and Azure environments.

Your contributions will be crucial in driving high-quality data integration, facilitating advanced analytics applications, and delivering solid, reusable data solutions that align with client objectives.

Key Responsibilities

  • Architect and implement scalable, automated data pipelines utilizing cloud-native technologies such as Spark, while integrating with on-premise data sources as necessary.
  • Develop and manage event-driven data architectures, maximizing pipeline efficiency, parallel processing, and proactive risk identification (e.g., fraud detection scenarios).
  • Construct and oversee data access layers and ETL frameworks, allowing for both self-service and ad-hoc data asset onboarding.
  • Innovate reusable data engineering patterns and tools to enhance productivity, scalability, and uniformity across projects.
  • Employ DevOps and software engineering best practices, including Infrastructure as Code (IaC) and Continuous Integration/Continuous Deployment (CI/CD) pipelines.
  • Collaborate with multidisciplinary teams to ensure high standards of data integration, governance, and performance.
  • Operate across hybrid cloud frameworks (AWS and Azure), ensuring secure, resilient, and scalable solutions.
  • Assist in the deployment and optimization of data solutions leveraging services such as:
    • AWS: EC2, EMR, S3, Lambda
    • Azure: Blob Storage and associated services
  • Align efforts with client data strategies, governance frameworks, and security requirements.
  • Foster knowledge sharing and skill enhancement within both UBDS and client teams.

About UBDS Group

UBDS Group is a forward-thinking technology firm specializing in data-driven transformation solutions. We are committed to delivering innovative, scalable, and sustainable data platforms that empower organizations to make informed decisions based on high-quality data.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.