companyUBDS Group logo

Data Engineer - AWS at UBDS Group | Manchester, England

UBDS GroupManchester, England, United Kingdom
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Skills & ExperienceEssentialProven experience in data engineering, specifically in building and maintaining data pipelines. Strong proficiency in Python and PySpark. Hands-on experience with AWS data services (e.g., S3, EMR, Glue). Familiarity with event-driven architectures, particularly Kafka. Understanding of batch and real-time data processing methodologies. Experience working with large-scale datasets and distributed systems. Knowledge of data quality, validation, and schema management practices. Experience using Terraform and GitHub in a DevOps context. Ability to operate within defined engineering standards and best practices. DesirableExperience with Azure, Databricks, or Microsoft Fabric. Background in regulated environments. Experience in data migration from legacy systems.

About the job

UBDS Group is hiring a Data Engineer with a focus on AWS technologies, based in Manchester, England. This role suits professionals experienced in building and optimizing data platforms, especially those with a background in cloud data pipelines and distributed data processing. The team values engineers who deliver scalable, reliable solutions and who take pride in maintaining high data quality.

What You’ll Do

  • Design, build, and maintain data pipelines and transformation workflows using modern data engineering tools.
  • Develop and manage both batch and real-time data processing solutions.
  • Create curated, reusable data assets to support analytics and reporting.
  • Ensure data quality, integrity, and consistency across multiple sources.
  • Work with data from APIs, file-based ingestion (such as SFTP), and event streams (including Kafka).
  • Tune pipelines for performance, scalability, and cost efficiency.
  • Support the evolution of data platform components and reusable engineering patterns.
  • Follow established architecture and engineering standards.
  • Collaborate with DevOps engineers, testers, and architects to deliver end-to-end solutions.
  • Help onboard new data sources and integrate them into existing platforms.
  • Share knowledge and contribute to continuous improvement within engineering teams.

Key Technologies

Core Stack

  • AWS (main platform): S3, EMR, Glue
  • Kafka for event-driven processing
  • Python and PySpark for engineering and transformation tasks
  • Terraform for infrastructure as code
  • GitHub for version control and CI/CD

Additional / Nice-to-Have Experience

  • Azure data platforms
  • Databricks or Microsoft Fabric
  • Multi-cloud architectures and related tooling

This position offers the chance to work alongside a multidisciplinary team, developing data assets that support both operational and analytical needs. UBDS Group values engineers who contribute to knowledge sharing and ongoing improvement across the team.

About UBDS Group

UBDS Group is dedicated to innovation and excellence in data solutions, leveraging the power of cloud technologies to enhance business operations. Our team is committed to fostering a collaborative environment where creativity and technical expertise thrive.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.