About the job
UBDS Group is hiring a Data Engineer with a focus on AWS technologies, based in Manchester, England. This role suits professionals experienced in building and optimizing data platforms, especially those with a background in cloud data pipelines and distributed data processing. The team values engineers who deliver scalable, reliable solutions and who take pride in maintaining high data quality.
What You’ll Do
- Design, build, and maintain data pipelines and transformation workflows using modern data engineering tools.
- Develop and manage both batch and real-time data processing solutions.
- Create curated, reusable data assets to support analytics and reporting.
- Ensure data quality, integrity, and consistency across multiple sources.
- Work with data from APIs, file-based ingestion (such as SFTP), and event streams (including Kafka).
- Tune pipelines for performance, scalability, and cost efficiency.
- Support the evolution of data platform components and reusable engineering patterns.
- Follow established architecture and engineering standards.
- Collaborate with DevOps engineers, testers, and architects to deliver end-to-end solutions.
- Help onboard new data sources and integrate them into existing platforms.
- Share knowledge and contribute to continuous improvement within engineering teams.
Key Technologies
Core Stack
- AWS (main platform): S3, EMR, Glue
- Kafka for event-driven processing
- Python and PySpark for engineering and transformation tasks
- Terraform for infrastructure as code
- GitHub for version control and CI/CD
Additional / Nice-to-Have Experience
- Azure data platforms
- Databricks or Microsoft Fabric
- Multi-cloud architectures and related tooling
This position offers the chance to work alongside a multidisciplinary team, developing data assets that support both operational and analytical needs. UBDS Group values engineers who contribute to knowledge sharing and ongoing improvement across the team.

