Lead Data Engineer

Join UBDS Group as a Senior Data Engineer, where you will be at the forefront of designing, developing, and enhancing scalable data platforms within intricate transformation initiatives. This pivotal role demands extensive knowledge in cloud data engineering, architecture, and DevOps methodologies, with proficiency in both AWS and Azure environments.Your contributions will be crucial in driving high-quality data integration, facilitating advanced analytics applications, and delivering solid, reusable data solutions that align with client objectives.Key Responsibilities Architect and implement scalable, automated data pipelines utilizing cloud-native technologies such as Spark, while integrating with on-premise data sources as necessary. Develop and manage event-driven data architectures, maximizing pipeline efficiency, parallel processing, and proactive risk identification (e.g., fraud detection scenarios). Construct and oversee data access layers and ETL frameworks, allowing for both self-service and ad-hoc data asset onboarding. Innovate reusable data engineering patterns and tools to enhance productivity, scalability, and uniformity across projects. Employ DevOps and software engineering best practices, including Infrastructure as Code (IaC) and Continuous Integration/Continuous Deployment (CI/CD) pipelines. Collaborate with multidisciplinary teams to ensure high standards of data integration, governance, and performance. Operate across hybrid cloud frameworks (AWS and Azure), ensuring secure, resilient, and scalable solutions. Assist in the deployment and optimization of data solutions leveraging services such as: AWS: EC2, EMR, S3, Lambda Azure: Blob Storage and associated services Align efforts with client data strategies, governance frameworks, and security requirements. Foster knowledge sharing and skill enhancement within both UBDS and client teams.

Join the innovative team at UBDS Group as a Data Engineer specializing in Multi-Cloud environments. In this pivotal role, you will play a crucial part in designing, developing, and optimizing data platforms that drive complex transformation programs. We are looking for an engineer with practical experience in data pipelines, cloud platforms, and ETL processes who is eager to enhance their skills in a collaborative and results-oriented environment.Your contributions will be vital in building dependable, scalable data solutions that facilitate analytics, reporting, and operational use cases.Key Responsibilities Design and maintain data pipelines and ETL processes leveraging cloud-native technologies (e.g., Spark). Assist in integrating cloud and on-premise data sources effectively. Support the implementation of event-driven data pipelines to enhance performance and scalability. Help develop data access layers and reusable ETL components. Facilitate the onboarding of new data sources, focusing on the preparation and transformation of datasets. Collaborate with senior engineers to uphold data engineering best practices and standards. Contribute to CI/CD pipelines and Infrastructure as Code (IaC) initiatives. Operate within AWS and Azure environments, assisting with the deployment and maintenance of data solutions. Engage with services such as: AWS: EC2, EMR, S3, Lambda Azure: Blob Storage and associated services Work alongside cross-functional teams to ensure data quality, reliability, and performance. Participate in knowledge-sharing and continuous improvement activities.Skills & ExperienceEssential Proven experience in data engineering or ETL development. Familiarity with data pipelines and data processing frameworks (e.g., Spark or similar). Proficiency in cloud platforms (AWS and/or Azure; experience with both is highly desirable). Solid understanding of ETL processes and data integration concepts. Basic experience with Infrastructure as Code (e.g., Terraform) and/or CI/CD tools (e.g., GitLab). Knowledge of key services such as: AWS: EC2, S3 (with EMR/Lambda experience being beneficial) Azure: Blob Storage Understanding of version control and collaborative development practices. Awareness of data security and governance considerations.Desirable Experience with event-driven architectures or streaming technologies. Background in data access layers or data platform design. Experience in public sector or regulated environments. Knowledge of cloud networking fundamentals. Familiarity with fraud analytics or large-scale data use cases.Security Requirements This position requires Security Clearance (SC). Candidates must be eligible and willing to undergo the clearance process.

Role overview ubds is hiring a DevOps Engineer with a focus on multi-cloud environments in Manchester, England. This position works closely with colleagues from different disciplines to build and maintain infrastructure that supports multiple cloud platforms. What you will do Design and implement infrastructure solutions that scale and remain reliable across several cloud providers Work alongside cross-functional teams to deliver projects and support ongoing operations Automate workflows and deployment processes to improve efficiency Maintain high availability for services and contribute to continuous improvement efforts

Join UBDS Group as a Senior DevOps Engineer, where you will design, build, and manage cutting-edge cloud-based solutions across complex transformation projects. This pivotal role demands extensive proficiency in multi-cloud platforms such as AWS and Azure, emphasizing automation, scalability, and robust service delivery.As a Senior DevOps Engineer, your contributions will empower engineering teams to deliver exceptional, high-quality solutions by leveraging contemporary DevOps methodologies, platform engineering, and cloud-native tools.Key Responsibilities Architect, develop, and sustain cloud-based services and infrastructure across AWS and Azure environments. Create and uphold CI/CD pipelines for reliable and consistent deployment processes. Design and manage Infrastructure as Code (IaC) to ensure scalable and secure environments. Facilitate multi-cloud strategies, guaranteeing interoperability and uniformity across AWS and Azure. Partner with development and data teams to integrate DevOps best practices throughout the delivery lifecycle. Maintain high availability, performance, and security of cloud services. Establish monitoring, logging, and alerting systems to enhance operational excellence. Advocate for automation and standardization to minimize manual workflows and boost efficiency. Assist in incident management, troubleshooting, and root cause analysis. Drive continuous improvement of tools, processes, and engineering standards.Skills & ExperienceEssential Extensive experience in DevOps engineering within cloud environments. Proven track record of developing and supporting cloud-based services. Proficient in AWS and Azure (multi-cloud) platforms. Hands-on expertise with CI/CD tools and pipelines (e.g., GitLab, GitHub Actions, Azure DevOps). Strong knowledge of Infrastructure as Code (e.g., Terraform, ARM, Bicep, or similar). Familiarity with containerization and orchestration (e.g., Docker, Kubernetes). Experience implementing monitoring and logging solutions (e.g., CloudWatch, Azure Monitor, Prometheus, Grafana). In-depth understanding of cloud networking, security, and identity management. Experience working in agile, collaborative delivery environments.Desirable Experience in public sector or regulated environments. Awareness of platform engineering and reusable infrastructure patterns. Experience supporting data platforms or event-driven architectures. Knowledge of security best practices and compliance frameworks. Familiarity with serverless architectures (e.g., AWS Lambda, Azure Functions).Security Requirements This position may necessitate Security Clearance (SC). Candidates must be eligible and prepared to undergo the clearance process.

Join UBDS Group as a Senior Test Engineer, where you will be pivotal in enhancing our test automation and data validation strategies to support intricate data and cloud transformation initiatives. This position is tailored for engineers with substantial expertise in ETL testing, modern automation frameworks, and cloud-native data solutions.In this role, you will design, build, and refine automated testing solutions, guaranteeing data quality and reliability while aligning with our clients' strategic goals.Key ResponsibilitiesDevelop and deploy automated test frameworks for data pipelines, ETL processes, and cloud-based systems.Lead data validation efforts, ensuring accuracy, completeness, and integrity across complex datasets.Create and maintain test automation using Python and pytest, employing TDD and BDD (Behave) methodologies.Generate and manage test data for effective ETL and data warehousing validation.Drive continuous improvement in automation frameworks, promoting efficiency, reusability, and scalability.Collaborate with engineering teams to integrate shift-left testing practices throughout the development lifecycle.Engage in peer and code reviews, alongside CI/CD processes, to maintain the quality and consistency of deliverables.Support cloud adoption initiatives, leveraging platforms like AWS and Azure, as well as technologies such as Kafka.Identify opportunities for re-use and standardization, contributing to a comprehensive toolbox of data engineering and testing patterns.Ensure testing outcomes are aligned with client strategies, including Digital, Data, and Analytics objectives.Facilitate knowledge transfer and skill development within client teams to ensure sustainable delivery.

bet365 is looking for a Data Engineer with experience in Google Cloud Platform (GCP) to join the team in Manchester. This position centers on building and maintaining data pipelines that support analytics projects across the company. Role overview The Data Engineer will design, develop, and manage data pipelines on GCP. The work involves ensuring data flows efficiently and remains accessible for analytics teams. A strong background in cloud technologies is essential for optimizing the company's data infrastructure. What you will do Design and construct data pipelines using Google Cloud Platform tools Maintain and improve existing data infrastructure Support seamless integration and data accessibility for analytics teams Requirements Experience with Google Cloud Platform in a data engineering context Background in designing, building, and maintaining data pipelines Ability to optimize data infrastructure for analytics needs

About UBDSAt UBDS Group, we are dedicated to enabling organizations to undergo exceptional digital transformations through pioneering technology solutions. Our collaboration spans both public and private sectors as we design and develop products, platforms, and services that truly enhance user experience.We are in search of a Senior Data Engineer who possesses a blend of advanced technical skills and a consulting-oriented mindset. This role is ideal for someone who thrives in uncertain environments, prioritizes user needs, and can transform complex business challenges into scalable, production-ready data solutions.The RoleAs a Senior Data Engineer at UBDS, you will collaborate with clients, designers, analysts, and engineers to conceptualize and implement innovative data solutions from start to finish. You will take the lead on technical strategy, make informed design decisions, and aid teams in delivering high-quality solutions that perform effectively in real-world scenarios.This is a hands-on position that grants you significant influence: you will be building, mentoring others, and assisting clients in recognizing exemplary practices.What You’ll DoTranslate ambiguous business challenges into precise data-driven analytical and technical solutions.Design, construct, and manage production-quality data pipelines, models, and products utilizing SQL, Python, and contemporary data engineering frameworks.Architect across data warehouses, lakehouses, and event-driven architectures, incorporating robust semantic models for analytics and visualization.Deliver solutions on cloud data and AI platforms (AWS/Azure), leveraging solid software engineering, testing, and CI/CD methodologies.Integrate analytics, experimentation, AI/ML, data governance, security, and data quality best practices as standard procedure.Produce clear data visualizations and narratives that empower clients to comprehend and act on insights.Engage closely with users and stakeholders in Agile, client-centric environments, deriving insights from live services and real-world feedback.Exhibit strong critical thinking, meticulous attention to detail, and adherence to industry and governmental standards to create solutions that are straightforward to transition, maintain, and evolve.What We’re Looking ForCore Data & Technical SkillsProficient in converting vague business problems into explicit data, analytical, and technical specifications.Strong expertise in SQL and Python for data modeling, transformation, automation, and analysis.Experience in designing data models and architectures across data warehouses, lakehouses, and event-driven systems, or strong semantic modeling proficiency in Power BI or other visualization tools.Hands-on experience with modern data engineering frameworks, including but not limited to Spark/PySpark, Pandas, and orchestration tools.Familiarity with cloud data and AI platforms on AWS or Azure (e.g., Databricks, Redshift, Bedrock, Microsoft Fabric).Solid foundation in software engineering principles, including Git, testing, and CI/CD practices.

UBDS Group is hiring a Data Engineer with a focus on AWS technologies, based in Manchester, England. This role suits professionals experienced in building and optimizing data platforms, especially those with a background in cloud data pipelines and distributed data processing. The team values engineers who deliver scalable, reliable solutions and who take pride in maintaining high data quality. What You’ll Do Design, build, and maintain data pipelines and transformation workflows using modern data engineering tools. Develop and manage both batch and real-time data processing solutions. Create curated, reusable data assets to support analytics and reporting. Ensure data quality, integrity, and consistency across multiple sources. Work with data from APIs, file-based ingestion (such as SFTP), and event streams (including Kafka). Tune pipelines for performance, scalability, and cost efficiency. Support the evolution of data platform components and reusable engineering patterns. Follow established architecture and engineering standards. Collaborate with DevOps engineers, testers, and architects to deliver end-to-end solutions. Help onboard new data sources and integrate them into existing platforms. Share knowledge and contribute to continuous improvement within engineering teams. Key Technologies Core Stack AWS (main platform): S3, EMR, Glue Kafka for event-driven processing Python and PySpark for engineering and transformation tasks Terraform for infrastructure as code GitHub for version control and CI/CD Additional / Nice-to-Have Experience Azure data platforms Databricks or Microsoft Fabric Multi-cloud architectures and related tooling This position offers the chance to work alongside a multidisciplinary team, developing data assets that support both operational and analytical needs. UBDS Group values engineers who contribute to knowledge sharing and ongoing improvement across the team.

NO PRIOR EXPERIENCE NECESSARY, COMPREHENSIVE TRAINING PROVIDEDEmbark on an exciting journey into the realm of Cloud Computing with us.In light of a significant skills gap in the industry, there is a high demand for AWS Cloud Computing Engineers.We collaborate with a network of employers eager to hire newly trained professionals who are enthusiastic about a career in Cloud Computing.Our training programs equip you with the essential knowledge, skills, and certifications needed to excel. After completion, we will connect you with our employer partners to help fulfill critical roles within this thriving sector.Join our complimentary AWS Career Webinar by clicking 'Apply for this job,' and we will forward you the joining link. After attending this free online event, you can determine if this career path aligns with your aspirations.

Vix Technology is seeking a Cloud Engineer in Manchester to support and maintain cloud infrastructure, with a strong focus on AWS environments. This position plays a key role in ensuring secure, efficient, and reliable operations within a DevSecOps culture. The Cloud Engineer will work closely with engineering teams to troubleshoot technical issues, deploy solutions, and uphold operational best practices. What you will do Support daily operations, maintenance, and security for both production and non-production cloud environments, following ITSM guidelines. Deploy solutions on AWS and address technical challenges as they arise. Collaborate with engineering teams to encourage best practices in a DevSecOps setting. Build and maintain CI/CD pipelines to streamline development workflows. Develop and update internal documentation to ensure consistent operations. Requirements Experience configuring and supporting AWS cloud-native solutions. Knowledge of Active Directory, DNS, and core networking concepts. Proficiency in scripting languages such as PowerShell or Python; familiarity with C# or Java is a plus. Comfort working in agile environments and applying DevSecOps principles. Experience with infrastructure-as-code tools like CloudFormation, CDK, or Terraform. Background in system monitoring and remediation using tools such as Splunk or CloudWatch. Understanding of security best practices, ITSM frameworks, and a customer-focused approach. Work environment Vix Technology fosters a collaborative workplace where sharing diverse perspectives is encouraged. Team members have opportunities for professional growth and contribute to projects that shape public transit systems around the world.

Founded in 2017, Obsidian Security was established to address a crucial need: securing the SaaS applications integral to modern business operations, such as Microsoft 365, Salesforce, and many more. Supported by leading investors like Greylock, Norwest Venture Partners, and IVP, we have developed a comprehensive SaaS security platform designed to mitigate risks, detect and respond to threats, and prevent breaches at their source. Our team comprises industry leaders who played pivotal roles in shaping endpoint and identity security at companies such as CrowdStrike, Okta, Cylance, and Carbon Black. Currently, we are revolutionizing SaaS security in the age of agentic AI. Today, Obsidian enjoys the trust of global enterprises including Snowflake, T-Mobile, and Pure Storage, safeguarding more than 200 organizations across North America, Europe, the Middle East, Southeast Asia, Australia, and New Zealand, including numerous Fortune 1000 and Global 2000 companies. With robust global momentum, an expanding partner ecosystem including SentinelOne, Databricks, and Google Cloud, and a major fundraising initiative on the horizon, we are rapidly scaling towards sustainable growth and readiness for an IPO. Join us in defining the future of SaaS security!

Join our dynamic team at Adler & Allan as a Multi-Skilled Technician, where you will be integral in maintaining and enhancing the operational capabilities of our facilities. We are looking for an innovative individual who thrives in a fast-paced environment and is eager to contribute to a variety of technical tasks, ensuring our equipment runs at peak performance.In this role, you will be tasked with troubleshooting, repairing, and maintaining a wide range of systems and equipment. Your expertise will help us deliver exceptional service to our clients while promoting safety and efficiency.

UBDS Group is hiring a Test Engineer focused on automation and data validation to support ongoing data and cloud transformation projects. This role is based in Manchester, England. Role Overview This position suits an engineer with hands-on experience in ETL testing, test automation, and cloud data platforms. The main focus is to design, build, and improve automated testing solutions that protect data quality and ensure reliable outcomes for clients. Main Responsibilities Create and maintain automated tests for data pipelines, ETL workflows, and cloud-based systems. Perform data validation to confirm accuracy, completeness, and integrity of data sets. Manage test automation using Python and pytest, applying TDD and BDD (Behave) practices. Generate and organize test data for ETL and data warehouse validation tasks. Upgrade automation frameworks to boost efficiency and promote reusability. Work closely with engineering teams to introduce shift-left testing approaches. Participate in peer code reviews and contribute to CI/CD workflows. Support cloud-based solutions on platforms such as AWS and Azure, and work with technologies like Kafka. Spot and act on opportunities to standardize and reuse testing strategies. Align testing methods with client objectives and project timelines. Share knowledge within teams to encourage ongoing skill development.

Join Anaplan, a group of creative thinkers dedicated to revolutionizing business decision-making with our cutting-edge AI-enhanced scenario planning and analysis platform. Our mission is to empower our clients to surpass their competition and thrive in their respective markets.What brings Anaplanners together, regardless of their roles or locations, is our unwavering commitment to our customers’ success and our vibrant Winning Culture.Our clientele includes some of the most prestigious names in the Fortune 50, such as Coca-Cola, LinkedIn, Adobe, LVMH, and Bayer, among over 2,400 global organizations that trust our top-tier platform.Our Winning Culture fuels our teams of innovators. We value diverse perspectives and ideas, embrace leadership at all levels, strive for ambitious goals, and celebrate our achievements—both significant and small.Guided by principles that prioritize strategy, values, and disciplined execution, you will find inspiration, connection, growth, and rewards here. Your unique qualities are not just welcomed; they are essential. Join us to create what’s next—together!We are seeking a skilled Cloud Infrastructure Engineer to become a vital part of Anaplan’s Platform Infrastructure Team. In this role, you will manage the public cloud and Kubernetes infrastructure that supports Anaplan’s SaaS product offerings. Your responsibilities will encompass a wide array of tasks, directly influencing our growth through improvements in platform reliability, developer experience, and cost efficiency.The ideal candidate will have prior experience in high-performing DevOps teams supporting production environments and a genuine passion for technology and continuous learning. Anaplan leverages a diverse technical stack, including all three major public cloud providers, an OpenStack private cloud, and Kubernetes for orchestrating our microservices architecture. We extensively utilize Terraform for infrastructure as code, Grafana and OpenTelemetry for observability, along with a suite of automation tools common in DevOps environments.This is a hybrid working position at our York or Manchester location, reporting directly to the Engineering Management team.Your ImpactProvision and maintain cloud infrastructure, Kubernetes clusters, and in-cluster servicesDesign and implement new services and functionalities to enhance developer experience, improve platform reliability, and optimize costsTroubleshoot and lead the resolution of production-impacting issues, typically when the issue arises...

Role overview Version 1 is hiring a Senior AWS Engineer to design, build, and manage scalable cloud systems for a varied client base. This role focuses on delivering practical AWS solutions that support clients’ business goals and digital transformation. Locations Positions are available in London, Birmingham, Manchester, Newcastle upon Tyne, Edinburgh, and Belfast.

UBDS Group Holdings is seeking a Technical Architect focused on Data Platforms to join the team in Manchester. This role centers on leading the design and development of large-scale, cloud-based data platforms for a varied client base. Role Overview The Technical Architect shapes solution design patterns, upholds architectural standards, and supports strategic migrations and transitions between AWS and Azure environments. Collaboration with engineering, DevOps, and quality teams is integral to ensuring robust delivery and platform evolution. Main Responsibilities Develop and refine architecture patterns for data ingestion, processing, and access. Design scalable, resilient, and cost-effective data solutions using a Hub and Spoke model. Help build new data ingestion pipelines for both batch and real-time use cases. Ensure all solutions comply with established architectural standards and governance frameworks. Contribute to the creation of target architecture roadmaps. Advise on architectural choices for: Data ingestion: Kafka, APIs, SFTP Data processing: PySpark, EMR, Glue Storage: S3 and data lake architectures Work closely with DevOps, Data Engineers, and Quality Assurance to support seamless project delivery. Promote engineering best practices, including CI/CD, infrastructure as code, and observability. Oversee schema evolution and manage changes to upstream data sources. Lead onboarding of new data sources and services onto the platform. Ensure solutions meet requirements for: Data quality and consistency Performance and scalability Security and compliance Work within defined data modeling ownership boundaries as needed. Support the ongoing development of cloud strategy. Design for portability and adaptability to avoid platform lock-in. Participate in technical decisions that guide future platform direction. Contribute effectively within blended, cross-functional teams. Provide technical leadership and mentorship to delivery teams. Encourage efficient knowledge transfer and skills development. Location This position is based in Manchester, England, United Kingdom.

Matillion creates an intelligent data integration platform that helps organizations get more from their data. The company’s Data Productivity Cloud and Maia (AI-driven virtual data engineers) set new standards for building and managing data pipelines. Collaboration and shared purpose drive the team, known as #TeamGreen. Role overview The Cloud Operations Analyst role is based in Manchester and centers on the reliability, scalability, and security of Matillion’s cloud-native platforms. This position works closely with a Senior Cloud Analyst and covers AWS, GCP, and Azure environments. The work blends cloud infrastructure, FinOps, and SRE responsibilities, calling for a hands-on approach and a proactive mindset. Beyond resolving tickets, the role involves analyzing platform performance, driving cost efficiencies, overseeing FinOps governance, and using AI tools to boost productivity for both the individual and the team. What you will do Monitor and maintain cloud infrastructure across AWS, GCP, and Azure Work with senior team members to ensure platform reliability and security Analyze system performance to identify improvement areas Drive cost efficiency and oversee FinOps governance Implement AI tools to streamline operations Who this role suits This position fits those early in their cloud careers who want to learn deeply, work independently, and help build scalable solutions. Initiative and attention to detail are essential. Work location and schedule This is a hybrid position based in Manchester. Team members meet in the office two days per week to support in-person collaboration.

At Turnitin, we recognize that AI and data science are fundamental to our achievements and ambitious product strategy. As a Senior AI Data Engineer, you will join a dynamic global team of proactive and independent professionals dedicated to crafting sophisticated, well-structured AI and data systems. You will be at the forefront of developing our next-generation data and AI pipelines, significantly scaling our team's impact. You'll collaborate across various teams within Turnitin to integrate AI and data science into a diverse range of products aimed at enhancing learning, teaching, and academic integrity.Key Responsibilities:AI Data Infrastructure & Pipeline Management: Design, build, and operate scalable real-time data pipelines that facilitate ongoing Applied AI model training. Implement and maintain robust data infrastructure utilizing AI techniques and engineering best practices to ensure continuous model improvement.Data Collection: Lead efforts to collect, normalize, and store data from various sources, including external LLM providers.Collaboration: Work closely with AI R&D, Applied AI, and Data Platform teams to ensure smooth data flow and adherence to quality standards. Collaborate with stakeholders to curate and catalog high-quality datasets that support Applied AI retraining workflows and business goals.Support for AI R&D: Contribute to AI Research & Development initiatives by leveraging advanced data warehousing and engineering technologies. Engage in exploratory data projects to extract insights from Turnitin's extensive datasets.Communication: Foster clear communication across teams, aligning with the company vision while sharing insights on data infrastructure requirements and potential innovations.Technology Evolution: Stay updated with emerging tools and methodologies in AI data engineering, providing recommendations to enhance our AI data infrastructure and capabilities.

Collaboration Fuels Innovation. Join Roku in Revolutionizing Television Viewing!Roku stands as the top TV streaming platform across the U.S., Canada, and Mexico, with ambitions to empower every television globally. As pioneers in streaming technology, our mission is to create a comprehensive TV streaming platform that integrates the entire TV ecosystem. We connect viewers with their favorite content, enable publishers to grow and monetize their audiences, and offer advertisers unique engagement opportunities.From your very first day at Roku, you will make significant contributions. We are a rapidly expanding public company where every team member plays an active role. This is your chance to delight millions of TV streamers around the world while gaining invaluable experience across diverse areas. Are you driven by the challenge of creating scalable, efficient systems that handle vast datasets? Do you excel in designing and implementing innovative solutions that provide actionable insights for engineering teams? Are you eager to enhance open-source observability at an extensive scale? Join us in extending open-source observability tools and developing new capabilities that empower teams to manage data effectively and derive actionable insights. About the Team The Observability team is integral to Roku’s Cloud Technology Infrastructure organization, playing a vital role in our platform's success. We are a high-performing, agile international team focused on ownership, effective communication, and delivering impactful engineering solutions.