Senior Data Engineer

Role overview hmgroup needs a Senior Data Engineer based in London to influence how data is used across the company. This position centers on building and maintaining systems that move and organize large amounts of data, helping teams make informed decisions. Main responsibilities Design and manage data pipelines that process significant data volumes Build architecture to ensure reliable data processing and analytics Convert raw data into insights that support teams throughout hmgroup

About XYZ RealityXYZ Reality is an innovative, award-winning Series-A startup on the cusp of our next funding round. Our goal is to enhance our platform by improving its features, performance, and scalability, all while transforming the construction industry.As a dynamic multi-disciplinary organization, we operate across various fields such as cloud development, data governance, data processing pipelines, electronics, embedded software/hardware, mechanical design/manufacturing, AI & computer vision, and data science, all contributing to the efficacy of our Building Information Modeling (BIM) Platform.To help propel our mission, we are in search of a Senior Data Engineer who possesses extensive experience in data modeling, database management, and data pipeline development. The ideal candidate will play a pivotal role in maintaining our existing tech stack and developing new features with an emphasis on performance and scalability. Collaboration with our API/backend development and data pipeline teams will be crucial to create robust and efficient solutions.

With Intelligence, now a part of S&P Global, is at the forefront of revolutionizing data offerings for participants in alternatives and private markets. As a member of a global organization boasting over 35,000 employees, we possess the unique ability to understand intricate nuances while maintaining a wide-ranging perspective. We empower our clients to assess new investment opportunities within the capital and commodities markets, navigate the energy sector's expansion, harness the acceleration of artificial intelligence, and adapt to the evolving landscape of public and private markets. Our mission is to advance essential intelligence.We are embarking on an exciting phase of growth, with significant funding aimed at transforming us into a pioneering, data-centric platform that places information, automation, and insights at its core.To meet the escalating demands of a dynamic, data-driven organization, we are expanding our data capabilities. This role is an outstanding opportunity for an enthusiastic individual ready to make a tangible impact while engaging with cutting-edge tools and contributing to our data strategy across products and teams.Your ResponsibilitiesDesign, develop, and maintain scalable data architectures and ETL pipelines.Build and manage data models and data warehouse solutions utilizing Airflow, dbt, and Redshift.Write clean, efficient Python and SQL code for data processing and transformation.Integrate data from internal and third-party APIs and services.Optimize data pipelines for performance, scalability, and reliability.Collaborate with data scientists, analysts, and engineering teams to fulfill business requirements.Implement and uphold data security and compliance standards.Utilize version control systems (e.g., Git) to manage and maintain project codebases.Contribute to the ongoing enhancement of data processes and tooling across the organization.

Join our team as a Senior Data Engineer specializing in AWS!Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentAbout the RoleWe are seeking a talented Senior Data Engineer with expertise in AWS to be a key player in our dynamic team of engineering professionals. You will spearhead the design, construction, and deployment of innovative cloud-based data pipelines that drive transformative outcomes for Tier 1 financial services clients. Your contributions will significantly enhance data ingestion, transformation, and delivery at scale across the financial services landscape.Your ResponsibilitiesDesign and implement end-to-end data pipelines using AWS-native tools and cutting-edge data architectures.Collaborate closely with clients to gather requirements, craft tailored solutions, and deploy production-ready systems.Utilize AWS Well-Architected Principles to ensure your solutions are scalable, secure, and resilient.Lead the development of robust, thoroughly tested, and fault-tolerant data engineering solutions.Mentor junior engineers, fostering a culture of knowledge sharing and continuous learning within the team.What We Seek

Join our innovative team at Synthesia as a Senior Data Engineer, where you will play a pivotal role in shaping the future of AI-driven video synthesis. As a key member of our data engineering team, you will design, implement, and maintain robust data pipelines that enable our advanced machine learning models to thrive. Your expertise will help us harness the power of data, ensuring high availability and performance. Collaborate with cross-functional teams to transform raw data into actionable insights that drive our product's success and enhance user experiences.

Join physicsx as a Senior Simulation Data Engineer, where you'll play a critical role in developing and optimizing simulation data workflows. You will collaborate closely with cross-functional teams to enhance our simulation capabilities and ensure data integrity. Your expertise will be instrumental in driving innovation and improving our processes.

Recursion Pharmaceuticals brings together technology and biology to advance drug discovery. The company’s Recursion Operating System combines machine learning, large-scale experiments, and a proprietary dataset that spans biological, chemical, and patient-related data. Each week, the team conducts millions of wet lab experiments and uses a supercomputing environment to find new connections in biology and chemistry. What you will do Develop, scale, and manage the core data platform. This includes building, operating, and optimizing systems that support querying and exploration across Recursion’s vast datasets, such as a chemistry library with billions of compounds, petabytes of microscopy images, and diverse assay results. Help make complex datasets accessible for scientific teams. Work closely with biologists, chemists, and data scientists to ensure data from different biological models and treatments can be explored and queried, even for new and evolving research questions. Mentor and support colleagues by sharing technical expertise and experience, helping others grow and increasing impact across teams. The team This role joins the Data Lake team, responsible for building and maintaining Recursion’s Data Lake and Data Lakehouse. The group manages both relational and object storage, ensuring all data is discoverable, queryable, and connected. As Recursion grows, the team integrates new data types under the guiding principle that all data flows to the Data Lake. Location London, England; Milton Park, England

Join Our Team! Contentful is seeking a Senior Data Engineer to play a pivotal role in designing, developing, and scaling advanced data solutions that drive analytics, operational reporting, and strategic decision-making within our organization. You will collaborate closely with our data, analytics, and business teams to create robust data pipelines, models, and integrations that ensure clean, reliable, and actionable data. You will be an integral part of a small, geographically diverse engineering team that operates with a product mindset—delivering iterative value while partnering closely with business and analytics stakeholders, and taking ownership of both the development and operational aspects of a critical data platform. Your Responsibilities Design, build, and maintain scalable data pipelines and transformations that integrate multiple systems and sources. Create high-quality data models that cater to analytics, reporting, and operational use cases. Collaborate with analytics, product, and business teams to identify data needs and translate them into effective technical solutions. Establish and enforce strong data quality, validation, and monitoring protocols to ensure the reliability and trustworthiness of our data. Optimize data storage, processing, and performance within cloud data warehousing environments. Contribute to the ongoing improvement of our modern data platform, including tooling, standards, and best practices. Support the operations of the data platform by troubleshooting issues, enhancing reliability, and ensuring SLAs are consistently met. Engage with cross-functional partners on governance, documentation, definitions, and data stewardship. Implement CI/CD practices and Infrastructure-as-Code (IaC) for automated deployment, testing, and environment management. Participate in code reviews, design discussions, and operational on-call rotations as required. Mentor team members and promote data engineering best practices across the organization. Your Skills and Experience Essential Qualifications 5+ years of experience in a Data Engineering or similar technical role. Expertise in SQL and experience working with cloud data warehouses (e.g., Snowflake, Redshift, BigQuery). Experience in building and maintaining ETL/ELT pipelines using tools such as dbt, Airflow, or similar frameworks. Proficiency in Python or another scripting language. Strong understanding of data modeling, data structures, and modern data architecture principles.

The RoleWe are excited to invite applications for the position of Senior Data Engineer to join our dynamic Data team based in London.This is an office-based position located at our London headquarters.Working at WGSNTogether, we shape the future.At WGSN, we thrive in a fast-paced and innovative environment filled with opportunities for professional growth. Our diverse team consists of consumer and design trend forecasters, content creators, designers, data analysts, advisory consultants, and more, all dedicated to a shared mission: to create tomorrow.Our reliable consumer and design forecasts empower exceptional product design, helping our clients envision a better future. Our offerings span consumer insights, beauty, consumer technology, fashion, interiors, lifestyle, food and drink forecasting, data analytics, and expert advisory services. If you're a specialist in your field, we would love to hear from you.Role OverviewAs WGSN expands its AI and Data capabilities, we aim to enhance our data architecture. As a Senior Data Engineer, you will be instrumental in designing, optimizing, and maintaining the data pipelines, models, and infrastructure that support our classification systems, AI workflows, forecasting models, TikTok insights, and consumer intelligence products.You will collaborate closely with our senior data scientists, analysts, and engineers, especially within the TikTok and Pulse pods, ensuring high-quality, well-structured, reliable data flows across Snowflake, Databricks, and downstream systems. This position is tailored for an individual with substantial technical expertise, advanced SQL and data modeling skills, and a passion for developing scalable, efficient data systems. This role is hands-on and requires a minimum of 5 years of experience in data engineering, including the ability to mentor junior engineers when necessary.Key ResponsibilitiesData Architecture & Modeling- Design, develop, and maintain scalable data architectures...

Join a Team Where Your Work Truly Matters.Advance your career with Qodea, where innovation is not just a catchphrase—it's part of our core identity.As a leading global technology group, we are dedicated to shaping the future, providing exceptional professionals with opportunities for high-impact work that shapes careers. By joining us, you are not merely undertaking projects; you are tackling challenges that have yet to be solved.Our exclusive clientele includes global leaders such as Google, Snap, Diageo, PayPal, and Jaguar Land Rover—companies that turn to us when deadlines loom, when others have faltered, and when the solutions must succeed.Say goodbye to mundane consultancy. Here, you will work at the intersection of technology, design, and human behavior to deliver rapid and meaningful outcomes. This is work that creates an impact—work you will proudly share with your peers.Qodea is designed for the future, fostering an environment where your skills will continuously evolve at the cutting edge of innovation and AI, ensuring your growth and development.We are in search of a Senior Data Engineer who will deliver outstanding solutions that exceed our clients' expectations by leveraging state-of-the-art tools and technologies.We seek individuals who exemplify:Innovation to tackle the most challenging problems.Accountability for every outcome.Integrity in all endeavors.Your RoleThe primary objective of this role is to design, develop, and manage scalable data pipelines and infrastructure to enable the effective processing and analysis of extensive, complex data sets. This position is tailored for impact, and we believe our best outcomes arise through collaboration. While we have a flexible working model, we anticipate that you will spend time on-site for collaboration sessions, client meetings, and internal workshops.Key ResponsibilitiesDevelop and maintain automated data processing pipelines using Google Cloud:Design, construct, and sustain data pipelines for data ingestion, ETL, and storage.Establish and uphold automated data pipelines to monitor data quality and resolve issues.Implement and maintain databases and data storage solutions:Stay informed about emerging trends and technologies in big data and data engineering.Ensure data quality, accuracy, and completeness.Implement and enforce data governance policies and procedures to uphold data quality and precision:Collaborate with data scientists and analysts to design and optimize data models for analytics and reporting.Develop and maintain data models for analytical and reporting purposes.Monitor and manage data infrastructure to ensure availability and performance.

Senior Data EngineerLocation: London (Hybrid)About SwapSwap serves as the foundation for modern agentic commerce, being the only AI-native platform that seamlessly integrates backend operations with a progressive storefront experience.Designed for brands aiming to sell anything, anywhere, Swap centralizes global operations, fuels intelligent workflows, and enables margin-preserving decisions through real-time data and capabilities. Our product suite encompasses cross-border transactions, tax solutions, returns management, demand planning, and our cutting-edge agentic storefront, empowering merchants with full transparency and actionable insights.At Swap, we are cultivating a culture that emphasizes clarity, creativity, and shared ownership as we revolutionize the landscape of global commerce.About the RoleWe are seeking a dedicated and detail-oriented Senior Data Engineer to join our platform team as we swiftly advance our technology stack for a new, data-driven era at Swap. In this role, you will lead transformative initiatives by developing world-class data systems for the entire organization, while also contributing to the platform’s vision and advocating for internal best practices.This position calls for a knowledgeable, hands-on, and enthusiastic team player who is eager to accelerate and scale a greenfield project. If you thrive in a fast-paced, collaborative environment where your contributions can make a significant impact, we want to hear from you!ResponsibilitiesAPI Strategy & Development: Lead the strategy and implementation of our API layer to facilitate product access to essential data.Platform Technical Vision: Shape and influence the technical direction of Swap’s data platform to ensure readiness for future business growth.Data Pipeline Development: Manage our replication pipelines, ensuring optimal observability, latency, and alerting capabilities.Data Quality & Governance: Champion best practices to ensure our data is reliable and trustworthy as we scale, delivering top-tier products for Swap.What We Are Looking For5+ years of experience as a data engineer in customer-centric product environments.Proven proficiency in Python for data pipeline creation, orchestration, and API development.

Join Us in Transforming the Creator Economy with AIFanvue is rapidly emerging as one of the leading platforms for creator monetization on a global scale. Our AI-driven, creator-centric platform empowers creators to connect with their audiences, engage meaningfully, and generate income directly at scale. Following our successful Series A funding, Fanvue has achieved over $100M in annual recurring revenue, with impressive triple-digit growth year-over-year, supporting countless creators and millions of fans around the world.As we continue to expand, the significance of data within our organization is becoming increasingly vital across various functions including product development, growth strategies, finance, and risk management. This position is pivotal in establishing a robust data foundation that the entire company can rely on, facilitating quicker decision-making, sophisticated analytics, and scalable machine learning capabilities. The RoleWe are seeking a Senior Data Engineer to take charge of and enhance Fanvue’s essential data infrastructure.This is a crucial, high-impact role where you will stabilize data ingestion processes, enhance observability and governance, minimize manual tasks, and enable advanced analytics and machine learning workloads. Your contributions will be foundational in helping Fanvue thrive as a genuinely data-driven organization. ResponsibilitiesOversee and stabilize end-to-end data ingestion pipelines, including Change Data Capture (CDC) ingestion using Amazon DMSAddress schema drift challenges and automate column ingestion to eliminate manual re-sync effortsDevelop production-grade observability for data pipelines, dbt runs, and Athena performanceSet up monitoring and alerting frameworks to proactively identify data quality issues or pipeline failuresEnhance CI/CD workflows for data transformations, aiming to reduce PR build times and deployment complexitiesDesign and implement reusable ingestion frameworks for swift onboarding of new data sourcesEstablish robust data governance protocols, including dbt tests in production and scheduled full-refresh pipelinesFacilitate advanced analytics and ML infrastructure, including AWS SageMaker integration and on-demand analytics environmentsImplement fine-grained access controls (RBAC) to safeguard PII and sensitive data as the company scalesManage Infrastructure as Code for the data platform utilizing AWS CDK

Join our innovative team at Elliptic as a Senior Data Engineer, where your expertise will help shape the future of blockchain intelligence. We are looking for a talented individual who is passionate about data engineering and wants to make an impact in the cryptocurrency space.In this role, you will design, develop, and optimize data pipelines, ensuring the integrity and accuracy of data that drives decision-making across the organization. Your work will involve collaborating with various stakeholders to identify data needs and implement solutions that enhance data accessibility and usability.

Join Pogust Goodhead as a Senior Data Engineer, where you will be at the forefront of data innovation and drive impactful solutions for our clients. Your expertise will enable us to harness data analytics, develop robust data pipelines, and ensure the integrity of our data systems. You will collaborate with cross-functional teams to optimize data workflows and enhance our data-driven decision-making processes.

Recursion Pharmaceuticals is reimagining drug discovery by combining biology and data in new ways. The Senior Scientific Data Engineer - Data Platform will help shape and maintain the data infrastructure that drives this mission. This position is based in either London or Oxford. Role overview This role focuses on designing, developing, and maintaining scientific data systems that underpin Recursion’s research and product development. The emphasis is on data architecture rather than machine learning or model building. The work involves: Managing the ingestion, standardization, and distribution of public and proprietary datasets essential for drug discovery. Enabling competitor intelligence, chemical tractability analysis, and compound design workflows through well-structured data products. Owning and evolving the data infrastructure that supports predictive modeling and machine learning across the company. This position suits engineers who enjoy building complex scientific data systems. It is not a modeling or data science role. Key data systems and products Flagship SAR Data Mart: Integrates commercial and public bioactivity databases (such as ChEMBL) with internal assay results. Commercial Vendor Data Mart: Maintains a catalog of purchasable compounds for internal design tools and tractability assessments. Biomedical Knowledge Graph: Offers semantic graph infrastructure connecting targets, diseases, and compounds to support AI-driven research. Chemical Synthesis Data: Stores reaction datasets for training retrosynthesis models and predicting chemical tractability. Patent Intelligence System: Converts patent feeds and competitor data into actionable insights for research and strategy. Compound Standardization Registry: Maintains a large-scale chemical structure repository to ensure consistency across billions of compounds, similar to UniChem. Important note This is a specialized Data Engineering position focused on data infrastructure and stewardship. The work does not include training or building predictive models, but it directly supports those efforts through reliable systems and curated datasets.

At Intercom, we are revolutionizing customer service through AI technology. Our mission is to empower businesses to deliver exceptional customer experiences by leveraging our advanced AI agent, Fin. This cutting-edge solution enables businesses to provide round-the-clock, flawless customer service and significantly enhances customer interactions. By integrating Fin with our Helpdesk, we offer the Intercom Customer Service Suite, a comprehensive solution tailored for complex queries requiring human assistance.Founded in 2011, Intercom has earned the trust of nearly 30,000 businesses globally, setting a new benchmark for customer service excellence. We are driven by core values that inspire us to push boundaries, innovate rapidly, and consistently deliver outstanding value to our clients.What Opportunities Await You?The demand for data at Intercom is skyrocketing, driven by our growth and ambition to integrate sophisticated, AI-driven data solutions. Our Data Engineering team is the heartbeat of our organization, responsible for constructing and upholding the infrastructure that transforms raw data into actionable insights, empowering teams across Product, Research, and more. We seek an experienced Senior Data Engineering Manager to lead pivotal data initiatives and propel our efforts forward.Key ResponsibilitiesThis role emphasizes impact and leadership. You will guide a team dedicated to designing and refining the core infrastructure that forms the backbone of our data ecosystem.Next-Gen Platform Evolution: Collaborate with product and business teams to architect and implement the next generation of our data stack, ensuring it meets the requirements of advanced analytics and AI applications.Enablement Through Tooling: Work closely with Analytics Engineers, Analysts, and Data Scientists to develop the self-service tools and infrastructure necessary for swift and secure deployments.Data Quality Guardianship: Establish advanced monitoring systems to proactively identify, highlight, and resolve data quality issues within our high-volume environment.Driving Automation: Create automation and tools that simplify the generation and discovery of high-quality analytics data, enhancing the overall efficiency of the data lifecycle.Your Strategic ImpactIn this pivotal role, you will not only shape our data strategy but also significantly influence the direction of our data infrastructure, enabling us to harness the power of data to drive business success.

Begin your journey with us. Advance your career here.AECOM is looking for a Senior Civil Engineer to play a key role in delivering civil engineering designs and comprehensive technical documentation for a variety of data centre projects. Your involvement will span from site due diligence assessments and master planning to detailed design and construction support. This position is essential in enhancing AECOM’s civil engineering capabilities within the data centre sector.In this role, you will be part of a Civil Engineering Business Unit, working in collaboration with ground engineers, structural engineers, mechanical engineers, electrical engineers, architects, project managers, environmental specialists, and surveyors both in the UK and internationally to support our diverse portfolio of data centre projects.As part of the Data Centres Market Sector, you will leverage your civil engineering expertise to contribute to significant projects for leading technology clients, collaborating with multidisciplinary teams across the UK and globally, further solidifying AECOM’s reputation in the Hyperscale and Co-location data centre markets.Your responsibilities will include:Providing civil engineering expertise for data centre initiatives while ensuring adherence to AECOM standards and applicable regulatory requirements.Delivering and reviewing designs and specifications for civil infrastructure, developing practical solutions for site development, earthworks, drainage, pavements, access, utility infrastructure, and other civil engineering tasks related to data centres.Coordinating with fellow civil engineers and technical experts to support the successful delivery of our data centre project portfolio, including collaboration with ground engineers, electrical engineers, mechanical engineers, structural engineers, project managers, architects, and environmental consultants across the UK and our global offices.Mentoring and assisting in the development of junior engineers, enhancing AECOM’s technical capabilities and delivery excellence within the Data Centres sector.Join us and thrive:At AECOM, we offer a comprehensive range of core and personalized benefits that support your well-being and future goals, tailored to fit your lifestyle. Enjoy career development opportunities, a flexible hybrid working model for a balanced work-life, access to technical practice networks, AECOM University, and volunteering days.

Join Aircall, a leading unicorn in the realm of AI-powered customer communications, where over 22,000 businesses globally harness our platform to enhance revenue, expedite issue resolution, and scale their customer-facing teams. We are transforming the communication landscape by integrating voice, SMS, WhatsApp, and AI into a cohesive workspace.Our growth is driven by a core philosophy: enable teams to work smarter, not harder. With our AI Voice Agent automating routine calls, AI Assist optimizing post-call tasks, and AI Assist Pro providing real-time insights, our solutions empower teams to achieve higher revenue and faster resolutions.Headquartered in Paris, with a robust presence in North America through our Seattle office, and teams across cities like Madrid, London, Berlin, San Francisco, New York City, Sydney, and Mexico City, Aircall has created a product that delights customers and a business model that scales rapidly, fueled by our commitment to innovation in AI across various product lines.At Aircall, you will be part of an ambitious, product-focused, and execution-driven team. We value visible impact, swift decision-making, and genuine growth.Our Work Culture: We are dedicated to understanding our customers, leveraging data meticulously, and striving for substantial outcomes. We champion ownership, continuous learning, and thoughtful execution. If you excel in a collaborative and dynamic environment where trust and impact are paramount, you will thrive here.We seek a passionate and dedicated Senior Data Engineer to become an integral part of our expanding Engineering Team. In this pivotal role, you will oversee our analytics and event platform stack.As a vital member of the Analytics & Data Platform team, your contributions will serve over 22,000 customers worldwide. Your efforts will unlock valuable data insights, enabling our clients to make informed decisions through real-time analytics, monitoring, and detailed reports.

Join our dynamic team at Eucalyptus as a Senior Data Engineer, where you will play a pivotal role in designing and implementing data solutions that drive our business forward. You will work with cutting-edge technology to ensure data reliability and accessibility, enabling our teams to make informed decisions. Your expertise in data engineering will contribute significantly to our mission, and you will have the opportunity to collaborate with cross-functional teams.