Data Engineer - Dry Bulk Commodities

Join our team as a Senior Data Engineer, where you will play a pivotal role in building and managing scalable data ingestion and Change Data Capture (CDC) capabilities on our Azure-based Lakehouse platform. Your expertise will drive our engineering maturity as we deliver ingestion and CDC preparation through Python projects and reusable frameworks. We are seeking a professional who applies best software engineering practices, including clean architecture, rigorous testing, code reviews, effective packaging, CI/CD, and operational excellence.Our platform emphasizes batch-first processing, allowing for the landing of streaming sources in their raw form while processing them in batch. We are selective in our evolution towards streaming as necessary.As part of the Common Data Intelligence Hub, you will collaborate closely with data architects, analytics engineers, and solution designers to create robust data products and ensure governed data flows across the enterprise.Your team is responsible for end-to-end ingestion and CDC engineering, including design, build, operation, observability, reliability, and reusable components.You will contribute to the development of platform standards, including contracts, layer semantics, and readiness criteria.While you will not primarily manage cloud infrastructure provisioning, you will work with the platform team to define requirements, review changes, and maintain deployable code for pipelines and jobs.Platform Data Engineering & DeliveryDesign and develop ingestion pipelines utilizing Azure and Databricks services, including Azure Data Factory pipelines and Databricks notebooks/jobs/workflows.Implement and manage CDC patterns for inserts, updates, and deletes, accommodating late arriving data and reprocessing strategies.Structure and maintain bronze and silver Delta Lake datasets, focusing on schema enforcement, de-duplication, and performance tuning.Create “transformation-ready” datasets and interfaces with stable schemas, contracts, and metadata expectations for analytics engineers and downstream modeling.Adopt a batch-first approach for data ingestion, ensuring raw landing, replayability, and idempotent batch processing while progressing towards true streaming as required.Software Engineering for Data FrameworksDevelop and maintain Python-based ingestion and CDC components as production-grade software, focusing on modules, packaging, versioning, and releases.Implement engineering best practices such as code reviews, unit/integration tests, static analysis, formatting/linting, type hints, and comprehensive documentation.Establish and enhance CI/CD pipelines for data engineering code and pipeline assets, covering build, testing, security checks, deployment, and rollback patterns.

Join our team at BDA_CDI HUB, where we deliver comprehensive IT solutions for T-Systems that encompass data management, analytics, visualization, and process automation.Our expertise covers everything from user-friendly analytics platforms to enterprise-level data warehouse and analytics solutions. We are dedicated to driving data-driven initiatives and implementing advanced analytics through cloud services, transforming our traditional data warehouse architecture into a centralized T-Systems Lakehouse framework to optimize performance and efficiency.Our work environment is dynamic, innovative, and focused on continuous learning and professional development.As a Senior Developer in Data Analytics & Data Engineering, your responsibilities will include:Designing IT platforms, processes, and structural frameworks for our evolving Lakehouse on Azure, using cutting-edge technologies such as Databricks, Data Factory, Data Lake Storage, Event Hub, and more.Developing sustainable architectures, prototyping solutions, and assessing new technologies to foster innovation.Supporting engineering teams in platform architecture development and mentoring them towards independent solution design.Ensuring the protection and security of business-critical and personal data.Collaborating with the team to improve platform architecture, establishing principles, patterns, and best practices.

Join our dynamic team as a Senior Data Engineer specializing in the Power Platform at Deutsche Telekom IT Solutions in Budapest. In this pivotal role within our international Common Data Intelligence Hub, you will enhance our Cloud Data & Analytics Platform by serving as the crucial link between Self-Service BI teams and the Azure Lakehouse backend.Our Cloud Data & Analytics Platform integrates Azure Lakehouse technologies (Data Factory, Databricks, dbt, CDC Framework) with Microsoft Power Platform services (Power BI, Power Apps, Power Automate, SharePoint Online). This innovative platform empowers business units to develop and manage their own analytics and reporting solutions while adhering to enterprise-level security, governance, and data management protocols.As a Senior Data Engineer, you will ensure that self-service solutions operate efficiently, securely, and reliably in accordance with established standards. You will provide guidance and support to business and data teams, helping them navigate the technical framework, governance principles, and best practices for sustainable analytics solutions. Collaboration with platform engineers will be key to maintaining operational alignment between the Power Platform frontend and the Lakehouse backend.Platform Operations & Maintenance:Ensure the reliable operation and performance optimization of Power Platform components (Power BI Service, Power Apps, Power Automate, SharePoint Online) within the Cloud Data & Analytics Platform.Monitor platform usage and performance to guarantee optimal resource allocation and cost efficiency.Manage Power BI gateways and secure data connections to the Azure Lakehouse backend (ADF, Databricks, dbt, CDC Framework).Oversee role-based access control (RBAC) and workspace permissions in line with corporate governance and Azure security principles.Optimize data refresh and load processes to maintain the freshness and stability of analytical datasets.Work closely with platform engineering teams to address incidents, coordinate upgrades, and implement technical improvements across both frontend and backend layers.Create standardized operational dashboards and reports to enhance transparency regarding platform usage, capacity, and performance metrics.Governance & Best Practices:Consult and coach Self-Service BI teams on effectively utilizing Power BI, Power Apps, and Power Automate within the governance framework.Guide new teams through onboarding and compliance processes, ensuring proper workspace configuration.

Join our esteemed client, a well-established IT consulting firm with over two decades of expertise in executing large-scale technology projects across various sectors. Their enduring collaborations with major organizations demonstrate their technical prowess and financial reliability, bolstered by consistently high external credit ratings. Operating with a streamlined core team, the company boasts low turnover rates and fosters a collaborative culture built on trust, long-term partnerships, and a commitment to high-quality deliverables. With engagements spanning telecommunications, healthcare, and academia, this role offers engineers the chance to work on diverse and intricate projects while enjoying a flexible and supportive work environment.We are seeking a Senior Data Engineer to help manage extensive data environments characterized by high-volume datasets, intricate integrations, and analytical applications. This hands-on engineering position emphasizes the creation and upkeep of data pipelines, in-depth understanding of end-to-end data flows, and resolution of data quality concerns across distributed systems.You will collaborate closely with engineers, analysts, and stakeholders to ensure the delivery of reliable, scalable, and well-structured data solutions that enhance analytics and machine learning efforts.Key Responsibilities:Design, construct, and sustain scalable data ingestion and ETL/ELT pipelines.Manage large datasets and interfaces that feed into enterprise-level databases.Examine data flows and diagnose inconsistencies across systems.Conduct root cause analyses to trace erroneous outputs back to original source systems.Prepare datasets for analytics and machine learning applications.Participate in data modeling and mapping activities.Assist machine learning initiatives through data preparation, evaluation, and optimization.Establish and implement data quality monitoring frameworks.Create visualizations to facilitate data interpretation and insights.

Join our dynamic team at Hawkeye Innovations as a Senior Java Engineer specializing in our Data Platform Framework. In this role, you will drive the development of scalable and efficient data solutions, collaborate with cross-functional teams, and contribute to the architecture of our data platform. If you are passionate about Java and data engineering, this is your chance to make an impact in a forward-thinking company.

Join our dynamic team as a Senior Data Engineer where you will play a pivotal role in shaping our data architecture and driving innovative solutions. You will be responsible for designing, building, and maintaining robust data pipelines that ensure our data is accessible, reliable, and ready for analysis. Your expertise will directly contribute to enhancing our data-driven decision-making processes.

This position is based in Budapest, Hungary, within a hybrid work environment requiring office attendance 3 or more days per week. Tulip, a pioneer in AI-native frontline operations, empowers global enterprises to provide their workforce with composable, interconnected applications. This innovation leads to superior quality work, enhanced efficiency, and comprehensive traceability throughout operations. Our cloud-native, no-code platform, driven by integrated AI, is revolutionizing digital transformation in industrial settings with human-centric, composable solutions that redefine the Manufacturing Execution System (MES) landscape. Founded as a spinoff from MIT, Tulip is headquartered in Somerville, MA, with additional offices located in Germany, Hungary, Singapore, and Israel. We have been recognized as a Global Innovator by the World Economic Forum, a recipient of the 2024 Deloitte Technology Fast award, and a finalist among Energage’s Top Workplaces USA, alongside being listed in Built In Boston’s “Best Places to Work” and “Best Midsize Places to Work.”

Role overview Qima seeks a Senior Manager, Data & Web Engineering to join their Budapest office. This leadership position manages a team of data engineers and web developers, focusing on the creation and improvement of data solutions and web applications. The role shapes data frameworks and helps ensure web platforms run smoothly, offering a dependable and user-friendly experience. What you will do Lead and mentor a group of data engineers and web developers Oversee development and refinement of data frameworks Maintain high standards for web platform performance and usability Collaborate with cross-functional teams to apply best practices in data management and web engineering Guide the team through complex technical issues Deliver projects on time and within budget Encourage continuous learning and foster innovation within the team Requirements Demonstrated experience leading teams in data engineering and web development Strong knowledge of data frameworks and web application performance Ability to work effectively across departments Track record of mentoring and developing technical staff Comfort managing several projects and shifting priorities This position is located in Budapest.

Join our team as a Lead Data Engineer and play a pivotal role in shaping data engineering strategies at DEPT®. Our hybrid work environment spans across vibrant cities including Budapest, London, Manchester, Amsterdam, Rotterdam, Dublin, Zagreb, and Split.At DEPT®, we empower the world’s most ambitious brands to accelerate their growth, blending technology and marketing through our expert team of over 4,000 specialists. We are proud to partner with industry leaders such as Google, Lufthansa, Meta, eBay, and OpenAI, and have maintained our B Corp and Climate Neutral certifications since 2021.In our Data & AI practice, we are dedicated to producing groundbreaking work that leverages Data & AI across various sectors. As a member of our EMEA Data craft team, you will collaborate with data strategists, scientists, and analysts to tackle complex challenges faced by beloved global brands.As a Lead Data Engineer, you will guide your team in delivering innovative, enterprise-scale data solutions, combining your technical expertise with strong business insights to meet client objectives.

The Exciting Opportunity This position plays a vital role in architecting and enhancing our platform to meet business demands while optimizing our systems. In this role, you will have the opportunity to develop new data pipelines, manage platforms hosted on data streams for both batch and real-time loading, and create real-time visualizations. Key Responsibilities: Maintain and enhance our existing data platform. Develop processes to ingest data from Kafka, APIs, and databases using AWS MSK Connect. Design and maintain real-time data processing applications utilizing frameworks such as Spark Structured Streaming and Kafka Streams. Implement transformations on data streams. Participate in data modeling adhering to standards like Inmon, Kimball, and Data Vault. Ensure data quality by verifying consistency and accuracy. Stay current with research and advancements in technology to improve our data platform. Possess an investigative mindset to troubleshoot issues creatively and manage incidents effectively. Take full ownership of assigned projects and tasks while collaborating within a team environment. Document processes thoroughly and conduct knowledge-sharing sessions. What We're Looking For: Essential Qualifications: Proven experience with modern cloud database technologies, especially Snowflake. Expertise in orchestrating data pipelines using Airflow. Proficient in AWS Glue. Familiarity with Apache Iceberg. Strong experience with SQL and Data Integration Tools. Proficiency in programming languages such as Python or Scala. Knowledge of AWS Services like S3, Lambda, API Gateways, DMS, and RDS. Development experience in Microsoft and Linux/Cloud environments. Exceptional analytical and problem-solving skills.

Join Kpler as a Senior BI Data Engineer and be a pivotal force in shaping our data architecture. In this vital role within our Business Intelligence & Insights team, you will develop scalable data pipelines, create robust data models, and establish reliable infrastructure that empowers teams across the organization with access to high-quality, accurate data. This position is ideal for someone who thrives in a fast-paced, international environment and enjoys addressing complex data challenges while designing systems that drive insights, reporting, and machine learning at scale. You will report directly to the Director of BI, collaborating closely with cross-functional teams to enhance data-driven decision-making across the company.

Role Overview Tulip is hiring a Data Operations Engineer to help manage and improve data operations. This role focuses on maintaining data quality, refining workflows, and supporting the efficiency of daily processes. The position is based in Budapest, Munich, or Tel Aviv. What You Will Do Work closely with teams across the company to ensure data remains accurate and reliable Identify opportunities to streamline data-related processes Support ongoing efforts to improve the efficiency of data operations Location Budapest, Hungary Munich, Germany Tel Aviv, Israel

Join a global leader in technology dedicated to energy innovation for a sustainable future. Our client is at the forefront of transforming energy solutions with advanced gas engine technologies, digital platforms, and energy services. With operations in over 100 countries, they focus on advancing engineering while prioritizing the well-being of people and the planet.The Senior Data Engineer plays a crucial role in collaboration with Data Analysts, BI Developers, and Requirements Engineers to lay the groundwork for all analytical projects. This position entails building and managing data pipelines that extract, transform, and load (ETL) data from various sources into a centralized repository, subsequently facilitating project-specific data delivery.Your Responsibilities: Architect and deploy scalable and resilient data pipelines that meet the analytics and data processing requirements. Design and maintain robust database architectures, including data lakes and warehouses. Ensure data integrity and consistency through meticulous data cleaning, transformation, and validation processes. Engage with Data Analysts, BI Developers, and Requirements Engineers to gather project requirements and provide data solutions aligned with business goals. Enhance data retrieval processes by developing pipelines and physical data models tailored for reports and various analytical projects. Implement data security and privacy protocols to ensure compliance with legal and regulatory standards. Document all created data pipelines comprehensively.

Bosch Group seeks a Data Engineering Intern based in Budapest. This internship provides practical experience in data management, analytics, and the development of data pipelines. What you will do Support the team in managing and organizing data Assist with analytics tasks and reporting Help build and maintain data pipelines for ongoing projects Work closely with experienced data engineers on real-world assignments Requirements Interest in data engineering and analytics Willingness to learn new data technologies Ability to collaborate with team members Based in Budapest or able to work from this location

Role Overview Betsson Group is hiring a Lead Data DevOps Engineer to guide the Data DevOps team in Budapest. This position focuses on team leadership, technical direction, and ensuring smooth data operations within an agile setup. Key Responsibilities Lead and mentor a team of Data DevOps professionals. Work closely with cross-functional teams to align data operations with business needs. Shape and improve data architecture and data pipelines. Implement and promote strong data management and DevOps practices. Streamline workflows to deliver insights that support company goals. Location This role is based in Budapest.

Join our dynamic team at Deutsche Telekom IT Solutions as a Data Engineer specializing in Fabric. In this role, you will be pivotal in designing and implementing robust data solutions that drive business insights and support our operations across various platforms. Your expertise in data engineering will help shape the future of our data infrastructure.

We are on the lookout for a talented Data Platform Developer who will play a crucial role in enhancing the clarity and consistency of our innovative cloud-based Lakehouse platform architecture. Your main objective will be to define, develop, and uphold architectural standards and contracts at the platform level. This will enable teams to build solutions in a consistent and transparent manner, fostering a shared understanding of where components belong, the rationale behind their placement, and their movement through the platform. A significant focus will be on establishing clear semantics and promotion rules across our layered data architecture, from raw ingestion to curated, consumption-ready data.As a vital member of the Common Data Intelligence Hub, you will collaborate closely with data architects, data engineers, analytics engineers, and solution designers to drive the target platform architecture forward and create an architectural framework that supports future use cases, without taking ownership of day-to-day development or operations.Key Responsibilities:Define, document, and continuously improve layer semantics and promotion rules across the architecture layers, including Landing, Sources, Bronze, Silver, and Gold. Ensure these rules are integrated into governance tooling such as Databricks Unity Catalog or Microsoft Fabric OneLake.Establish and govern platform guardrails and contracts, focusing on schema evolution, Change Data Capture (CDC) principles at the platform level, and key non-functional requirements such as reliability, performance, security, and cost.Own and refine the platform's reference architecture, including capability/service boundaries, responsibilities, standard integration patterns, and architectural standards.Drive the target platform architecture and maintain a prioritized architectural roadmap, addressing platform enablers and technical debt initiatives.Support and review solution designs for new use cases, ensuring they align with platform standards and governance requirements.Create and maintain an architecture documentation practice that is up-to-date and user-friendly.Ensure the platform is consistently represented within enterprise architecture tools and processes, acting as the liaison to enterprise architecture stakeholders.Collaborate with Data Architects and domain teams to ensure platform rules support high-quality modeling and cross-domain consistency.

Bosch Group is hiring a Data Scientist and AI Engineer in Budapest. This position centers on applying data analytics and artificial intelligence to improve products and processes. Role overview Work closely with colleagues from different disciplines to design and build machine learning models. The focus is on creating solutions that add value to Bosch Group’s offerings. What you will do Develop and implement machine learning models Use data analytics to identify opportunities for improvement Collaborate with cross-functional teams to integrate AI-driven solutions Requirements Experience in data science and artificial intelligence Ability to work with teams from various backgrounds Strong skills in building and deploying machine learning models

At Kpler, we empower organizations to navigate complex markets effortlessly. Our innovative approach simplifies global trade information, providing essential insights that drive informed decisions in the commodities, energy, and maritime industries.Founded in 2014, Kpler has continually delivered premier intelligence through intuitive platforms. With a dedicated team of over 700 professionals from more than 35 countries, we transform intricate data into actionable strategies, ensuring our clients remain competitive in a rapidly evolving market. Join us to harness cutting-edge innovation for impactful outcomes and receive unmatched support on your path to success.We are seeking an enthusiastic and skilled Senior Data Analyst to become a pivotal member of our Business Intelligence & Insights team. In this influential role, you will help shape the data architecture that underpins Kpler's commercial and strategic decisions. Reporting directly to the Head of BI, you will be responsible for managing essential data pipelines, designing scalable Looker solutions, and serving as a trusted data partner for stakeholders across the organization.This role is ideal for an individual who excels at the intersection of data engineering and business analytics, capable of building robust, production-quality infrastructure one day and translating complex datasets into actionable insights for commercial teams the next. If you are passionate about working with real-time commodity flow data and eager to influence the BI strategy of a dynamic B2B SaaS company, we encourage you to apply.