Senior Python Data Scraping Engineer

About ClickHouseListed among the top innovators on the 2025 Forbes Cloud 100 list, ClickHouse is a leading, rapidly expanding private cloud company. With over 3,000 customers and an astonishing annual recurring revenue growth exceeding 250%, ClickHouse is at the forefront of real-time analytics, data warehousing, observability, and AI workloads.Our momentum was recently reinforced by a successful $400 million Series D funding round. In the past three months, renowned clients such as Capital One, Lovable, Decagon, Polymarket, and Airwallex have adopted or expanded their use of our platform. These new clients join a prestigious roster of AI innovators and global brands including Meta, Cursor, Sony, and Tesla.Join us in our mission to revolutionize the way companies leverage data!The Connectors team serves as the vital link between ClickHouse and the vast data ecosystem. We develop and maintain integrations that make ClickHouse accessible to millions of developers, data practitioners, and AI agents worldwide—ranging from high-level data visualization plugins (like Tableau, PowerBI, Superset, Metabase) to connectors for data frameworks (Apache Spark, Flink, Kafka Connect, Fivetran), orchestration platforms, and AI tools.Our work is pivotal in shaping how organizations process massive datasets—enabling real-time analytics platforms to ingest millions of events per second, observability systems to monitor global infrastructure, and increasingly, AI-driven data applications that redefine team collaboration with data. We work closely with the open-source community, our internal teams, and enterprise users to ensure that ClickHouse integrations lead the way in performance, reliability, and developer experience.About the RoleAs a Senior Software Engineer specializing in Python and the Data Ecosystem, you will be a key contributor, responsible for owning and advancing essential components of ClickHouse's data engineering ecosystem. This role exists at the crossroads of high-performance database engineering and enhancing developer experience. You will create tools that empower Data Engineers and Data Scientists to fully leverage ClickHouse's speed and scale within the frameworks they are already familiar with.We are seeking an individual who has direct experience as a Data Engineer or Data Scientist. The landscape for data practitioners is evolving rapidly; databases have progressed beyond mere query targets—they are now integral components of AI-powered workflows, serving as vector stores for RAG pipelines, backends for LLM-powered agents, and real-time feature stores for ML inference. You comprehend these workflows not from an outsider's perspective, but from personal experience within them. Your role is not just to build integrations; you will contribute product-level insights that enhance user experience.

About ClickHouseFeatured on the 2025 Forbes Cloud 100 list, ClickHouse stands as one of the most dynamic and rapidly expanding private cloud enterprises. With over 3,000 clients and an annual recurring revenue (ARR) growth exceeding 250% year-on-year, ClickHouse is at the forefront of real-time analytics, data warehousing, observability, and artificial intelligence workloads.This remarkable growth was underscored by a recent $400M Series D funding round. In just the last three months, our platform has been embraced and expanded by industry leaders such as Capital One, Lovable, Decagon, Polymarket, and Airwallex. These newcomers join an esteemed roster of AI pioneers and global brands like Meta, Cursor, Sony, and Tesla.Join us in our mission to revolutionize data utilization across industries. Be a part of our exciting journey!The Connectors team serves as the vital link between ClickHouse and the expansive data ecosystem. We design and maintain the connectors that render ClickHouse accessible to millions of developers and data professionals globally. Our responsibilities encompass low-level database integrations and high-level data visualization plugins, ensuring seamless integration with familiar tools.We oversee the official data connectors including Kafka, dbt, Spark, Flink, Beam, and Fivetran, alongside integrations with leading visualization platforms like Grafana, Tableau, Power BI, and Metabase.Your RoleAs a Senior Software Engineer focusing on JVM-based frameworks, you will be a key contributor, responsible for managing and maintaining essential components of ClickHouse's data engineering ecosystem. This role is positioned at the intersection of high-performance database engineering and developer experience, where you will create tools that empower Data Engineers to leverage ClickHouse’s remarkable speed and scalability.You will oversee the complete lifecycle of data framework integrations—from the core database driver that manages billions of records per second to SDKs and connectors that make ClickHouse feel native in JVM-based applications. It’s not just about coding; you are constructing the backbone that countless Data Engineers depend on for their most critical data tasks.Your contributions will directly influence how organizations process vast datasets, from real-time analytics platforms that handle millions of events per second to observability systems monitoring global infrastructure. You will collaborate closely with the open-source community, internal teams, and enterprise users to ensure our JVM integrations set the benchmark for performance and reliability.

Join our dynamic team at dev2 as a Senior Python Software Engineer. In this pivotal role, you will leverage your expertise in Python to develop innovative software solutions that meet the evolving needs of our clients. Your contributions will directly impact project outcomes and enhance our technology stack.We are looking for a passionate individual who thrives in a fast-paced environment, possesses strong problem-solving skills, and is eager to collaborate with cross-functional teams to deliver high-quality software.

About dltHubdltHub is at the forefront of innovation, leveraging the dlt library, a leading open-source Python tool for data loading with approximately 4 million downloads monthly. We are on a mission to develop the next generation of AI-native data tools built upon our robust open-source foundation.Our team is agile and thrives on experimentation, automation, and user-centric AI workflows. Founded by seasoned data scientists and machine learning engineers, we have our roots in Berlin and a burgeoning presence in the United States.We are supported by prominent investors including Bessemer Venture Partners, Foundation Capital, Dig Ventures, and technical pioneers from Hugging Face, Instana, Matillion, and more. Our core values drive us: we communicate with courage, prioritize meaningful projects, automate continuously, maintain high energy, honor our commitments, and achieve success collectively. About the RoleAs we continue to enhance our AI-first data platform, we are seeking a passionate and entrepreneurial software engineer in Berlin. This role offers the opportunity to tackle data platform challenges related to ingestion, storage, performance, reliability, observability, and AI-enhanced developer experiences. If you are driven, eager to collaborate with a motivated team, and prioritize high-quality code and innovative data systems, this position is tailored for you.

SmartRecruiters is seeking a Senior Python Software Engineer to join its Engineering team in Germany. This position centers on designing and building software that advances company objectives. The role involves tackling complex problems and working closely with other engineers. Key responsibilities Design and develop software solutions using Python Collaborate with team members to resolve technical challenges Share ideas to enhance products and internal processes What we’re looking for Deep experience with Python programming Ability to work through complex technical issues Interest in working collaboratively to achieve team goals

Distribusion is the premier global marketplace for ground transportation, providing travelers with effortless online access to a variety of ground transport options from search to ticket purchase. Our state-of-the-art B2B technology platform connects bus, rail, and ferry operators across 70+ countries to major online retailers, including Google Maps and Booking.com.We are redefining the future of travel by constructing the largest global network of transport providers and retailers. Having achieved a remarkable 10x growth in the past year, we are one of the fastest-growing startups in the travel sector. Supported by four prominent venture capital firms (TQ Ventures, Creandum, Northzone, and Lightrock), and following our recent Series C funding round of $80 million, we are poised to expand even further.We are on the lookout for a talented Senior Python Software Engineer to join our Demand Team. This team is crucial to our product, acting as the first touchpoint for end customers. Therefore, delivering a seamless and efficient search experience is vital for driving sales, ensuring customers can swiftly find optimal choices and successfully complete their bookings.Key Responsibilities:Write clean, efficient, and thoroughly documented Python code.Develop and maintain backend services and APIs for web projects.Implement backend solutions for business-critical applications.Debug, test, and optimize applications for enhanced performance and scalability.Ensure system uptime of at least 99.9%.Engage in code reviews and contribute to best practices.Work Environment:Our headquarters is located in Berlin, where the team frequently meets. However, we embrace a remote-first culture, with team members dispersed globally.

Join Synthflow AI, a revolutionary no-code platform designed for deploying voice AI agents that transform contact center operations and business process outsourcing (BPO) at scale. We empower mid-market and enterprise companies to efficiently manage routine calls, ultimately saving valuable time and resources for their teams.Our voice AI agents have made a significant impact:Saved over 5 million hours in contact center operationsIncreased call answering rates by 35% compared to non-AI operatorsHandled 45 million calls with an impressive 99.9% uptimeSupported by leading investors such as Accel, Atlantic Labs, and Singular, we are proud to serve over 1,000 customers and drive an industry shift towards advanced and accessible conversational AI.About the Role:We are seeking a Senior Python Engineer to develop robust, production-grade software and backend systems, focusing on databases, scalable APIs, and core engineering principles.Your Key Responsibilities:Design, develop, and maintain our backend infrastructure, ensuring scalability, performance, and reliability.Create and enhance data models and persistence layers with a strong emphasis on PostgreSQL best practices, including schema design, migrations, query optimization, indexing, and transactions.Develop and support enterprise-grade APIs using FastAPI, focusing on versioning, authentication/authorization, and observability.Participate in pair programming to foster code quality and team collaboration.Manage deployments and environments with Kubernetes and GitOps practices (ArgoCD).Conduct code reviews, offering constructive feedback and ensuring adherence to best practices.Contribute to end-to-end product delivery, including occasional front-end feature development when necessary.Qualifications:5+ years of experience as a Python developer, successfully delivering production systems.Proven expertise in building scalable and extensible data infrastructures.Strong familiarity with relational databases, particularly PostgreSQL (performance tuning, migrations, transactions).Experience in developing and maintaining enterprise-grade APIs using FastAPI.Solid understanding of engineering fundamentals and best practices.

Are you ready to take your career to the next level? Join dev2 as a Senior Data Engineer specializing in Python and play a pivotal role in our data-driven projects. You will work closely with cross-functional teams to design and implement scalable data solutions that drive innovation and efficiency.In this role, you will:Design, develop, and maintain data pipelines and ETL processesCollaborate with data scientists and analysts to optimize data storage and retrievalEnsure data quality and integrity through rigorous testing and validationContribute to architectural discussions and guide best practices

Distribusion Technologies stands at the forefront of the global ground transportation marketplace, offering travelers unparalleled access to diverse transport options online, from seamless search functionalities to straightforward ticket purchasing. Our state-of-the-art B2B technology platform bridges the gap between bus, rail, and ferry operators in over 70 countries and leading online retailers such as Google Maps and Booking.com.As we continue to redefine the travel landscape, we are expanding the largest global network of transportation providers and retailers. After experiencing a remarkable 10x growth last year, we are recognized as one of the fastest-growing startups in the travel sector. With the support of four prominent venture capital firms (TQ Ventures, Creandum, Northzone, and Lightrock) and our recent successful $80 million Series C funding round, we are poised for significant advancements.We are currently seeking a dynamic Senior Python Software Engineer to join our Portal Team. In this pivotal role, you will play a crucial part in developing our core B2B product, which connects global carriers, retailers, and travel partners to Distribusion’s robust infrastructure. The Portal serves as the central interface within our ecosystem, facilitating high-performance booking and analytics tools, as well as identity management and operational dashboards. You will navigate multiple domains, influence architectural decisions, integrate complex workflows, and collaborate with teams across Data, Platform, and E-commerce to create a seamless and scalable user experience. We are on the lookout for a developer who thrives on ownership, enjoys tackling complex challenges, and is passionate about building the foundation of how the world books ground transportation.

OUR VISIONAt NavVis, we empower individuals through our cutting-edge technology that seamlessly connects the physical and digital realms. Our solutions not only capture reality but also inspire creativity, productivity, and innovation, laying down a digital foundation that transforms the world.We provide tools that allow our users to visualize their environment as it is while also paving the way for a better future. Whether physical or digital, NavVis is committed to enabling people to shape a reality that enhances their lives.THE OPPORTUNITYJoin our Mapping and Perception Team and engage in the development of software and components for our state-of-the-art mobile indoor mapping system, utilized by organizations in over 25 countries globally.In this role, you will contribute to the creation of software solutions that map entire buildings and generate realistic 3D representations, including maps, point clouds, and panoramic images, leveraging the latest advancements in robotics technology.We are a diverse, international team, and if you are passionate about software engineering and eager to create transformative indoor digital experiences, this is the perfect opportunity for you!HOW YOU WILL MAKE AN IMPACTYou will design and architect the core software stack that powers our innovative mapping solutions.Collaborate with cross-functional teams to enhance product features and functionality.Implement best practices in software development and contribute to the overall engineering culture.

Data Engineer (Python) Company Overview Orcrist Technologies is at the forefront of innovation with the Orcrist Intelligence Platform (OIP), a cutting-edge data intelligence system built on Kubernetes. Our platform is available as a SaaS solution or can be deployed on-premises, including air-gapped setups. We manage both streaming and batch data pipelines that empower search functionalities, machine learning enrichment, and investigative workflows for our mission-critical clientele. Role Summary As a Data Engineer, you will play a pivotal role in quickly validating new data initiatives from inception to deployment, ensuring they are adoptable and scalable. In this innovative environment, you will prototype effective connectors and pipelines, generate performance assessments, and create handoff packages for productization by our Foundation or delivery team. Key Responsibilities Prototype ingestion and connector patterns (batch and streaming) utilizing NiFi, Kafka, Kafka Connect/Streams, and Change Data Capture approaches. Design schemas and data models that are both prototype-grade and easily adoptable, ensuring semantic clarity and a disciplined approach to evolution. Develop incremental lakehouse datasets using Hudi, Iceberg, and Delta patterns, producing outputs for real-world latency and throughput evaluations. Implement data quality and provenance considerations early in the process, incorporating checks, metadata hooks, and operational basics. Containerize and deploy prototypes on Kubernetes, providing minimal runbooks and configurations for seamless adoption. Create adoption artifacts including schemas, reference implementations, technical design notes, and a backlog for integration. Qualifications Minimum of 3 years of experience in data engineering with a proven track record of delivering real-world data pipelines beyond ad-hoc scripts. Proficient in Python and SQL, skilled in building transformations, validation tools, and pipeline integration code. Solid understanding of streaming and Change Data Capture fundamentals, along with experience in the Kafka ecosystem. Familiar with lakehouse architectures and query layers (e.g., Hudi, Iceberg, Delta, Trino, Hive, Postgres) and their role in making datasets accessible. Comfortable working in Kubernetes and container environments and adept at documenting technical decisions clearly. Must be eligible to work in Germany; EU/NATO citizenship is preferred, and export-control screening will apply. Preferred Qualifications Experience with data quality tools such as Great Expectations or metadata/lineage platforms (OpenMetadata, DataHub, Atlas). Experience with on-premises or air-gapped deployments and awareness of governance and policy for regulated environments. Proficiency in German (B1+) and familiarity with OSINT, GEOINT, or multi-INT data structures. What We Offer A modern data stack with real-world constraints: Kafka, NiFi, and more.

Join Our Innovative TeamAs a Senior Software Engineer specializing in Python and AWS, you'll play a critical role in shaping the future of our cutting-edge cloud processing platform, delivering exceptional solutions to customers around the globe.You will be an integral part of the Cloud Processing Team within the Mapping and Perception department, collaborating closely with talented professionals to develop and enhance the software components that power our services.

We are seeking a highly skilled Senior Data Engineer to join our dynamic team at repriskag in Berlin. In this pivotal role, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes. You will work closely with data scientists, analysts, and other stakeholders to ensure data quality and accessibility.

Delivery Hero is looking for a Senior Python AI Engineer to focus on logistics, data, and machine learning projects in Berlin. This position centers on developing AI-powered tools that support and improve delivery operations. Role overview This role involves designing and building applications using Python, with a strong emphasis on artificial intelligence and data science. The main goal is to create solutions that make logistics processes more efficient and help raise customer satisfaction. What you will do Develop and maintain AI-driven applications tailored for logistics challenges Apply machine learning techniques to optimize delivery workflows Work closely with teams to identify and solve data-related problems Requirements Extensive experience with Python Background in artificial intelligence, data science, and machine learning Ability to build solutions that improve operational efficiency

Distribusion is the premier platform for ground transportation, providing travelers with easy access to various transport options online—from searching to ticket purchasing. Our innovative B2B technology platform links bus, rail, and ferry operators in over 70 countries with major online retailers like Google Maps and Booking.com.We are at the forefront of revolutionizing the travel industry, establishing the largest global network of transport providers and retailers. After experiencing a remarkable 10x growth in the past year, we are among the fastest-growing startups in the travel sector. With the support of leading venture capitalists (TQ Ventures, Creandum, Northzone, and Lightrock) and following a recent $80 million Series C funding round, we are poised for expansion.We are on the hunt for a dynamic Senior Python Software Engineer to become a crucial member of our Demand Team. This team is vital to the Distribusion product, acting as the first point of contact for end customers. Thus, an efficient and user-friendly search experience is essential for driving sales; it must be quick, provide optimal choices, and guide customers effortlessly through the booking process.Key Responsibilities:Produce well-structured, efficient, and well-documented Python code.Develop and sustain backend services and APIs for web projects.Effectively implement the backend for mission-critical applications.Debug, test, and enhance applications for improved performance and scalability.Ensure system uptime of at least 99.9%.Engage in code reviews and contribute to the establishment of best practices.Workplace:We operate a hybrid model with headquarters in Berlin, where team members often gather. As a remote-first organization, we also have teams distributed globally.

peec is building and improving the backend systems that support its products. As a Senior Python Engineer based in Berlin, this position centers on designing, developing, and maintaining complex backend infrastructure to ensure reliable and high-quality delivery. Role overview This role involves full ownership of backend systems, from initial planning and architecture through to implementation and deployment. The work spans API design, distributed systems, and ongoing performance improvements. What you will do Lead the end-to-end development of backend systems, including scoping, architecture, execution, and delivery. Design and implement scalable APIs and distributed systems that meet high performance standards. Work closely with Product, Frontend, and Design teams to translate product ideas into solid backend solutions. Explore and apply modern backend technologies to improve architecture and the developer experience. Help evolve backend architecture and infrastructure to support fast iteration and growth. Identify areas for system and developer experience improvement, and drive initiatives to address them. Requirements Significant experience with Python and backend development is essential. Strong skills in API design, distributed systems, and collaborating across teams will be important for success in this role.

Join Distribusion as a Senior Python Software Engineer and be part of a pioneering force in the global ground transportation marketplace. Our innovative platform seamlessly connects travelers with bus, rail, and ferry operators across over 70 countries, partnering with major online retailers like Google Maps and Booking.com.As one of the fastest-growing startups in the travel sector, we have expanded tenfold in the past year, backed by leading venture capital firms including TQ Ventures, Creandum, Northzone, and Lightrock. Following our recent $80 million Series C funding, we are poised for further growth and innovation.In this vital role within our Portal Team, you will drive the development of our core B2B product, which connects global carriers, retailers, and travel partners to Distribusion’s infrastructure. The Portal serves as the central interface of our ecosystem, offering high-performance booking and analytics tools, identity management, and operational dashboards. You will collaborate with cross-functional teams to make critical architectural decisions, integrate complex workflows, and ensure a seamless, scalable experience for our users. We are seeking a developer who thrives on ownership, enjoys tackling challenging problems, and is eager to build the backbone of how the world books ground transportation.

Mindrift is looking for a Freelance Python Data Scraping Engineer to join its remote team, supporting projects from Stuttgart, Baden-Württemberg, Germany. This part-time, freelance position centers on the Tendem project, where engineers contribute as "AI Pilots" to streamline and improve data workflows. Role overview This role focuses on extracting, processing, and validating data from complex and dynamic web sources. The engineer collaborates with Tendem Agents, applying analytical skills and domain expertise to ensure data is accurate and relevant. Work is fully remote and designed for professionals with a strong background in web scraping and data processing. What you will do Lead data extraction projects on complex websites, delivering structured datasets that meet quality standards. Use internal tools such as Apify and OpenRouter, along with custom workflows, to collect, verify, and process data according to project needs. Develop and refine scraping methods for dynamic and interactive sites, including those with JavaScript-rendered content or frequent changes. Maintain high data quality through validation checks, consistency controls, formatting compliance, and systematic verification. Optimize large-scale scraping using batching or parallel processing, and build resilience against minor site structure changes. Requirements Minimum 3 years of hands-on experience in data engineering, web scraping, and automation. Compensation Contributors can earn up to $32 per hour, depending on project complexity, performance, and expertise. Actual rates may vary between projects. How to apply Submit an application through the provided link. Qualified candidates are matched with projects that suit their technical strengths and can set their own schedules. Work includes programming, automation, and refining AI outputs, supporting the practical use of AI in real-world scenarios.

TrustYou stands at the forefront of AI-driven hospitality solutions, committed to enhancing guest experiences while empowering businesses to excel. Our diverse team of over 120 talented professionals collaborates remotely from various locations worldwide, united in a mission to help companies achieve exceptional customer satisfaction.At TrustYou, our culture is dynamic, shaped by the contributions of our team members. We value open feedback and are dedicated to continuous improvement and achieving excellence in customer service.Every individual’s unique perspective enriches our collective success, fostering an environment of experimentation, learning, and growth.Our innovative products are designed to enhance customer satisfaction, increase customer lifetime value, and minimize unnecessary expenditures.Customer Experience Platform (CXP): Gain AI-powered insights that elevate guest experiences. Enhance service quality using feedback from surveys and reviews, respond to all comments with AI assistance, and enhance your brand reputation.Customer Data Platform (CDP): Transform customer data management with AI for more direct bookings. Integrate and master customer data, manage consent, and convert insights into tailored marketing strategies and personalized journeys.AI Agents: Our intelligent, always-on agents enhance productivity and reduce operational costs. Available round the clock, they offer immediate, personalized recommendations and streamline direct booking processes.Discover more about TrustYou at www.trustyou.comIf you are passionate about enhancing customer happiness and making a significant impact, you belong here. Join us in our journey to innovate and excel in the hospitality industry.Position: Senior Software Engineer - DataLocation: Germany / Spain / Romania (Remote)As a Senior Software Engineer - Data, you will play a pivotal role in the complete development and technical execution of our core data infrastructure. Your primary focus will be on crafting clean and efficient code for building high-performance, data-intensive APIs and intricate processing pipelines that serve as the backbone of our data products.This position is tailored for a technical specialist who thrives on hands-on work with distributed systems and takes full accountability for implementing and delivering robust data solutions.