Senior Big Data Engineer

Role overview Jobgether is hiring a Senior Python Data Scraping Engineer for a freelance position based in Israel. This role offers remote flexibility and involves collaboration with a partner organization. The focus is on building and maintaining sophisticated data extraction systems that support AI and analytics initiatives. What you will do Design and implement scalable web data extraction pipelines for large and complex datasets. Create advanced scraping solutions for dynamic websites, adapting to frequent changes in site structure and content. Work with hybrid AI-human workflows, partnering with AI-driven agents to improve data validation and quality control. Deliver structured, accurate, and validated data to support downstream projects. Share technical expertise to refine scraping strategies and uphold reliability standards. Requirements Deep experience with Python, especially for web scraping and data extraction tasks. Track record of engineering resilient and scalable scraping tools for complex, changing web environments. Keen attention to detail and a focus on producing precise, high-quality datasets. Ability to work independently as a remote freelancer. Experience with both human and AI-driven workflows is a plus. Location This position is open to candidates based in Israel. Remote work is available.

Mindrift seeks a Freelance Python Data Scraping Engineer to join the Tendem project. This is a remote, part-time contract role for candidates based in Israel. The position involves integrating advanced data scraping workflows into a hybrid system that combines AI with human input. Collaboration with Tendem Agents is central, as they manage repetitive tasks while the engineer ensures technical precision and data quality. Key responsibilities Extract structured data from complex websites, managing the full process from collection to delivery. Utilize internal tools such as Apify and OpenRouter, alongside custom workflows, to streamline data gathering, validation, and task management. Adapt scraping techniques for dynamic and interactive web sources, including sites with JavaScript-rendered content or frequent structural changes. Enforce data quality through validation checks, ensuring consistency across sources and compliance with formatting standards. Scale scraping operations for large datasets using batching or parallelization, monitor for failures, and maintain resilience to minor site updates. Requirements Minimum 3 years of experience in data engineering, web scraping, and automation. Compensation Contributors may earn up to $32 per hour, depending on expertise and pace. Actual rates vary by project, reflecting scope, complexity, and required skills. Application process Interested candidates should submit an application to qualify for freelance projects that align with their technical experience. The role offers flexible scheduling and the chance to contribute to projects involving coding, automation, and AI output refinement, supporting both AI development and practical uses.

About ClickHouseListed among the 2025 Forbes Cloud 100, ClickHouse stands out as a pioneering and rapidly expanding private cloud organization. With a robust customer base exceeding 3,000 and an annual recurring revenue (ARR) growth surpassing 250% year-on-year, we are at the forefront of real-time analytics, data warehousing, observability, and AI workloads.Our recent $400M Series D funding round validates our continuous momentum. In the last quarter, notable clients such as Capital One, Lovable, Decagon, Polymarket, and Airwallex have either implemented or expanded their use of our platform, joining a prestigious roster of AI innovators and global brands including Meta, Cursor, Sony, and Tesla.Join us in our mission to revolutionize data utilization across industries!The Connectors team serves as the vital link between ClickHouse and the expansive data ecosystem. We design and maintain integrations that empower millions of developers, data professionals, and AI systems worldwide, ranging from advanced data visualization tools (like Tableau, PowerBI, Superset, Metabase) to connectors for data processing frameworks (including Apache Spark, Flink, Kafka Connect, Fivetran), orchestration platforms, and AI toolsets.Our efforts are integral in shaping how organizations handle vast datasets, from real-time analytics platforms managing millions of events per second to observability systems that monitor global infrastructures, and increasingly, AI-driven data applications that redefine team workflows. We collaborate closely with the open-source community, internal teams, and enterprise users to ensure our integrations set new benchmarks in performance, reliability, and user experience.About the RoleAs a Senior Software Engineer with expertise in Python and the Data Ecosystem, you will play a pivotal role in developing and advancing key components of ClickHouse's data engineering ecosystem. This position intersects high-performance database engineering and user experience. Your contributions will involve creating tools that enable Data Engineers and Data Scientists to leverage ClickHouse's speed and scalability seamlessly within their existing frameworks.We seek a candidate who has firsthand experience as a Data Engineer or Data Scientist. The landscape for data practitioners is evolving rapidly: databases are transforming from mere query targets to active participants in AI-driven workflows, functioning as vector stores for retrieval-augmented generation (RAG) pipelines, backends for large language model (LLM)-driven agents, and real-time feature stores for machine learning inference. You comprehend these workflows not from an external viewpoint but from active engagement. You don’t just develop integrations; you provide product-level insights that drive innovation.

Join our dynamic Platform Infrastructure team as a Senior Software Engineer, where you will be instrumental in designing and building the core Axonius Platform that underpins all current and future offerings. You will confront challenging engineering challenges across the entire stack, from low-level system configurations to advanced distributed backend applications. By joining our diverse global team, you'll serve as a technical beacon, conducting in-depth research and troubleshooting complex performance and architectural challenges that others find elusive.

Jobgether is looking for a Senior Data Engineer based in Israel. This position centers on building and maintaining data pipelines and architectures that help drive business goals. Role overview The Senior Data Engineer will design, develop, and support data systems. Collaboration with teams across the company is a regular part of the job, with a focus on delivering reliable and secure data solutions. Key responsibilities Create and manage data pipelines and architectures Work with multiple teams to support data quality and availability Help ensure data security in all processes Location This role is based in Israel.

Jobgether is looking for a Senior Full-Stack Engineer with strong skills in Python and React. This position is based in Israel and focuses on building and supporting modern web applications. Role overview This role centers on both backend and frontend development. The Senior Full-Stack Engineer will work with Python and React to create new features and improve existing systems. Collaboration with other teams is a regular part of the job, ensuring projects move forward smoothly. Key responsibilities Develop and maintain web applications using Python and React Work closely with cross-functional teams to deliver project goals Promote technical quality and consistency across projects Requirements Proven experience as a full-stack engineer Strong knowledge of Python and React Ability to collaborate with diverse teams

Role Overview Shift4 Payments, Inc. is hiring a Senior Data Engineer to join the Data Infrastructure team in Herzliya. This team builds and maintains the data systems that support Shift4’s payment processing and technology products. What You Will Do Design, build, and maintain scalable data pipelines Work closely with data scientists and analysts to improve data workflows Ensure data integrity across systems and processes Impact and Collaboration This role shapes the backbone of Shift4’s data capabilities. Senior Data Engineers here help strengthen the company’s data infrastructure, supporting both current needs and future growth.

Join Axonius as a Senior Data Infrastructure Engineer and take charge of designing and constructing robust data architectures, ML pipelines, and cloud infrastructure tailored to transform extensive and fragmented datasets into actionable insights. Your expertise will enable business stakeholders to achieve in-depth visibility, automate essential processes, and drive strategic outcomes organization-wide.

Join Axonius as a Senior Software Engineer specializing in Data Engineering. In this role, you will take charge of the design and development of data architectures, machine learning pipelines, and the cloud infrastructure essential for converting vast and fragmented data into actionable insights. Your contributions will enable business leaders to achieve better visibility, automate critical workflows, and foster strategic advancements across the organization.Key Responsibilities:Data Infrastructure Development: Architect and implement all components of the data platform, including machine learning pipelines and necessary infrastructure.Cloud Data Lake Optimization: Establish and enhance an AWS-based Data Lake while adhering to cloud architecture best practices in metadata management, partitioning, and security to facilitate enterprise-level operations.Project Leadership: Oversee full lifecycle of data projects, from initial infrastructure design to production monitoring and performance tuning.Integration Solutions: Employ effective ETL/ELT patterns and advanced querying techniques to tackle complex data integration challenges arising from both structured and unstructured datasets.

About BrandlightBrandlight stands at the forefront of enterprise AI visibility, dedicated to empowering top global brands to effectively understand, manage, and enhance their presence across AI-driven search, commerce, and advertising channels.As artificial intelligence evolves into a multi-trillion-dollar marketing and distribution frontier, Brandlight is pioneering the systems that determine which brands gain visibility, trust, and preference.Join our innovative team and contribute to the development of cutting-edge tools that will redefine brand management in an AI-centric world.About the RoleIn the capacity of Senior Data Engineer at Brandlight, you will be instrumental in architecting, constructing, and scaling the data infrastructure that fuels AI-driven brand perception insights.This role requires close collaboration with platform and AI research teams to ensure the integrity, performance, and reliability of our data pipelines and systems.ResponsibilitiesDesign and maintain extensive end-to-end data pipelines tailored to platform and research requirements.Create data models optimized for analytics, machine learning training, and inference.Oversee the complete data lifecycle, emphasizing robust monitoring, validation, and reliability.Enhance queries, storage, partitioning, and indexing for optimal performance and cost efficiency.Manage and scale BigQuery workloads while orchestrating pipelines using Airflow.RequirementsBachelor's degree in Computer Science, Information Systems, or a related field.A minimum of 6 years of practical experience as a data or backend engineer.Strong software engineering capabilities with proficiency in Python development.Expert SQL skills, particularly in query optimization.Experience with big data frameworks is essential.Prior experience with BigQuery and Airflow is a significant advantage.Familiarity with LLMs, Vector DBs, and machine learning concepts is a valuable asset.Demonstrated ability to thrive in a fast-paced, demanding, and sometimes ambiguous environment.Why Join Us?At Brandlight, you will have the opportunity to shape and create a new category that lies at the intersection of AI, marketing, and commerce.We are a rapidly growing startup led by experienced entrepreneurs and top-tier engineers, providing an exciting platform for your career growth.

About Nexxen Nexxen builds technology for the advertising industry, connecting advertisers, agencies, publishers, and broadcasters worldwide. The Nexxen Data Platform combines a demand-side platform (DSP) and a supply-side platform (SSP), enabling clients to use data and advanced TV solutions tailored to their needs. Working at Nexxen The team in Tel Aviv is committed to customer focus, curiosity, and collaboration. Employees support each other and work together without ego to create flexible solutions that move the industry forward. Candidate Safety Notice Nexxen will never ask for payment as part of the hiring process or promote questionable financial offers. If you see suspicious job postings or communications claiming to be from Nexxen, contact infosec@nexxen.com to verify. Your trust and safety are important. Role Overview: Senior Data Engineer The Senior Data Engineer will join the Data Engineering team in Tel Aviv. This role focuses on processing, storing, and serving data for Nexxen's core systems. The team values proactive problem solvers who enjoy research and development and work well with others. Main Responsibilities Lead projects from initial design through to production, with an emphasis on innovation and efficiency. Mentor and guide other developers on complex initiatives that impact key business areas.

Autofleet helps major fleet operators and transportation providers improve efficiency and launch new business models. The platform relies on advanced data infrastructure to power machine learning and real-time optimization. Role Overview The Senior Data Engineer will take ownership of Autofleet’s backend data infrastructure. This role focuses on building and scaling the systems that enable real-time analytics, machine learning, and operational insights. What You Will Do Design, build, and maintain scalable data pipelines for both batch and real-time processing using Spark and other modern tools. Manage backend data infrastructure, including ingestion, transformation, validation, and orchestration of large datasets. Work with Google Cloud Platform (GCP) to architect and operate secure, cost-effective, and scalable data solutions. Develop and refine ETL/ELT workflows to support analytics, internal applications, and machine learning projects. Create and maintain data marts and models with a focus on performance, data quality, and sustainability. Collaborate with development, product, and external teams to understand data needs and translate them into scalable solutions. Shape architectural decisions related to distributed data processing, pipeline reliability, and system scalability. Location This position is based in Tel Aviv-Yafo, Tel Aviv District, Israel.

In today's landscape, cloud computing represents a significant business cost and can be challenging to manage effectively.At Finout, we empower organizations to gain deeper insights into their cloud expenditures, enabling them to make informed, rapid, and strategic decisions.We are proud to serve esteemed clients such as The New York Times, Wiz, Elastic, SiriusXM, and Lyft, supported by premier investors with over $85 million raised. Over the past four years, we have expanded to a team of over 100 professionals across Tel Aviv and New York, and this is just the beginning.If you are passionate about building impactful solutions, solving real-world problems, and accelerating growth, we would love to connect with you.

Viz.ai builds artificial intelligence solutions for healthcare, serving more than 2,000 hospitals in the United States. The platform delivers AI-powered Care Pathways that help clinicians detect diseases, coordinate care, and ensure patients receive timely treatment. Viz.ai partners with leading life sciences organizations to provide real-time, multimodal clinical data. Black Book Research has recognized Viz.ai as the top Healthcare AI Platform. Role overview The Senior Data Engineer will design and develop Viz.ai's next-generation data infrastructure and pipelines. This role plays a key part in shaping scalable and reliable data solutions that support both customer needs and internal teams. What you will do Lead ongoing development of the Data Platform, supporting AI research and business intelligence from design through implementation. Architect and build complex data pipelines to move and transform data from multiple sources. Create systems that expand and improve Viz.ai's data product offerings. Collaborate closely with Software Engineering, AI Engineering, and Product Management teams. Technical environment The team primarily uses AWS and Python. Core technologies include S3, DBT, ETL, ELT, Spark, DynamoDB, Postgres, RabbitMQ, Docker, Redis, and Prometheus. The team regularly evaluates and adopts new tools and technologies as needed. What success looks like Works independently and collaborates effectively within the team. Mentors colleagues on code review, performance, and scalability. Demonstrates a commitment to continuous learning and introduces new ideas and initiatives. Communicates clearly and fosters strong working relationships. Location: Tel Aviv, Israel

Join our dynamic Data and Machine Learning Engineering group at CyberArk as a Senior Software Engineer. In this pivotal role, you will design and implement innovative software solutions that leverage advanced data analytics and machine learning techniques. Your contributions will enhance our security products, ensuring that our clients can protect their sensitive information effectively.

About Nexxen Nexxen is reshaping the advertising industry with data-driven technology. The company’s platform brings together a demand-side platform (DSP), supply-side platform (SSP), and the Nexxen Data Platform to help advertisers, agencies, publishers, and broadcasters use data and advanced TV in meaningful ways. Role Overview The Data Engineering team in Tel Aviv is looking for a Senior Software Engineer. This position focuses on building and improving the data platform that powers Nexxen’s core systems for processing, storing, and serving data. What You Will Do Own the full development cycle for key projects, from initial design through to production deployment, with an emphasis on efficiency and new ideas. Lead and mentor junior developers, guiding them through complex projects that directly affect the business. The team values proactive problem-solving and collaboration. A hands-on approach to research and development is encouraged. Working at Nexxen Nexxen’s culture centers on customer focus, curiosity, and teamwork without ego. Creativity, commitment, and a drive to innovate are recognized and valued. Employee Safety Nexxen is committed to employee well-being and warns against online scams. The company will never ask for payment as a condition of employment or promote questionable financial schemes. For any concerns about suspicious job postings or communications, contact infosec@nexxen.com to verify authenticity.

Join Armis, a leader in cyber exposure management and security, where we protect organizations by safeguarding their entire attack surface and managing cyber risk exposure in real time. In today's fast-paced, perimeter-less world, we ensure that businesses can continuously see, protect, and manage their essential assets, from ground to cloud. Our clients include Fortune 100, 200, and 500 companies, along with various national and local government entities, all working to keep critical infrastructure, economies, and societies secure around the clock.We are a privately held company based in California, and we are looking for a highly skilled Senior Engineer to enhance our Data Platform Team. This is your chance to work on cutting-edge technologies, drive innovation, and play a pivotal role in designing and implementing our data infrastructure and architecture.What You'll DoDatabase Infrastructure Development - Design, develop, and maintain a scalable and reliable self-service database infrastructure, utilizing PostgreSQL, MongoDB, SingleStore, and AWS Aurora.Big Data Infrastructure Development - Create and manage scalable and dependable big data infrastructure, focusing on cloud-agnostic data lakehouses, distributed databases, and platform-powered data pipelines.End-to-End Ownership - Assume accountability for the full lifecycle of data infrastructure, from DevOps (Terraform, Kubernetes) to application-level components (infrastructure libraries, core components in data pipelines).Architecture Leadership - Collaborate with the Architecture group to define and maintain the company's core architectural vision.Work closely with development teams, providing technical guidance, best practices, and support from the design phase through to production deployment.Innovation and Exploration - Engage in diverse and impactful projects across various layers of the tech stack, exploring new technologies and methods to enhance reliability, efficiency, and scalability.

Senior Software Data Engineer We are seeking an innovative and experienced Senior Software Data Engineer to join our dynamic Engineering team and spearhead the advancement of our next-generation data platform. This pivotal role requires a blend of technical expertise and leadership skills, allowing you to act as a player-coach. You will be the visionary architect responsible for designing a robust ecosystem while being actively involved in implementing scalable, secure, and intelligent solutions that enhance everything from operational reporting to cutting-edge GenAI applications. Your ability to bridge the gap between complex business requirements and technical execution will be crucial as you advocate for a data-first culture. This position starts as an individual contributor role but offers a clear pathway for growth into leadership opportunities. Why join Tipalti? Tipalti is an AI-driven platform revolutionizing finance automation, transforming how finance teams operate within the global economy. We empower our clients to scale efficiently and effectively by simplifying global business complexities and enhancing finance operational efficiency. Our comprehensive suite of finance automation solutions is tailored for mid-market businesses, covering areas such as accounts payable, global payouts, procurement, employee expenses, corporate cards, supplier management, tax compliance, and treasury. Tipalti collaborates with top financial institutions like Citi, Wells Fargo, J.P. Morgan, and Visa, enabling over 5,000 global companies to securely and efficiently manage payments to millions of suppliers and payees across more than 200 countries and territories, in 120 currencies. At Tipalti, we take pride in our collaborative culture, the quality of our products, and the capabilities of our people. Our team members are passionate about their work and driven to achieve results. We offer competitive benefits, a flexible work environment, career coaching, and a culture that fosters diversity and inclusion, allowing everyone to thrive and make a meaningful impact. Our ethos encourages collaboration and success as a unified team. Founded in 2010 in Israel, Tipalti has grown into a global enterprise with its headquarters in the San Francisco Bay Area (Foster City) and offices located in Tel Aviv, Plano, Toronto, Vancouver, London, Amsterdam, Tbilisi, and Medellin. About the Role Architecture & Hands-on Execution: Design and actively build a comprehensive data platform. You will not only oversee infrastructure but also write core code and develop tools that support a variety of workloads, from operational reporting to complex analytical queries. Strategic & Technical Delivery: Collaborate closely with product managers and cross-functional teams to deliver high-quality data solutions.

Join BioCatch, a pioneer in Behavioral Biometrics, where we harness the power of machine learning to analyze digital behavior patterns for enhanced online security. Our mission is to create a digital landscape where identity, trust, and ease coalesce. With over 32 of the world’s top 100 banks and 210 financial institutions leveraging our innovative BioCatch Connect™ platform, we are at the forefront of fraud prevention and digital transformation. Backed by a decade of experience, more than 80 patents, and collaborations with leaders like American Express and Barclays, BioCatch is committed to delivering actionable insights. To learn more, visit www.biocatch.com..We are seeking a talented Senior Backend Engineer to join our Data Engineering team, focusing on developing robust backend systems and data infrastructure for high-scale data processing.Your responsibilities will include designing and maintaining essential microservices and data pipelines that support our products while ensuring reliable data access for various teams within the organization.This role will emphasize the development of customer-facing features that rely on intricate data assets, prioritizing reliability, clear SLAs, observability, and flexibility. Your Key ResponsibilitiesArchitect and implement high-volume data processing infrastructureEnhance performance, cost-efficiency, and reliability at scaleCollaborate with frontend teams to deliver customer-facing features and applicationsEngage with stakeholders to ensure data processes fulfill their needsUphold high engineering standards, including testing, observability, clean coding practices, and effective CI/CD