Senior Data Engineer

About Glean:Established in 2019, Glean is a pioneering AI-driven knowledge management platform that empowers organizations to swiftly locate, organize, and disseminate information throughout their teams. By seamlessly integrating with tools such as Google Drive, Slack, and Microsoft Teams, Glean ensures that employees have timely access to essential knowledge, thereby enhancing productivity and collaboration. Our state-of-the-art AI technology streamlines knowledge discovery, facilitating a more efficient utilization of collective intelligence across teams.Glean originated from Founder & CEO Arvind Jain’s profound insight into the challenges that employees encounter while seeking and comprehending information at work. Witnessing firsthand how fragmented knowledge and a multitude of SaaS tools hindered productivity, he aimed to create an enhanced solution – an AI-powered enterprise search platform that enables rapid and intuitive access to necessary information. Since its inception, Glean has transformed into a leading Work AI platform, merging enterprise-grade search, an AI assistant, and robust application and agent-building capabilities to fundamentally reshape the modern workplace.About the RoleWe are in search of a Software Engineer to become a vital member of Glean’s Data Foundations team—the unit responsible for the comprehensive data ingestion and management layer that powers Glean’s Search, AI Assistant, and Agent offerings across a multitude of enterprise applications and vast quantities of documents.Your contributions will directly influence the quality, timeliness, and reliability of the knowledge that each Glean user engages with daily.Your Responsibilities Include:Ingestion & ConnectivityDevelop and enhance connectors for a diverse array of SaaS and on-premise systems (including Google Workspace, Microsoft 365, Slack, Salesforce, Jira, ServiceNow, GitHub, etc.).Ensure the seamless integration and continuous improvement of data flows to maintain system performance and reliability.

Role Overview Pylon is hiring an Infrastructure Engineer, Foundation, based in Palo Alto. This role focuses on designing, implementing, and maintaining infrastructure that supports the company’s core products and services. The work directly supports operational reliability and technical growth across the organization. What You Will Do Design and build infrastructure solutions to support Pylon’s main offerings Maintain and improve existing systems to ensure reliability and performance Work with teams across engineering and other functions to integrate and support infrastructure needs Identify opportunities to optimize system performance and scalability Who We’re Looking For Proactive approach to problem solving and infrastructure development Interest in building scalable systems and improving performance Comfort working closely with cross-functional teams

Join PsiQuantum, a pioneering force dedicated to creating the first practical quantum computers that will revolutionize various industries. Since our inception in 2016, we have been unwavering in our mission to construct and implement million-qubit, fault-tolerant quantum systems.Our innovative quantum computers leverage the principles of quantum mechanics to tackle problems that are beyond the capabilities of the most sophisticated supercomputers and AI technologies. The transformative potential of these machines will benefit fields such as energy, pharmaceuticals, finance, agriculture, transportation, and materials science.Utilizing silicon photonics as the foundation of our architecture, we capitalize on advanced semiconductor manufacturing techniques—partnering with leaders like GlobalFoundries. This approach allows us to employ high-volume processes that already produce billions of chips for telecommunications and consumer electronics. The benefits of photonics are clear: they are immune to heat, unaffected by electromagnetic interference, and seamlessly integrate with current cryogenic cooling systems and standard fiber-optic infrastructures.In 2024, we announced significant government-funded projects aimed at establishing our first utility-scale quantum computers in Brisbane, Australia, and Chicago, Illinois. These initiatives illustrate the growing acknowledgment of quantum computing's strategic and economic significance, emphasizing the urgency to scale our efforts.At PsiQuantum, we are also focused on developing the algorithms and software necessary for these systems to achieve commercial viability. Our application and software teams collaborate with prestigious Fortune 500 companies—including Lockheed Martin, Mercedes-Benz, Boehringer Ingelheim, and Mitsubishi Chemical—to optimize quantum solutions for real-world applications.Quantum computing signifies not merely an extension of classical computing but a radical transformation, offering pathways to tackle challenges that cannot be addressed through any other means. The opportunities are vast, and we are committed to making this vision a tangible reality.We invite you to be a part of this groundbreaking journey.

Join Mudflap, a pioneering force in the $800 billion trucking industry, where our innovative payment solutions empower truckers to save significantly on fuel costs—their largest operational expense. We connect fuel stop partners with new customers, creating a vibrant marketplace that is rapidly expanding. We are actively seeking a customer-focused Senior Software Engineer to help us shape our exciting future.As a Senior Software Engineer specializing in Data Platforms, you will be instrumental in constructing a robust data infrastructure that ensures reliable and scalable data flow throughout Mudflap's systems. Your contributions will be vital in designing and managing the frameworks and services that facilitate efficient data ingestion, processing, and accessibility on a large scale.In this role, you will architect and develop high-performance platform systems that drive data ingestion, orchestrate pipelines, and manage large-scale processing. Your efforts will lay the groundwork for high-availability data systems that empower Mudflap's teams to operate with speed and confidence.This position is based in the Bay Area and offers a hybrid work model, allowing for a blend of in-office collaboration and remote work.

Join xAI as a Software Engineer on our Data Platform team, where you'll design, build, and operate scalable distributed systems that handle vast data processing and transport. Be part of a dynamic environment focused on engineering excellence, working with cutting-edge technologies like Apache Kafka, Spark, and Flink to drive real-time machine learning and analytics at a petabyte scale.

Senior Staff Software Engineer - Data PlatformAbout LadderLadder is revolutionizing the life insurance industry by eliminating unnecessary delays, paperwork, and in-person meetings. Founded by Jamie, who experienced a personal loss at a young age, our mission is to simplify access to life insurance so families can secure their futures. By harnessing the power of real-time underwriting and AI technology, we have transformed the months-long application process into a matter of minutes, garnering over $74 billion in coverage provided. Our user-friendly digital experience is celebrated by clients, as reflected in our glowing Trustpilot and Google reviews.About the RoleWe are seeking a dynamic Senior Staff Software Engineer with extensive experience in building scalable ETL pipelines. You will tackle complex backend and data plumbing issues that connect our transactional systems (Datomic) with analytical and streaming infrastructures (BigQuery, Kafka, Flink, DBT). If you thrive on solving intricate architectural challenges using immutable data structures and functional programming, we want you on our team!

Role overview Speechify seeks a Software Engineer specializing in Data Infrastructure and Acquisition at its Palo Alto, CA office. This position focuses on building and refining the data pipelines and backend systems that support Speechify’s text-to-speech products. What you will do Design, develop, and improve data pipelines to meet product and business requirements Collaborate with engineering, product, and data teams to maintain reliable data flows Contribute to systems that support data-driven decisions and ongoing product improvements

Rivian and Volkswagen Group Technologies brings together two major automotive innovators focused on advancing mobility. The partnership works on a range of technology solutions, including operating systems, zonal controllers, and cloud connectivity. The goal is to address the unique challenges of electric vehicles and set new standards for software-defined vehicles worldwide. With expertise in connectivity, artificial intelligence, and security, the team aims to create smarter, more connected, and sustainable mobility solutions. Role overview The Vehicle Data Services team seeks a Lead Staff Software Engineer to help drive the Cloud Data Platform. This position centers on building scalable and reliable Data Services that move data between backend systems and vehicles. The work involves supporting high-throughput telemetry, managing both streaming and batch data, maintaining a data model registry, and coordinating fleet-wide push updates. What you will do Design, develop, and maintain high-performance, low-latency distributed systems for vehicle data services Support telemetry systems that handle streaming and batch data Oversee the data model registry and manage fleet push updates Shape the interaction between Cloud and Mobile services with vehicles and other cloud systems Collaborate with cross-functional teams to solve complex technical challenges Contribute to the architecture and software for next-generation Software Defined Vehicles (SDVs) Requirements Experience designing and developing distributed systems Ability to work on high-throughput data platforms and telemetry systems Strong collaboration skills for working with cross-functional teams Background in supporting cloud and mobile service integration with vehicles

At PsiQuantum, our mission is to pioneer the development of the first practical quantum computers—machines that can unlock the transformative potential that the quantum field has promised for decades. Founded in 2016, we are singularly focused on creating and deploying million-qubit, fault-tolerant quantum systems.Quantum computers utilize the principles of quantum mechanics to tackle challenges that traditional supercomputers and AI systems cannot overcome. Their potential impact spans across various industries including energy, pharmaceuticals, finance, agriculture, transportation, and materials.Our innovative architecture is founded on silicon photonics, leveraging cutting-edge semiconductor manufacturing processes in partnership with leaders like GlobalFoundries. This approach allows us to utilize high-volume techniques that yield billions of chips for telecommunications and consumer electronics. Photonics provides inherent advantages for scalability: photons are unaffected by heat, immune to electromagnetic interference, and can seamlessly integrate with existing cryogenic cooling and standard fiber-optic systems.In 2024, PsiQuantum initiated government-funded projects to establish our first utility-scale quantum computers in Brisbane, Australia, and Chicago, Illinois. These initiatives reflect a growing acknowledgment that quantum computing will be a defining strategic and economic force, making it imperative to scale our efforts.Moreover, PsiQuantum is actively developing the algorithms and software necessary to ensure these systems are commercially viable. Our teams collaborate directly with top Fortune 500 companies—including Lockheed Martin, Mercedes-Benz, Boehringer Ingelheim, and Mitsubishi Chemical—to tailor quantum solutions for tangible real-world applications.Quantum computing signifies a fundamental departure from classical computing, presenting a unique pathway to address challenges that no other technology can solve. The potential is vast, and we have a clear strategy to bring it to fruition.Join us to be part of this revolutionary journey!

Woven by Toyota is at the forefront of Toyota's transformative journey into a mobility-centric future. With a deep commitment to innovation that prioritizes human needs, our goal is to redefine mobility in ways that enhance societal well-being.Our initiatives are driven by four key pillars: AD/ADAS focusing on autonomous and advanced driver-assist technologies; Arene, our robust software development platform for software-defined vehicles; Woven City, an innovative testbed for mobility solutions; and Cloud & AI, the digital backbone of our collaborative ecosystem. Together, these elements support our ambitious vision of achieving zero accidents and promoting a healthier society.TEAMThe Advanced AD/ADAS team is dedicated to pioneering a scalable, data-centric approach to autonomous and assisted driving software. By collaborating with partners across Toyota, we integrate cutting-edge technologies into consumer vehicles worldwide. To enhance our driving systems, we develop workflows that utilize real-world data alongside in-house simulation technologies. A vital aspect of these workflows is the creation of modern data analytics and visualization web applications that analyze extensive driving data and metrics from our on-road fleet and simulation experiments, including lidar, video, geospatial data, and 3D visualizations.WHO ARE WE LOOKING FORWe are in search of an accomplished Fullstack Engineer with a robust background in modern web technologies, particularly for data streaming applications. The ideal candidate will possess experience in cloud infrastructure and large-scale data processing. You will be tasked with designing, developing, and deploying both frontend and backend components for various data analytics and visualization web applications. By advocating for best practices, collaborating with cross-functional teams, and mentoring fellow developers, you will play a pivotal role in constructing our essential AD/ADAS web tools.

Join Protegrity, a trailblazer in data protection, as we harness the power of AI and quantum-resistant cryptography to revolutionize data security across diverse environments including cloud-native, hybrid, on-premises, and open-source systems. By utilizing cutting-edge cryptographic techniques such as tokenization, format-preserving encryption, and quantum-resilient methods, we aim to make sensitive data not only secure but also accessible and trustworthy.At Protegrity, you will collaborate at the forefront of innovation, making significant contributions to the industry while working with a team of exceptional professionals. Together, we are reshaping the future of data security, empowering organizations to flourish in a GenAI landscape where data is the most valuable asset. If you are prepared to influence the future of data security, Protegrity welcomes you.We are seeking an experienced, motivated, and inquisitive DevOps Software Engineer with expertise in backend API development, microservices deployed on Kubernetes, Generative AI (GenAI), and Large Language Models (LLMs). A strong dedication to data security, privacy, and safety is essential - WE WANT YOU!In this role, you will focus on the integration and maintenance of GenAI backend microservices within Kubernetes, developing and maintaining engineering solutions for products that ensure the safe and secure use of GenAI by our customers.

Rubrik Inc. is seeking a Software Engineer with expertise in Ruby and AI to join the team in Palo Alto, CA. The role supports the ongoing development of Rubrik’s cloud data management platform, emphasizing AI-driven enhancements. Key responsibilities Collaborate with fellow engineers to create AI-powered solutions using Ruby Design, implement, test, and deploy software that applies artificial intelligence to solve product challenges Share technical insights and contribute ideas to improve platform efficiency and expand its capabilities Focus areas Advancing AI features within a cloud data management environment Delivering reliable, maintainable Ruby code for production systems

Join a Transformative OrganizationAt Palantir, we craft advanced software designed for data-centric decision-making and operations. Our platforms empower partners to create life-saving drugs, anticipate supply chain issues, locate missing individuals, and much more by connecting the right data to the right people.Position OverviewAs a Software Engineer focused on Core Interfaces, you'll be instrumental in developing applications that enable our clients to organize, analyze, and make informed decisions using their data. Our applications serve diverse roles within organizational workflows, leading users to operate multiple applications simultaneously with seamless integration. While backend services manage much of this coordination, creating a fast and responsive experience requires effective client-side frameworks that interact directly through the browser. This task is uniquely challenging; each Palantir application has distinct functionalities and user experience concepts, necessitating frameworks that integrate smoothly. Success in this role demands exceptional API design skills and a sharp eye for user experience.The frontend frameworks you will develop will support various functions across Palantir's application ecosystem. Some frameworks will integrate deeply with the Palantir Ontology, a foundational schema for defining objects and their relationships. These frameworks facilitate real-time data synchronization across applications; for instance, selecting an Ontology object on a map will instantaneously update related data in another application. Other frameworks will function independently of the Ontology, allowing applications to define custom behaviors triggered by other applications or AI agents, enhancing platform flexibility.Key ResponsibilitiesIn this role, you will oversee cross-application frameworks from technical implementation to high-level user experience decisions. You will extensively utilize core web APIs—Broadcast Channels, Service Workers, Local Storage—to enable real-time inter-application communication. Furthermore, you will contribute to the development of an Electron application, leveraging Electron-specific capabilities like the IPC API to enhance workflows. Throughout this journey, you will cultivate relationships across teams and gain deep insights into various codebases and architectural patterns.API design will be a central focus of your work; the interfaces you develop must be ergonomic and portable, easily integrating into any application that adopts them.

Role Overview Pylon is hiring a Security Engineer focused on foundational security practices at our Palo Alto office. This role centers on building and maintaining security protocols to protect company infrastructure. What You Will Do Design, implement, and maintain security measures across systems and networks Work with teams from different disciplines to spot vulnerabilities and address them Help ensure Pylon meets relevant industry security standards and compliance requirements Location This position is based in Palo Alto.

Join Rubrik, Inc. as a Senior Software Engineer specializing in API Infrastructure. In this role, you will play a pivotal part in designing and developing robust and scalable APIs that empower our cloud data management solutions. Your expertise will help shape the future of our platform, driving innovation and enhancing our product offerings.

Hello from Cygnus Professionals,We hope this message finds you well!We are currently seeking a talented Big Data Engineer specializing in Spark to join our dynamic team. If you possess the necessary skills and are interested, please send us your updated resume along with your contact information and desired rate.Position: Big Data Engineer with SparkLocation: Palo Alto, CADuration: Potential Contract to HireInterview Mode: Skype following a phone interviewImportant Note: We are looking for Green Card holders, U.S. Citizens, or EAD GC candidates only.Position Overview:As a Big Data Engineer, you will utilize your expertise in Java, Spark, and Hadoop to design and implement scalable data solutions. You will work with distributed systems, and your responsibilities will include:Developing data pipelines and implementing distributed system designs.Applying machine learning algorithms to enhance data processes.Building large-scale applications utilizing various software design patterns and object-oriented design principles.Engaging in research and analysis to convert raw data into structured datasets for product development.Managing data warehousing and parallel processing of large datasets using technologies such as Hadoop and cloud solutions.Participating in Agile, Scrum, and SDLC methodologies.Thriving in a fast-paced, research-oriented environment while demonstrating strong communication and collaboration skills.

Lead Staff Software EngineerLocation: Hybrid - Palo Alto Office (Tuesdays and Thursdays)Your ImpactJoin our team at MidiHealth as a Lead Staff Software Engineer, where you will play a crucial role in shaping the future of women's healthcare technology. You will be a core technical leader within our engineering organization, translating intricate concepts into actionable technical roadmaps and innovative products that drive our mission forward.Your ResponsibilitiesEvaluate complex technical challenges and spearhead architectural assessments across teams, mitigating technical debt and fostering sustainable, cross-service patterns within Midi’s healthcare ecosystem.Serve as a 'part-time product manager for technology,' championing essential infrastructure enhancements to boost business agility.Design and implement high-quality, scalable products and code, ensuring a balance between swift execution and long-term scalability.Contribute actively to our engineering culture by establishing best practices for automated testing, CI/CD, and maintaining high code quality throughout our technology stack.Assess overarching technical and business challenges, crafting elegant solutions that support both scalability and business growth.Collaborate closely with Executive Leadership, Product, Marketing, and Clinical teams to uncover unmet customer and operational needs, translating these insights into effective technical strategies that enhance outcomes for our patients and clinicians.Mentor and guide both senior and junior engineers, nurturing a culture of curiosity, humility, and technical excellence.

Backend Software EngineerConfluera is an innovative cybersecurity startup backed by Series B funding, dedicated to safeguarding the cyber landscape. Our mission is to fortify enterprises today to ensure a more secure tomorrow. We provide a comprehensive solution that enhances visibility across cloud environments, empowering cybersecurity leaders with real-time attack prevention capabilities.Key Responsibilities- Design and construct distributed systems capable of processing vast amounts of data.- Develop, maintain, and optimize APIs and systems for scalable product enablement.- Create advanced models and features to improve anomaly detection accuracy.- Collaborate and communicate effectively with Product, Design, and Engineering teams.- Rapidly develop and iterate on solutions while upholding high-quality standards.Required Qualifications- Proficiency in programming languages such as Java and Python.- Experience with streaming platforms like Kafka.- Familiarity with stream processing frameworks, including Spark.- Understanding of distributed systems architecture.Preferred Qualifications- Prior experience working with streaming and stream processing systems (Kafka, Spark, etc.).- Knowledge in building ETL pipelines.- Experience delivering and maintaining large-scale production systems.- Leadership experience in technical projects.Educational Background- A Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field, or equivalent professional experience.

Join our dynamic team at xAI, where we are committed to developing cutting-edge AI systems that understand the universe and support humanity's quest for knowledge. As an Outstanding Software Engineer, you will tackle critical product challenges and engage in hands-on projects that drive our mission forward. We value curiosity, initiative, and a strong work ethic in a collaborative, meritocratic environment. Your ability to communicate effectively and share knowledge with your peers will be instrumental in our success.