Senior Engineering Manager - Photon Team at Databricks | San Francisco

Join Databricks as a Senior Backend Software Engineer and contribute to solving some of the world's most challenging problems. We empower data teams through our state-of-the-art data and AI infrastructure platform, enabling businesses to leverage deep data insights for transformative growth. At Databricks, founded by engineers and driven by a customer-first philosophy, we tackle technical challenges with enthusiasm — from designing next-gen UI/UX for data interfacing to scaling our services across millions of virtual machines.In this role, you will collaborate closely with your team to develop scalable infrastructure and innovative products for the Databricks platform.

P-150 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging problems, ranging from security threat detection to the development of cancer treatments. We achieve this by creating and managing the leading data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has evolved from a modest office in Berkeley, California, to a global enterprise with over 1000 employees. Our platform is trusted by thousands of organizations, from startups to Fortune 100 companies, establishing us as one of the fastest-growing SaaS firms worldwide. Our engineering teams design and develop highly technical products that meet significant real-world needs. We continually push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers' success on our platform. We operate one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we frequently encounter cloud hardware, network, and operating system faults, and our software must effectively shield our customers from any disruptions. As a Software Engineer focused on backend development, you will collaborate closely with your team and product management to prioritize, design, implement, test, and operate microservices for the Databricks platform and products. This role includes writing software in Scala/Java, building data pipelines using Apache Spark™ and Apache Kafka, integrating with third-party applications, and interacting with cloud APIs such as AWS, Azure, CloudFormation, and Terraform. Below are examples of teams you can join: Data Science and Machine Learning Infrastructure: Develop services and infrastructure that bridge the gap between machine learning and distributed systems. Our technology supports flagship collaborative workspaces, notebooks, IDE integrations, and project management tools. We also facilitate large-scale machine learning through environment management, distributed training, and lifecycle management via MLflow. Compute Fabric: Construct the resource management infrastructure that supports all big data and machine learning workloads on the Databricks platform in a robust, flexible, secure, and cloud-agnostic manner. This software oversees millions of virtual machines.

About This Role Join Databricks as a Software Engineer focused on GenAI inference, where you will play a pivotal role in designing, developing, and enhancing the inference engine that drives our Foundation Model API. Collaborating at the intersection of research and production, you will ensure our large language model (LLM) serving systems are optimized for speed, scalability, and efficiency. Your contributions will span the entire GenAI inference stack, from kernels and runtimes to orchestration and memory management. What You Will Do Participate in the design and implementation of the inference engine, collaborating on a model-serving stack tailored for large-scale LLM inference. Work closely with researchers to integrate new model architectures or features such as sparsity, activation compression, and mixture-of-experts into the engine. Optimize latency, throughput, memory efficiency, and hardware utilization across GPUs and other accelerators. Build and maintain tools for instrumentation, profiling, and tracing to identify bottlenecks and inform optimization efforts. Develop scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads. Ensure reliability, reproducibility, and fault tolerance in inference pipelines, including A/B launches, rollback, and model versioning. Integrate with federated and distributed inference infrastructure, orchestrating across nodes, balancing load, and managing communication overhead. Engage in cross-functional collaboration with platform engineers, cloud infrastructure, and security/compliance teams. Document and share insights, contributing to internal best practices and open-source initiatives as appropriate.

The Applied AI team at Databricks is dedicated to pioneering advancements in GenAI-driven products. In recent years, we have successfully launched notable innovations such as the Databricks Assistant, AI/BI Genie, and Agent Bricks. These products are utilized by hundreds of thousands of Databricks users daily. We are addressing complex challenges such as code suggestions, error detection and correction, text-to-SQL generation, automatic pipeline creation, and knowledge QA. As our GenAI products continue to advance, we are on the lookout for multiple GenAI Engineers, ranging from junior to senior levels, to spearhead the next phase of development. In 2025, our focus will be on enhancing the quality of LLMs, broadening GenAI functionalities across Databricks products, and fortifying our platform architecture to facilitate seamless AI interactions at scale.

Join our innovative team at Databricks as a Staff Backend Software Engineer focusing on our cutting-edge AI Platform. In this pivotal role, you will be responsible for designing, developing, and optimizing backend systems that empower data scientists and engineers to build AI applications efficiently.As a key contributor, you will work closely with cross-functional teams to deliver scalable solutions that enhance our platform's capabilities. Your expertise will drive the development of robust features that support machine learning workflows and big data processing.

Join Databricks as a Staff Backend Software Engineer for our cutting-edge AI Platform. In this pivotal role, you will design and implement robust backend systems that power innovative AI solutions. Collaborate with a talented team to drive impactful projects and shape the future of data and AI.

Join Databricks as a Staff Backend Software Engineer on our cutting-edge AI Platform team. We are on a mission to simplify data and AI for enterprises worldwide. In this role, you will be pivotal in developing robust backend systems that support our AI initiatives, driving innovation and efficiency.As a member of our dynamic team, you will work with the latest technologies and methodologies to create scalable solutions that meet the needs of our clients. Your expertise will help shape the future of our AI Platform, delivering exceptional user experiences and insights.

Join Databricks as a Staff Backend Software Engineer on our AI Platform team, where you will play a pivotal role in shaping the future of data analytics and machine learning. You will work collaboratively with talented engineers to design, develop, and enhance robust backend systems that drive our cutting-edge AI solutions. Your innovative mindset and technical expertise will help us deliver unparalleled value to our customers.

The Applied AI team at Databricks is at the forefront of pioneering GenAI-powered products. In recent years, we have successfully launched the Databricks Assistant, AI/BI Genie, and Agent Bricks, collaborating with product teams to significantly enhance LLM quality for these offerings. These innovations are utilized by hundreds of thousands of Databricks users daily. We are dedicated to solving complex challenges such as code suggestion, error detection and correction, text-to-SQL generation, automatic pipeline generation, and knowledge QA.As we continue to evolve our GenAI products, we are looking for multiple GenAI Engineers at various experience levels to lead the next phase of our development. Our goals for 2025 include improving LLM quality, broadening GenAI capabilities across Databricks products, and reinforcing our platform architecture to facilitate seamless AI interactions on a large scale.

Join our dynamic team at unify as a Senior Backend Software Engineer, where you will leverage your expertise to design and implement robust backend systems that enhance our product's performance and scalability. You will collaborate closely with cross-functional teams to develop innovative solutions that meet our customers' needs.

Are you a dedicated Developer Advocate with a passion for bridging the gap between technology and the developer community? If you thrive on connecting with others, hosting engaging events, and diving into the nuances of application development and developer experience, we want to hear from you!As a Senior Developer Advocate at Databricks on the Neon DevRel team, you'll play a pivotal role in linking our engineering teams with an expanding community of application and agent developers utilizing Postgres and Neon. Your technical acumen will be essential in maintaining and enhancing our SDKs, educating users, and shaping the future of Agent and Developer Experience (AX & DX) for Neon.Developer experience will be central to your responsibilities. You will help enhance our TypeScript SDK and CLI, manage Neon’s MCP server, and develop other developer-oriented tools, all while keeping ahead of the evolving AI landscape. Your expertise in DevTools and AX will be shared through presentations, meetups, blog articles, videos, and community interactions, empowering developers to build more effectively with Neon and demonstrating our commitment to exceptional Developer Experience (DX) and Agent Experience (AX).Collaboration will be key as you work closely with the neon.com community, product teams, and engineering staff, ensuring that developer feedback directly influences product direction. You'll also partner with fellow advocates, program managers, and the broader Databricks DevRel organization to create a cohesive and impactful strategy for agent experiences.The ideal candidate will embody the core values of our DevRel team: a profound enthusiasm for application development, strong empathy for developer needs, and the ability to convey complex concepts with clarity and effectiveness.In this role, you’ll foster and expand the Neon community through top-notch technical content and hands-on experiences, continuously feeding insights back into the product to further enhance the developer experience.

About HappyRobotHappyRobot is revolutionizing the real economy with our AI-native operating system designed to bridge the gap between intelligence and action. By integrating real-time insights with specialized AI capabilities, we empower enterprises to manage complex operations autonomously.Our AI OS continuously accumulates knowledge, optimizes various processes, and adapts over time. We are initially focusing on supply chain and large-scale industrial operations, where speed, resilience, and ongoing improvement are paramount—allowing human resources to concentrate on strategic and creative high-value tasks.Discover more about our vision in our Manifesto. So far, HappyRobot has successfully raised $62M in funding, including a recent $44M in Series B financing as of September 2025. Our esteemed investors include Y Combinator (YC), Andreessen Horowitz (a16z), and Base10, who share our mission to transform enterprise operations. We are leveraging this investment to build a top-tier team of individuals with unwavering motivation, exceptional problem-solving capabilities, and a drive to exceed limits in a dynamic working environment. If this resonates with you, we want you at HappyRobot.About The RoleAt HappyRobot, our Senior Backend Software Engineers are entrusted with significant components of our product and infrastructure, overseeing projects from inception to deployment. We are seeking passionate builders who thrive in uncertain environments, value craftsmanship, and desire genuine ownership of their creations.

Join Kiddom as a Senior Backend Software EngineerAt Kiddom, we are revolutionizing the education landscape by providing a platform that champions equity and growth for all students. Our innovative approach integrates top-tier instructional materials with engaging digital learning tools, allowing schools and districts to take charge of their curriculum. With our exceptional curriculum management capabilities, we deliver personalized learning experiences that cater to the specific needs and aspirations of local communities. Our robust data insights empower educators and leaders to enhance instructional strategies, improve school programs, and foster professional development.We are seeking a dedicated Senior Backend Software Engineer to join our dynamic team, where you will play a crucial role in creating the next generation of scalable backend services. Your responsibilities will include the design, development, and maintenance of high-performance systems that underpin our applications.The ideal candidate will possess significant experience in backend technologies and system architecture, coupled with a genuine passion for addressing complex challenges faced by our users. Mentoring fellow engineers and sharing your expertise will be key aspects of this role. A strong affinity for education, an understanding of teachers' needs, exceptional product insight, and a commitment to Kiddom's mission and vision are essential.

Astranis is at the forefront of satellite technology, constructing advanced satellites for high orbits that extend humanity's capabilities into the solar system. Our satellites deliver dedicated, secure networks to a diverse clientele, including major corporations, government entities, and the US military. With five satellites successfully in orbit and numerous launches on the horizon, we are addressing a robust pipeline of over $1 billion in commercial contracts.As a trusted satellite communications partner, Astranis meets the rigorous demands for uptime, data security, network visibility, and tailored solutions. With over $750 million raised from distinguished investors like Andreessen Horowitz, Blackrock, and Fidelity, we have a thriving team of 450 engineers and innovators. Our operations are conducted from our expansive 153,000 sq. ft. headquarters located in Northern California, USA.Senior Software Engineer - BackendJoin our dynamic Platform team as a Software Engineer, where your role will involve designing and developing services that autonomously manage satellites, monitor telemetry for anomalies, and provide real-time situational awareness to ensure the safety and operational integrity of our fleet. You will play a crucial role in building the foundational components and services that empower our software organization, enabling all teams to operate more efficiently and reliably.In this position, you will help shape the core software that our satellites rely on for flawless performance.This role encompasses contributions to both our commercial and US government initiatives.Key ResponsibilitiesDevelop and implement high-performance, reliable, mission-critical software for satellite command operations.Take full ownership of features, collaborating across backend and infrastructure.Work with interdisciplinary teams to define software requirements, architectures, and designs.Continuously evaluate the evolving technology landscape and advocate for innovations to enhance our systems.Mentor colleagues, share insights, and elevate the technical standards within the team.

About UsOur mission is to revolutionize language learning.Learning a new language can transform lives by providing access to diverse cultures, career opportunities, and communities. With two billion people globally striving to learn languages, the most effective method—one-on-one tutoring—remains difficult to access at scale and has not evolved significantly over the years. Speak is developing an AI-powered, human-like tutor that fits in your pocket, offering a conversation-first approach that allows learners to practice speaking, receive immediate feedback, and progress through thoughtfully designed lessons. This results in a comprehensive journey from novice to confident speaker across multiple languages.Since our launch in South Korea in 2019, Speak has emerged as the leading language learning app, now available to learners in various markets and over 15 languages. As one of the foremost AI companies globally, we have secured over $150 million in venture capital from notable investors such as OpenAI, Accel, Founders Fund, and Khosla Ventures, with a diverse team spread across San Francisco, Seoul, Tokyo, Taipei, and Ljubljana.About This RoleWe are seeking a Senior Backend Engineer, with full-stack capabilities, to help create innovative AI-driven product experiences. The ideal candidate should have experience collaborating closely with product, design, and machine learning teams, alongside a proven track record in developing polished consumer applications. This role is pivotal in shaping our latest products focused on programmatic, conversational language learning and will significantly impact the future direction of our company.Your ResponsibilitiesCrafting innovative AI-driven product experiences and user interfaces for the web.Full-stack engineering with a primary focus on designing scalable backend systems.Troubleshooting complex streaming challenges.Taking ownership of the complete development cycle of features from ideation to production.Writing code efficiently, shipping frequently, and making a substantial impact on our business by facilitating the scaling of our content.Your Profile5+ years of industry experience as a Backend Engineer, ideally within a fast-paced startup environment.Bonus: Experience on an app that has reached over 1 million users.Exceptional problem-solving and communication skills, along with the ability to work effectively in a collaborative environment.

P-1398 Note: This is a hybrid role requiring approximately 3 days in the office in Plano, TX. Mission: As a Staff Data & AI Technical Solutions Engineer, you will take the lead in developing and guiding others in crafting innovative Data & AI technical solutions for various customer issues. This includes an in-depth exploration of production data pipelines, AI workflows, streaming data ingestion, and more. You possess extensive expertise in Data & AI architectures, having encountered a diverse array of use cases while successfully managing intricate production environments in compliance with Service Level Agreements (SLAs). You will work collaboratively with product engineering and customer account teams to deliver exceptional results for customers, especially in critical production downtime scenarios. Your role is to empower customers with the knowledge and skills necessary to create efficient architectures and dependable services, leveraging Databricks’ platform to achieve their strategic goals. Reporting to a Technical Support Engineering manager, you are recognized as a technical authority within a leading global support engineering organization, celebrated for your leadership, technical knowledge, and ability to resolve even the most challenging customer situations. The impact you will have: Lead and direct technical solutions for a wide range of complex challenges reported by Databricks customers, including escalated and critical cases. Conduct comprehensive code-level analysis and systems architecture assessments of customer workloads to resolve issues related to Databricks products, including Spark core internals, Spark SQL, Delta, DLT, and Model Serving. Act as a customer support advisor, adept at diffusing escalations during incidents directly with customer stakeholders, swiftly identifying mitigations and solutions for advanced use cases, and strategically helping to avert future customer issues. Contribute to simplifying Databricks products and enhancing customer production environments' stability by influencing Engineering and Backline Support teams to identify areas for product improvements. Establish yourself as a deep technical expert and leader in the Databricks platform and production systems, mentoring others to share your expertise. What we look for: A minimum of 8 years of experience in designing, building, testing, and maintaining data pipelines, with relevant past experience in Spark being mandatory. Proficiency in SQL databases or data warehouses, among other technical skills.

At Databricks, our passion lies in empowering data teams to tackle some of the most challenging problems globally, from detecting security threats to advancing cancer drug development. We achieve this by creating and operating the world's premier Data Intelligence Platform, enabling our customers to concentrate on high-value challenges central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has evolved from a small office in Berkeley, California, into a global powerhouse with over 1000 employees. We are trusted by thousands of organizations—from small startups to Fortune 100 companies—with their mission-critical workloads, establishing us as one of the fastest-growing SaaS companies worldwide. Our engineering teams are dedicated to developing highly technical products that address real-world needs. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability crucial for our customers' success on our platform. Operating one of the largest-scale software platforms, our infrastructure comprises millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we routinely encounter cloud hardware, network, and operating system faults, and our software is designed to shield our customers from such issues effectively. As a Data Scientist on the Data Team, you will play a pivotal role in fostering a data-driven culture within Databricks by addressing product and business challenges. The Data Team serves as an internal, production 'customer' that utilizes Databricks and influences the future trajectory of our products. Your Impact: Steer the direction of key data science initiatives including segmentation, recommendation systems, forecasting, product analytics, churn prediction, and insights. Collaborate closely with Engineering, Product Management, Sales, and Customer Success to discern product usage patterns and trends, facilitating data-driven decisions, recommendations, and forecasts. Manage stakeholder expectations in your focus area—gather evolving requirements, define project OKRs and milestones, and effectively communicate progress and results to non-technical audiences. Mentor and support junior data scientists within the team, assisting with project planning, technical decisions, and conducting code and documentation reviews. Advocate for the data science discipline across the organization, amplifying our commitment to becoming more data-driven. Develop self-service internal data products to simplify data access within the company. Represent Databricks at academic and industry conferences and events.

About SemgrepSemgrep stands at the forefront of code security, enabling developers to innovate seamlessly. Our platform empowers teams to identify, flag, and address real vulnerabilities before deployment, with security solutions that evolve alongside their coding efforts. By securing code during its creation, Semgrep provides essential guardrails, allowing developers to work swiftly while ensuring their safety. With a focus on integration, Semgrep offers visibility, control, and confidence to security teams, making it an indispensable tool for modern developers. Our AI-driven approach minimizes false positives and highlights actionable vulnerabilities, with validation from 95% of security experts across over 6 million findings. In our mission to eliminate false positives, our AppSec teams experience an 80% reduction in false positives across Code and Supply Chain, significantly alleviating backlog issues.Founded in San Francisco and supported by prestigious investors such as Menlo Ventures, Felicis Ventures, Lightspeed Venture Partners, Redpoint Ventures, and Sequoia Capital, Semgrep is recognized by Gartner in Application Security Testing and trusted by leading companies including Snowflake, Dropbox, and Figma. Discover more about us at semgrep.dev.About the RoleAs a Senior Backend Engineer, you will be instrumental in enhancing our backend and infrastructure systems to ensure a robust and efficient user experience for all our customers. You will collaborate with fellow engineers to design and develop APIs, data models, and services that power Semgrep’s scalable products. A solid understanding of databases, query optimization, and distributed systems is essential, as is the ability to integrate third-party services into existing first-party code.Our technology stack includes Typescript and React on the Frontend and Python, Flask, and SQLAlchemy on the Backend, deployed using Kubernetes and hosted on AWS. While professional experience with these technologies is preferred, we welcome candidates who are eager to learn them quickly!This position is hybrid, requiring at least 3 days a week in our San Francisco, New York, Boston, or Denver offices, depending on your team. We also consider remote work for exceptional candidates.CompensationThe estimated starting annual salary for this role ranges from $160,000 to $207,000 USD. The actual salary will be determined based on various factors, including job-related skills, relevant experience, qualifications, location, internal equity, and market data. In addition to the base salary, total compensation may include equity, variable compensation, and benefits.

About CasapCasap is an innovative Series A startup backed by over $30M in funding from renowned investors such as Emergence, Lightspeed, and Primary Ventures. Located in the vibrant tech hub of San Francisco, our team consists of experienced product leaders from industry giants like Robinhood and Chime. Our mission is to revolutionize banking operations by automating disputes and combating friendly fraud. Our solutions have garnered love and appreciation from everyday users and major financial institutions alike.We are currently seeking skilled Backend Engineers to join our team in San Francisco, eager to enhance the banking experience with our rapidly growing product that sits at the cutting edge of automation and Artificial Intelligence.