Lead, Data Operations & Evaluation Engineering

About ArcadeArcade is pioneering the world’s first AI-driven platform for creating physical products, where creativity meets reality. Our innovative platform empowers users to design, purchase, and sell custom, manufacturable products using natural language and generative AI. We believe in democratizing creation, allowing anyone to produce physical goods as …

About Saris AISaris AI specializes in developing AI-driven workflow agents that enhance and automate back-office operations specifically for banks and credit unions. Our solutions operate in highly regulated, high-stakes environments where precision, trustworthiness, and explainability are prioritized alongside rapid execution. We focus on designing for intricate systems, real-world operators, and sustainable impacts rather than just eye-catching demos.The RoleWe are seeking a Senior Product Designer who excels in navigating complex challenges. In this pivotal role, you will spearhead the design efforts across our core product areas, transforming convoluted workflows, outdated systems, and regulatory frameworks into intuitive, reliable user experiences. This position offers substantial ownership and influence over the product's strategic direction.You will collaborate closely with co-founders, product managers, and engineers to redefine the way banks and credit unions engage with AI workflow agents, particularly for users who are more domain experts than technical specialists.What You’ll DoLead end-to-end design for key product surfaces, including discovery, workflows, interaction models, and visual systems.Design user interfaces for enterprise software alongside complex, multi-step workflows.Translate banking and operational requirements into seamless user experiences.Partner with PMs to clarify problems, outline solutions, and navigate trade-offs.Collaborate with engineering teams to guarantee superior execution.Design with a focus on trust, transparency, and user control in AI-driven systems.Develop and maintain design systems, patterns, and documentation to support product scaling.Engage in user research, usability testing, and iterative refinement with real customers.What We’re Looking For6+ years of product design experience, including substantial time in enterprise or B2B software environments.Demonstrated success in designing complex systems such as dashboards, workflows, administrative tools, and regulated products.Proficiency in understanding and synthesizing user challenges.Strong capabilities in interaction design and information architecture.Experience collaborating closely with engineering teams in dynamic product environments.Ability to balance the needs of users with technical constraints and business objectives.

Join Our Team at Retell AIAt Retell AI, we are pioneering the future of call centers with innovative voice AI technology. In just 18 months, our cutting-edge AI voice agents have transformed how thousands of companies handle their sales, support, and logistics calls, reducing reliance on extensive human teams. Supported by renowned investors such as Y Combinator and Alt Capital, we have achieved remarkable growth, scaling from $5 million to $36 million in annual recurring revenue (ARR) with a dedicated team of 20.Our ambitious vision for 2026 is to develop a comprehensive customer experience platform powered entirely by AI. We are redefining automation by building intelligent AI agents capable of functioning as frontline representatives, quality assurance analysts, and managers, ensuring continuous improvement in customer interactions.As we expand, we seek passionate innovators eager to tackle challenging technical problems and make a significant impact at one of the fastest-growing startups in voice AI. Together, let’s shape the future.Recognized as a top 50 AI application in the a16z list: https://tinyurl.com/5853dt2xRanked #4 on Brex's Fast-Growing Software Vendors of 2025: https://www.brex.com/journal/brex-benchmark-december-2025One of the top startups on: https://leanaileaderboard.com/About the RoleWe are looking for a Senior Product Designer to craft exceptional products at Retell. You will design the infrastructure and tools that enable real-time AI voice agents used by dynamic companies. The quality of design is paramount as every interaction occurs in real time, with actual users under pressure.In this role, you will take ownership of end-to-end product design across essential user workflows. Collaborating closely with founders, engineers, and customers, you will shape features from the ground up, rather than merely refining existing user interfaces. This position offers substantial ownership and influence over product direction, user experience quality, and design standards.

Join Lyft as a Senior Illustrator specializing in Design Foundations and AI Transformation! We are looking for a highly creative and skilled illustrator to enhance our design team. In this role, you will collaborate with cross-functional teams to create engaging visual content that supports our design principles and AI initiatives. Your illustrations will play a pivotal role in conveying our brand message and enhancing user experiences.

Join Lyft as a Senior Design Program Manager in our Design Foundations & AI Transformation team, where you will play a pivotal role in shaping and enhancing our design processes, driving innovation through AI integration. This is an exciting opportunity to work at the intersection of design and technology, ensuring that our design principles are robust and scalable to meet the evolving needs of our users.As a Senior Design Program Manager, you will lead cross-functional teams, manage complex design projects, and collaborate closely with designers, product managers, and engineers to deliver exceptional design solutions. You will champion design thinking methodologies and foster an environment that promotes creativity and excellence.

Help Build Tools That Detect Wildfires Early About Pano AI Pano AI develops technology to help fire professionals spot and respond to wildfires faster. Headquartered in San Francisco, the team now includes more than 150 people working in a hybrid-remote model. The company’s platform combines advanced hardware, software, and artificial intelligence, all accessible through a web-based interface. Fire authorities use Pano’s network of 360-degree, ultra-high-definition cameras, along with satellite and other data sources, to monitor specific geographic areas and receive real-time intelligence about emerging threats. The Challenge Wildfires are growing more intense and unpredictable as climate change drives drier conditions and stronger winds. Most fires are still detected by bystanders and reported through 911, which can mean hours of delay before first responders are dispatched. Pano AI aims to give fire authorities a faster, more reliable way to detect and confirm new ignitions, so small incidents are stopped before they become disasters. Recognition Named one of the TIME 100 Most Influential Companies of 2025 Selected by MIT Technology Review as a top 15 climate tech company to watch in 2024 Recognized by Fast Company as a Top 10 most innovative company in AI of 2023 Featured in the Wall Street Journal and Bloomberg Pano AI continues to grow as a leader in early wildfire detection and intelligence, supporting first responders with timely information and better coordination.

Join Monaco, the pioneering revenue engine for startups, as we revolutionize the landscape of sales solutions with our AI-native platform designed to replace outdated CRM systems.We are seeking a talented AI Product Designer to shape the future of our AI-driven product experiences. This role offers significant ownership at the crossroads of product development, design, and modern AI user experience.

Role Overview Sigma Computing is building tools that help businesses let their customers create applications, agents, and dashboards using governed enterprise data. As the design team grows, the company is looking for a Senior Product Designer, AI, who thrives on solving complex problems and delivering new capabilities across the technology stack. The team values designers who want to make data accessible to everyone. What You Will Do Work at the intersection of interaction design and AI engineering Use AI to speed up product development and shipping Develop skills and evaluation methods to improve AI effectiveness Explore and define new ways for users to interact with intelligent systems Go beyond traditional design by not only working in Figma but also coding with AI, training it, and evaluating its performance Challenge and rethink what user interfaces can be when the UI itself can reason Work Location This position requires working on-site four days a week at Sigma Computing's San Francisco office.

Join Fractional AI as an Associate Principal of AI TransformationAt Fractional AI, we specialize in creating tailored generative AI software solutions designed to revolutionize businesses. Our clients include private equity-backed companies and Fortune 500 enterprises across diverse industries.As AI continues to evolve, every C-suite executive is grappling with the challenge of translating theoretical AI into practical applications. Our elite engineering team excels at developing comprehensive AI solutions, while our top-tier business team offers expert AI advisory services. We are on a fast-paced growth trajectory, positioned at the cutting edge of applied AI, collaborating with some of the world's largest private equity firms.We seek intellectually curious, collaborative professionals eager to make an impact from day one.Role OverviewAs an Associate Principal, you will serve as the intellectual backbone of our AI due diligence practice. Your responsibilities will include assessing disruption risks and identifying value creation opportunities across various industries, conducting management interviews, and presenting your insights to our private equity clients. Each quarter, you'll gain insights into 4-5 companies, honing a unique pattern recognition that is unmatched in the market.This exposure will pave your way to becoming a Principal at Fractional AI, the go-to advisor for private equity firms seeking AI guidance for their portfolio companies. In addition to diligences, you will collaborate with our Principals on active deals, proposals, and fostering relationships within the private equity sector. Within 6-12 months, you will be expected to begin leading your own deal pursuits.Note that this position does not have sales quotas but is designed to evolve into one.Key ResponsibilitiesLead end-to-end diligence processes. You will be fully dedicated to each engagement while the Principal and AI Architect manage multiple deals. As the primary point of contact, you will maintain a sharp point of view, prepare the team for each interview, and ensure the Principal is thoroughly prepared for client meetings. Your role encompasses desk research, generating points of view, conducting interviews, and overseeing deliverables.Assist with live deals and account management. You will work closely with Principals on ongoing sales efforts, participating in discovery calls, shaping proposals, and managing existing customer relationships.Develop your network within private equity. This role provides a unique opportunity to connect with key players in the private equity industry, enhancing your professional footprint.

About Simple AIAt Simple AI, we are revolutionizing enterprise communication with cutting-edge voice AI agents. Our innovative solutions empower renowned companies such as DoorDash, xAI, and Omaha Steaks to streamline various phone operations—from customer support to order intake and lead qualification. As we experience rapid growth, we are on the lookout for a pioneering product designer who will play a key role in defining the future of our products. Join us in our San Francisco office five days a week and help us harness the transformative power of AI.Simple AI is supported by exceptional investors and operators, including Y Combinator, Massive Tech Ventures, and tech luminaries like Michael Seibel (Twitch), Jared Friedman (Scribd), and more.

About UsAt 3Y Health, we are pioneering AI-driven software solutions aimed at enabling healthcare providers to navigate the intricate administrative challenges that currently absorb 40% of the industry’s financial resources. Our comprehensive platform empowers clinician entrepreneurs, equipping medical professionals with the tools they need to establish, manage, and expand their private practices. By integrating cutting-edge AI and automation, we empower these independent practices to reclaim their time, cultivate successful businesses, and enhance health outcomes within their communities. Backed by over $200 million from prominent investors such as Founders Fund, General Catalyst, Softbank, and 8VC, we are on a mission to revolutionize healthcare.About the RoleWe are in search of an innovative AI Product Designer to conceptualize an Agentic system and AI agents tailored for the healthcare sector. The ideal candidate will possess a product-centric mindset, hands-on design experience, and a robust understanding of designing interactions for large language models (LLMs) and AI agents, including tool usage, function calling, retrieval-augmented generation (RAG), and evaluations. This role requires a proactive design leader capable of overseeing the entire delivery process of agentic workflows while collaborating effectively with cross-functional teams in sales, operations, marketing, recruitment, and product development. As our AI Product Designer, you will be responsible for shaping design strategies, information architecture, and the execution of both the agent platform and design system.ResponsibilitiesDesign comprehensive AI interfaces and agent workflows (including chat, tools, and actions) from initial problem framing to detailed user flows and high-fidelity designs in Figma, followed by production quality assurance.Collaborate closely with AI engineers to create interfaces capable of managing real-time data and dynamic outputs.Rapidly prototype using Figma (advanced prototyping), React, Replit, and Cursor; apply lightweight coding in HTML, CSS, and JavaScript or Framer when necessary; conduct usability tests, implement analytics, and iterate based on controlled experiments and session reviews.Transform complex laboratory tasks into user-friendly layouts and intuitive workflows.Foster innovation by identifying new AI design opportunities and developing ground-breaking designs that explore the boundaries of AI capabilities.Contribute to the strategic vision for AI at 3Y Health, shaping our roadmap and expanding AI functionalities throughout the organization.

Join the Handshake TeamAt Handshake, we are revolutionizing career development in the AI economy. With a network of over 20 million knowledge workers, 1,600 educational institutions, and 1 million employers—including all Fortune 50 companies—Handshake empowers individuals to discover, hire, and enhance their careers in AI. Our growth is unparalleled, having tripled our Annual Recurring Revenue (ARR) by 2025.Why You Should Join Us:Influence how careers evolve in the AI landscape, making a visible impact on your community.Collaborate with elite AI labs, Fortune 500 partners, and top-tier educational institutions.Be part of a dynamic team with leaders from Scale AI, Meta, xAI, Notion, Coinbase, and Palantir.Contribute to a rapidly expanding business poised to generate billions in revenue.Your Role:Collaborate with product, engineering, data, research, and operations teams to create a vision for operator independence and self-service tools.Craft strategic product visions and work with partners to implement them in actionable phases.Work closely with the Model Enablement and Fellow Experience squads, enhancing their initiatives through your design work.Engage with operations leaders to understand workflows, conduct user shadowing, identify pain points, and turn insights into prioritized design investments.Address complex, user-centered challenges and translate them into straightforward solutions.Oversee the design process from conception to production, rapidly iterating through research, user journeys, wireframes, prototypes, and polished designs.Elevate our design culture and quality through systems thinking, product reasoning, precision, facilitation, and mentorship.

The OpportunityJoin our dynamic team at Rowspace as a Product Designer, where your creativity will transform complex AI functionalities into user-friendly solutions for our customers. Your mission is to craft experiences that not only integrate with existing workflows but also empower professionals in research, analysis, and decision-making.Your ResponsibilitiesDesign intuitive user experiences that elevate our AI-powered knowledge engine for investment professionals—from analysts to partners.Create user interfaces for intricate workflows including variance analysis, value creation identification, and financial forecasting.Develop seamless integration experiences for platforms such as Excel, chat applications, and other financial tools.Establish scalable design systems to ensure consistency and usability across our platform.Engage in user research with hedge fund analysts, private equity professionals, and venture capital partners to uncover their needs and challenges.Produce prototypes and wireframes that clearly communicate complex AI functionalities in a straightforward manner.Collaborate with engineering teams to validate technical feasibility and performance of your designs.Design with an emphasis on trust and transparency, ensuring AI decision-making processes are clear and auditable.

Join us in combating the escalating wildfire crisis through cutting-edge AI and IoT technologies!About UsThe Challenge: In a world where every moment counts during fire emergencies, the growing intensity of wildfires, driven by climate change, poses a serious threat to communities. Traditional detection methods reliant on bystander reports can delay response times, allowing small fires to escalate into catastrophic disasters. Our mission is to equip fire authorities with advanced capabilities for swift detection, confirmation, and localization of fires, enabling timely intervention.About Pano AI: We are a dynamic start-up with over 150 team members, operating in a hybrid-remote model and based in San Francisco. As pioneers in early wildfire detection and intelligence, we empower fire professionals to respond more effectively and safely, ensuring they have access to the right tools and timely information needed to combat new ignitions before they escalate. Pano AI integrates sophisticated hardware, software, and artificial intelligence into a user-friendly web platform. By harnessing a network of ultra-high-definition 360-degree cameras positioned in strategic locations, along with satellite and other data sources, we create a real-time overview of potential threats, delivering actionable intelligence instantly.Recognized by TIME as one of the 100 Most Influential Companies of 2025, and featured by MIT Technology Review as one of the top 15 climate tech companies to watch in 2024, Pano AI is at the forefront of innovation. Fast Company also named us one of the Top 10 Most Innovative Companies in AI of 2023. Our achievements have been highlighted in notable publications such as the Wall Street Journal and Bloomberg.

About Resolve AI Resolve AI focuses on solving challenges in software maintenance and production troubleshooting, aiming to boost engineering productivity. The team is building a fully autonomous AI Production Engineer that can identify and fix complex system issues from beginning to end. The company was founded by Spiros Xanthos and Mayank Agarwal, who previously led OpenTelemetry and contributed to Splunk Observability. Both have a track record of successful exits to Splunk and VMware. Resolve AI has raised over $150M from investors such as Lightspeed, Greylock, and Unusual Ventures. Individual backers include Jeff Dean (Google DeepMind), Thomas Dohmke (GitHub), Matt Garman (AWS), Reid Hoffman (LinkedIn), and Fei-Fei Li (Stanford). Role Overview: Product Designer Own the design for major parts of the Resolve product, from identifying problems to delivering final designs. Use prototyping to explore ideas and quickly turn abstract challenges into tangible concepts for team and user feedback. Create new interaction models for AI in production settings, often working in areas where design standards are still emerging. Work closely with engineering and product teams, collaborating both remotely and in person to keep the product vision aligned. Stay in touch with users: conduct research, join incident reviews, use the product directly, and fold insights into your work. Raise the bar for design quality, paying attention to typography, layout, animation, and the details that make software feel polished. Help grow and refine the design system as the product evolves. Use AI as a creative partner to speed up exploration, improve quality, and clearly explain your design decisions. What We Look For At least 5 years of experience designing complex software products, ideally for technical or developer audiences. Background in observability, data tools, infrastructure, or AI products is a plus. A strong portfolio that highlights both your design process and finished work. Clear communication skills and a collaborative approach to working with cross-functional partners.

Join our innovative team at Ping Identity as the Director of Engineering for AI Transformation. In this pivotal role, you will lead the charge in integrating AI technologies into our engineering processes, driving operational efficiency, and enhancing product offerings. You will collaborate with cross-functional teams to shape the future of identity management and ensure our solutions remain at the forefront of technology.

Handshake is looking for a Senior Product Designer II to help shape the future of AI-driven features and user experiences. This position focuses on designing products that feel both innovative and seamless, working closely with engineering, product management, and other teams. Key responsibilities Create intuitive interfaces for products and features powered by AI Work alongside cross-functional partners to transform ideas into polished, user-ready experiences Promote user-centered design principles throughout every stage of the product lifecycle Ensure that all interactions are clear, accessible, and engaging for users Bring creative ideas that enhance both Handshake’s brand and product quality What we look for Expertise in user experience and interface design Background working with AI-driven or technology-forward products Strong collaboration skills and openness to feedback Creativity and a drive to address real user needs Dedication to delivering high-quality, user-focused solutions Location This role is based in San Francisco, CA.

Be Part of the Future of Commerce with Whatnot!Whatnot is the premier live shopping platform across North America and Europe, dedicated to helping you buy, sell, and discover your favorite items. We are revolutionizing e-commerce by merging community, shopping, and entertainment into a unique experience tailored just for you. As a remote co-located team, we thrive on innovation, grounded in our core values. With operational hubs in the US, UK, Germany, Ireland, and Poland, we are collaboratively shaping the future of online marketplaces.From fashion and beauty to electronics and collectibles like trading cards and comic books, our live auctions cater to a diverse audience.We’re just getting started! Recognized as one of the fastest-growing marketplaces, we seek innovative, forward-thinking problem solvers across all functions. Stay updated with the latest from Whatnot on our news and engineering blogs and join us as we empower individuals to transform their passions into successful businesses while fostering community through commerce. Role OverviewWhatnot is seeking a skilled and thoughtful Senior Product Designer who is passionate about tackling complex challenges, designing scalable systems, and crafting user-centric experiences that align with business objectives. You will lead the design process for end-to-end workflows across high-impact areas, focusing on user-facing features, internal tools, and essential platform systems.In this pivotal role, you will influence the future of our product by developing experiences that are intuitive, efficient, and user-focused. You will collaborate closely with designers, product managers, engineers, data scientists, operations, and other cross-functional partners. Your responsibilities may include anything from designing onboarding processes and discovery flows to creating educational content, user review systems, or facilitating real-time interactions during live events.You will report to a Design leader and have the flexibility to work from one of our office hubs (LA, SF, NYC, or Seattle) or remotely (U.S. only).Craft intuitive, end-to-end product experiences for both user-facing and internal tools.Collaborate with cross-functional teams to translate intricate problems and workflows into seamless product experiences.Conduct user research and usability testing to inform your designs and validate your solutions.Stay current with design trends and best practices to ensure our products remain competitive and innovative.

Join Twitch as the Vice President of Product for Commerce, where you'll lead our innovative product strategies to enhance the shopping experience on our platform. This is a unique opportunity to shape the future of commerce in the live streaming industry, collaborating with cross-functional teams to create impactful solutions. You'll drive product vision, strategy, and execution, ensuring alignment with our business goals while delivering exceptional value to our users.