Machine Learning Evaluation Engineer

Join the forefront of technology as we revolutionize the construction industry with advanced autonomy.Be a Part of Innovation at Bedrock RoboticsAt Bedrock Robotics, we are transforming artificial intelligence from theoretical concepts into practical applications that enhance the world’s infrastructure. Our team comprises seasoned professionals who have been pivotal in launching industry leaders like Waymo, scaling Segment to a $3.2 billion acquisition, and driving Uber Freight to $5 billion in revenue. We are currently implementing autonomous systems in heavy construction machinery nationwide, expediting the timelines of multi-billion dollar infrastructure developments while significantly enhancing job site safety.With a robust funding of $350 million, we are rapidly addressing the escalating demand for housing, data centers, and manufacturing facilities, all while tackling the construction sector's increasing labor shortages. This is where innovative algorithms meet the realities of heavy machinery.If you are passionate about leveraging cutting-edge technology to tackle real-world challenges and wish to collaborate with a talented team of industry experts, we invite you to apply.Role: Machine Learning Engineer: EvaluationBedrock Robotics is on a mission to integrate autonomy into construction processes! We are seeking a driven engineer with substantial experience in evaluating complex machine learning systems in real-world scenarios. Your objective will be to convert the intricate dynamics of the built environment into actionable, AI-driven evaluations that enhance the adoption of our Bedrock Operators.The ideal candidate will have a proven track record in developing evaluation systems and executing statistical analyses to assess performance variations across system iterations. Your experience in iterating on complex machine learning systems in production environments will be crucial, as you navigate the intricacies involved.Your Responsibilities:Design and Maintain Evaluation Systems:Develop and maintain pipelines for performance measurement—encompassing both open-loop and closed-loop simulations, hardware-in-the-loop systems, and field data from Bedrock Operator-equipped machinery. Collaborate with other teams to glean insights earlier in the development cycle through optimized workflows.Develop Metrics:Align product objectives with system behaviors by translating real-world specifications into measurable indicators derived from logged data. Enable data-driven decision-making for everything from parameter adjustments to strategic program planning.

Be Part of the Future of Autonomous RoboticsAt Bedrock Robotics, we are pioneering the transition of AI from theoretical frameworks to practical applications in the built environment. Our team is comprised of seasoned professionals who have been instrumental in the success of innovative companies such as Waymo, Segment, and Uber Freight. We are at the forefront of deploying autonomous technologies in heavy construction machinery, significantly enhancing the efficiency and safety of multi-billion dollar infrastructure projects across the nation.With backing from $350 million in funding, our mission is to address the urgent need for housing, data centers, and manufacturing facilities, while simultaneously responding to the construction industry's labor shortages.This position is where cutting-edge algorithms meet the practical world of construction. You will work alongside industry experts and top-tier engineers to tackle complex real-world challenges that cannot be simulated. If you are eager to leverage advanced technology for impactful problem-solving within a skilled team, we encourage you to apply.

Be Part of the Revolution in Construction AutonomyAt Bedrock Robotics, we're transforming the landscape of construction with cutting-edge AI technology. Our team is composed of seasoned experts who have been instrumental in launching industry-defining initiatives such as Waymo, scaling Segment to a $3.2 billion acquisition, and driving Uber Freight's growth to $5 billion. We are actively deploying autonomous systems in heavy construction machinery nationwide, enhancing the efficiency of multi-billion dollar infrastructure projects and elevating safety standards on job sites. With an impressive $350 million in funding, we are swiftly addressing the urgent need for housing, data centers, manufacturing hubs, and tackling the construction industry's labor shortage.Join us in a dynamic environment where innovative algorithms meet real-world applications. Collaborate with industry veterans and elite engineers to tackle tangible challenges that surpass the limitations of simulation. If you are eager to leverage groundbreaking technology to make a significant impact alongside a talented team, we invite you to be part of our mission.We are seeking a passionate Technical Program Manager to help shape Bedrock's platform from inception, spearheading cross-functional initiatives encompassing hardware, onboard infrastructure, and safety.In this pivotal role, you will act as a catalyst for our most thrilling projects, transforming intricate hardware-software integration challenges into seamless, high-impact execution. You will work closely with exceptional engineering teams to deliver the next generation of autonomous construction machinery.This hands-on role is ideal for someone who thrives in fast-paced, early-stage environments and is eager to establish robust processes that will empower our rapidly growing company.Your Responsibilities:Lead complex, cross-functional technical programs, guiding autonomous systems from early prototypes to production-ready deployment.Oversee execution across software, hardware, firmware, safety, and field operations, integrating deeply interconnected workstreams into a cohesive strategy.Direct system-level integration and milestone planning, ensuring timely alignment of firmware, drivers, hardware setup, vehicle production, and field deployments.Facilitate critical technical decision-making, guiding teams through trade-offs, clarifying uncertainties, and driving progress with urgency.Proactively identify and mitigate program and technical risks to ensure smooth execution.

Be a Part of Pioneering Advanced Autonomy in ConstructionAt Bedrock Robotics, we are transforming the landscape of construction by integrating advanced AI technologies into real-world applications. Our team comprises industry experts who have played pivotal roles in renowned companies such as Waymo, Segment, and Uber Freight. We are on a mission to deploy autonomous systems on heavy construction machinery nationwide, significantly enhancing project timelines for billion-dollar infrastructure endeavors while prioritizing job site safety. With robust funding of $350M, we aim to bridge the gap between the escalating demand for housing, data centers, and manufacturing with the construction industry's persistent labor shortages.Join us where cutting-edge algorithms meet hands-on construction expertise. Collaborate with seasoned construction professionals and top-tier engineers to tackle challenges that simulations alone cannot address. If you are eager to leverage innovative technology to make a tangible impact, we invite you to become a vital member of our dynamic team.Your Role:As we expand rapidly and diversify our product offerings and revenue streams, we seek a distinguished finance leader to take on the role of Strategic Finance Lead. This pivotal position within our Finance team will influence the financial strategy of Bedrock Robotics and empower executive-level data-driven decision-making, driving long-term value creation. You will partner closely with the VP of Finance, CEO, COO, Commercial team, and various stakeholders across the organization to translate business strategies into actionable financial plans and insights.Key Responsibilities:Lead Strategic Planning:Oversee the company's long-term financial planning process and multi-year strategic modeling.Evaluate the financial implications of major strategic initiatives, including mergers and acquisitions, partnerships, capital raises, and market entry.Create board and investor presentations, including decks, updates, and fundraising narratives.Advise senior leadership on capital allocation strategies, ROI frameworks, and portfolio prioritization.Develop and Manage FP&A Functions:Supervise the annual budgeting, quarterly forecasting, and monthly performance commentary processes.Establish company-wide financial targets and ensure alignment across all business units.Conduct variance analysis to inform decision-making.

Become a Key Player in Revolutionizing Construction AutonomyAt Bedrock Robotics, we are pioneering the transition of artificial intelligence from research labs to real-world applications. Our team, composed of experienced professionals who have contributed to the successes of Waymo, Segment, and Uber Freight, is dedicated to deploying cutting-edge autonomous systems in heavy construction machinery across the nation. Our efforts are accelerating billion-dollar infrastructure projects while enhancing job site safety. With $350 million in funding, we are rapidly addressing the increasing demand for housing, data centers, and manufacturing facilities amid the construction industry's labor shortages.In this role, you will bridge the gap between theory and practice, collaborating with seasoned construction experts and top-tier engineers to tackle complex physical challenges that simulations cannot resolve. If you are eager to leverage advanced technology to solve real-world issues as part of a dynamic team, we invite you to explore this opportunity with us.We are on the lookout for a highly skilled Software Engineer to enhance our onboard testing capabilities. You will be responsible for developing comprehensive safety-critical test cases for our machines. Your work will involve close collaboration with our Robotics Platform and Cloud Infrastructure teams to design and implement validation frameworks that operate on actual machinery, in Hardware-in-the-Loop (HIL) settings, and through cloud-based end-to-end simulation. Your expertise will be crucial in integrating systems engineering, simulation, and onboard infrastructure to rigorously test the robot across hardware-software interfaces.The ideal candidate will demonstrate proficiency in creating reusable automation scripts, developing fault injection capabilities, building interfaces with cloud infrastructure, and collaborating with systems engineers to establish a robust testing framework for onboard AI. Your contributions will directly enhance system reliability and safety by identifying edge cases early, ensuring compliance with stringent safety standards.This position is perfect for software engineers who possess a systemic mindset, are aware of the implications of real-world deployments, and prefer developing intelligent solutions rather than merely executing scripts. Strong candidates will be hands-on engineers who are passionate about reliability and have a background in robotics. Some travel to our remote and Bay Area testing sites will be expected to observe and evaluate your tests in action.Join Bedrock Robotics in our mission to infuse autonomy into the construction industry! We are a dedicated group of professionals from the autonomous vehicle sector, committed to making a significant impact.

Join Our Mission to Revolutionize Autonomy in ConstructionAt Bedrock Robotics, we are pioneering the integration of AI in real-world applications. Our innovative team comprises industry experts who contributed to the success of Waymo, facilitated Segment's $3.2B acquisition, and propelled Uber Freight to $5B in revenue. We are at the forefront of deploying autonomous systems in heavy construction machinery nationwide, significantly enhancing the efficiency of multi-billion-dollar infrastructure projects while prioritizing safety on job sites. With an impressive $350M in funding, we are rapidly addressing the escalating demand for housing, data centers, manufacturing facilities, and the pressing labor shortage in the construction sector.This is where groundbreaking algorithms converge with the realities of the construction field. You will partner with seasoned construction professionals and elite engineers to tackle complex challenges that go beyond simulation capabilities. If you are eager to leverage cutting-edge technology to make a tangible impact alongside a talented team, we invite you to apply.Your RoleAs part of the Onboard Infrastructure team, you will be responsible for developing the foundational software and middleware that operates on our onboard computer, utilizing Rust from board bring-up to middleware.We are seeking a Staff Software Engineer to conceptualize and implement our onboard runtime framework. This framework is crucial for the safe and efficient operation of our autonomy stack, allowing our Machine Learning and Controls teams to accelerate their workflows and deliver with assurance.Your ResponsibilitiesDesign and develop the core application runtime framework, incorporating application lifecycle management, deterministic scheduling, and sophisticated configuration systems that manage complex subsystem dependencies.Create high-performance communication systems and zero-copy interfaces for low-latency, real-time sensor data, including cameras and lidars.Build onboard infrastructure to enhance system observability, diagnostics, and ensure deterministic logging and replay capabilities.Establish and uphold coding standards and code quality, promoting Rust best practices while mentoring junior engineers.Collaborate closely with Machine Learning and Controls teams to ensure the platform meets the stringent requirements of advanced autonomy.Required Qualifications10+ years of software engineering experience, with a focus on systems programming in Rust.Proven track record in developing high-performance, real-time systems.Strong understanding of middleware architectures and software design principles.Experience working in collaborative, cross-functional teams.

At Exa, we are pioneering the next generation of search engines designed for the era of artificial intelligence, starting from the foundational Silicon architecture. Our ambitious indexing operation is unparalleled, allowing us to crawl the vast open web at an extraordinary scale. We harness cutting-edge embedding models to comprehend this data and utilize our high-performance Rust-based vector database alongside a $5M H200 GPU cluster, which powers tens of thousands of machines simultaneously.The Machine Learning (ML) division is central to this mission, focusing on the training of foundational models that enhance search capabilities. Our vision is to create systems capable of swiftly filtering the world’s knowledge to deliver precisely what you need, regardless of the complexity of your inquiry—effectively transforming the web into a robust, searchable database.To achieve this ambitious goal, we must define what constitutes “effective search”. This is where your expertise will play a crucial role.We are seeking a talented Machine Learning Evaluations Engineer to develop and implement our evaluation framework at Exa. This position entails exploring methodologies to assess search engines in a world dominated by large language models (LLMs) and crafting the most thorough, innovative, and impactful evaluation suite. Your decisions will influence the future of search optimization and directly affect the research team’s focus, shaping the company’s strategic direction.

Join our innovative team at Osaro as a Machine Learning Engineer, where you will contribute to advancing the intelligence and capabilities of our robotic systems. Our cutting-edge products integrate advanced perception algorithms with adaptive decision-making and meticulous control strategies, empowering industrial robots to operate autonomously and efficiently across diverse applications.In this role, you will collaborate closely with our robotics, deployment, and sales teams to identify client requirements and design tailored machine learning solutions. You'll be responsible for monitoring, training, and validating the performance of our deep learning models, ensuring they meet our quality standards.We seek individuals who are not only passionate about their work but also take ownership of their projects and enjoy tackling new challenges. The ideal candidate is one who values teamwork and embodies integrity and directness in their communication.

Join xdof at a pivotal moment as we lead the charge in the development of general-purpose robotics. With frontier labs racing to create advanced robotic systems, high-quality training data is a critical challenge. Our mission is to build the essential infrastructure that supports foundational models – from data collection systems and operational capabilities to an exabyte-scale data warehouse and innovative software toolchains. This will empower our partners to advance the field of robotics.As a Research Engineer, you will be at the forefront of designing, constructing, and deploying real-world robotic learning systems. Your work will encompass manipulation, locomotion, and control, transitioning robots from raw hardware to fully operational systems.This hands-on position requires you to take ownership of systems from inception to deployment on actual robots. You will play a crucial role in establishing the technical foundations that facilitate large-scale robotic learning.

At Scale AI, our Physical AI division is at the forefront of addressing data challenges in Robotics, Autonomous Vehicles, and Computer Vision. We invite you to join our team as a Machine Learning Systems Engineer, where you will play a pivotal role in applied research and the development of machine learning pipelines. Your focus will be on enhancing algorithms and pipelines for optimal performance on cloud-based GPU systems, empowering advancements in Physical AI research and applications.Your Role:As a Machine Learning Systems Engineer within the Physical AI team, you will design and implement robust platforms that ensure the scalable and efficient deployment of foundational models for physical agents. Your contributions will support groundbreaking research and production systems, facilitating internal discoveries and external applications in the fields of robotics and autonomous technology.We seek candidates who possess a strong foundation in machine learning coupled with extensive backend system design expertise. You will thrive in a collaborative environment, bridging the gap between Physical AI research and production engineering to expedite innovation across Scale AI.

Join gleanwork as a Machine Learning Engineer specializing in LLM evaluations and observability. In this role, you will be instrumental in developing cutting-edge machine learning systems that enhance our understanding and effectiveness of language learning models. You will collaborate with cross-functional teams to drive the integration of advanced analytics and machine learning solutions.

About the RoleIn this exciting position, you will address comprehensive challenges to enhance the performance of our AI models deployed on robotic systems. Your responsibilities will include adding new features to our video processing data pipeline, updating our machine learning data loaders, training models to validate your modifications, and testing these changes in real-world robotic applications. This role requires the integration of numerous distributed Python services to achieve specific data processing and application tasks, alongside managing substantial cloud infrastructure for efficient business logic processing at scale.Your responsibilities will include:Conceptualizing and implementing innovative solutions to enhance system robustness, scalability, and speed.Revamping existing systems and services to accommodate significant future growth.Developing business logic to ensure our robots access the necessary data and that customers receive appropriate access to our robotic solutions.You may excel in this role if you:Possess extensive experience in building complex distributed applications or data pipelines at scale.Have a background in processing petabytes of data, especially video data.Demonstrate expertise in Python, with foundational knowledge in distributed infrastructure and solid understanding of modern machine learning principles.Have a robust foundation in contemporary ML techniques with experience in large-scale ML training and production deployments.Have familiarity with distributed cloud infrastructure and a deep understanding of cloud networking, permissions, and container orchestration (Kubernetes).About GeneralistAt Generalist, our mission is to realize the potential of general-purpose robots. We envision a future where industries and homes thrive on the collaboration between humans and machines. Our robots are designed to enhance productivity and efficiency.We focus on developing embodied foundation models, starting with dexterity, which necessitates pushing the boundaries of data, models, and hardware to enable robots to intelligently interact with their environments.Our company is deeply rooted in large-scale AI and robotics, with a team drawn from leading organizations like OpenAI, Boston Dynamics, and Google DeepMind, all committed to delivering groundbreaking advancements in AI technology.

Join Our Innovative Team as a Robotics Software Engineer!Location: San Francisco, CA (full-time, in-person)Company OverviewAt Cosmic Robotics, we aim to revolutionize the construction of essential infrastructure on Earth while developing advanced technologies to facilitate humanity's expansion beyond our planet. Our flagship project, Cosmic-1, is designed to install solar panels at a speed 10 times faster than current methods, propelling us toward a sustainable energy future and laying the foundation for autonomous construction in the years to come.Your RoleAs a Robotics Software Engineer, you will be instrumental in coding, testing, and deploying software for our robots engaged in live field projects. You will be a pivotal member of our team, influencing the future of autonomous construction.Why Join Us?Tackle significant challenges that will shape the future of energy and infrastructure.Collaborate with an elite team hailing from renowned organizations like NASA, SpaceX, Google, and Built Robotics.Experience rapid personal and professional growth within a fast-expanding company.Key ResponsibilitiesDesign, develop, and implement software for robotic manipulation, navigation, and path planning systems.Contribute across the entire software stack, from low-level motor control and sensor integration to high-level application logic.Ensure the safety and reliability of mission-critical systems through comprehensive testing and adherence to best engineering practices.Collaborate with hardware teams to initiate new systems and resolve technical issues.Travel to customer sites for on-site testing and deployment of robotic solutions.Maintain high code quality through reviews, automated testing, and thorough documentation.QualificationsA minimum of 2 years of professional engineering experience.Proficiency in C++, Python, and Linux development.Solid foundation in algorithms, software architecture, planning, and execution.Strong communication and project management abilities.

Join Our Mission to Transform the Construction Industry with Advanced AutonomyAt Bedrock Robotics, we are pioneering the integration of artificial intelligence into real-world applications. Our team consists of seasoned professionals who have contributed to major advancements in companies like Waymo, Uber Freight, and Segment. We are committed to deploying autonomous systems on heavy construction machinery nationwide, enhancing the efficiency of billion-dollar infrastructure projects while ensuring safety on job sites. With a robust funding of $350 million, we aim to bridge the gap between the increasing demands for housing, data centers, and manufacturing facilities, all while addressing the industry's labor shortage.This is where cutting-edge algorithms intersect with the physical world. You will work alongside construction experts and top-tier engineers to tackle challenges that simulations alone cannot solve. If you are eager to leverage innovative technology to address significant issues, we invite you to become part of our dynamic team.About the Role:As a Sensors Test and Verification Engineer at Bedrock Robotics, you will be instrumental in validating the performance, reliability, and safety of the sensing systems that drive our autonomous platforms. You will operate in laboratory settings, structured environments, and real-world construction sites. Your responsibilities will include designing and executing tests that reveal real-world failure modes, facilitating system enhancements, and ensuring the secure deployment of autonomous solutions in complex construction environments. Your contributions will be vital in enhancing the robustness and operational readiness of Bedrock's autonomy stack.Key Responsibilities:Develop and implement comprehensive sensor testing strategies across various environments including labs and live field tests.Evaluate and confirm the performance of sensing technologies such as lidar, cameras, radar, and ancillary sensor cleaning systems.Establish and refine testing methodologies, including the selection and enhancement of testing equipment and lab infrastructure.Create reusable software tools for sensor data analysis, test automation, and performance assessment.Design and execute scenarios to challenge system performance and uncover potential failure modes.Analyze test results, monitor key performance indicators (KPIs), and document findings in relation to system specifications.Collaborate with cross-functional teams including systems, software, and hardware engineering.

About Taskrabbit:Taskrabbit is an innovative marketplace platform that seamlessly connects individuals with Taskers to manage everyday home tasks, including furniture assembly, handyman services, moving assistance, and much more.At Taskrabbit, we aim to transform lives one task at a time. We celebrate innovation, inclusion, and hard work, fostering a collaborative, pragmatic, and fast-paced culture. We seek talented, entrepreneurially minded, data-driven individuals who possess a passion for empowering others to pursue their passions. In partnership with IKEA, we are creating more opportunities for individuals to earn a consistent, meaningful income on their terms by establishing enduring relationships with clients in communities globally.Taskrabbit operates as a hybrid company, with team members located across the US and EU, and has been recognized as a Built In — Best Places to Work for 2022, 2023, and 2024, receiving accolades across various national and regional categories. Join us at Taskrabbit, where your contributions will be significant, your ideas appreciated, and your potential maximized!This position operates on a hybrid schedule, requiring two days of in-office collaboration per week. It can be based in our San Francisco office or our new New York City office (opening March 2026).About the RoleMachine Learning is a foundational element at Taskrabbit, and we are in search of an experienced Senior Machine Learning Engineer to join our team and help mold the future of ML/AI at Taskrabbit. This distinct, full-stack role is designed for someone who is enthusiastic about the entire machine learning lifecycle—from initial research and model development to constructing the robust infrastructure necessary for deploying and scaling your innovations.As a Senior Machine Learning Engineer, you will engage with exciting challenges that directly influence how users discover and interact with home services on the Taskrabbit platform. You will play a vital role in enhancing our capabilities in areas such as search ranking, content discovery, and recommendation systems. Collaborating closely with data scientists and fellow engineers, you will design and implement cutting-edge algorithms, ensuring the scalability, reliability, and optimization of our models in production alongside software engineers.

About VSCO At VSCO, we empower photographers with an innovative platform that provides essential tools, a vibrant community, and the visibility needed for creative and professional growth. We cultivate an authentic creative environment that welcomes photographers of all skill levels, offering a space that inspires opportunity, collaboration, and connection. Our mission is to support photographers in their journeys, enabling them to thrive and connect with fellow creatives and businesses through our comprehensive suite of tools, available on both mobile and desktop. We seek individuals who are passionate and proactive in advancing our mission. Our team members have the opportunity to make a significant impact, and we believe that collaborative efforts yield stronger results. Our core values are essential to our team culture and guide our hiring process. Learn more about what you can expect when joining VSCO on our Careers Page. About The Role As a Senior Machine Learning Engineer, you will harness the power of AI and machine learning to create innovative, reliable user-facing product features. You will leverage your extensive technical background and hands-on experience in deploying machine learning models to deliver impactful solutions based on real-world feedback. Your focus on measurable outcomes and customer satisfaction drives your work, blending innovation with practical implementation. You will be highly skilled in Python and adept across the data and machine learning stack, enabling you to develop and launch models efficiently while ensuring scalability and maintainability. Whether working with traditional algorithms or cutting-edge deep learning and generative AI, you will expertly navigate the complexity of each problem, managing every phase from defining the challenge to deployment and iterative improvement. Your dedication to software engineering excellence will inform your thoughtful approach to system design for machine learning, encompassing data quality, pipeline design, feature workflows, model serving, and ongoing monitoring and enhancement. By integrating machine learning deeply within our cohesive product experiences, you will collaborate effectively with cross-functional teams, aligning on objectives, defining success metrics, and driving meaningful outcomes. You will stay informed about the rapidly evolving AI landscape, maintaining a discerning perspective that allows your team to focus on significant advancements while avoiding distractions. The Day to Day Design and implement ML-powered features for search, discovery, personalization, and more.

Join Our Visionary Team Revolutionizing Construction with Advanced AutonomyAt Bedrock Robotics, we are committed to transforming artificial intelligence from theoretical concepts into practical applications that enhance the real world. Our talented team consists of seasoned professionals who played pivotal roles in the inception of Waymo, the scaling of Segment to a $3.2 billion acquisition, and the growth of Uber Freight to $5 billion in revenue. We are at the forefront of deploying autonomous systems on heavy construction machinery nationwide, significantly improving the timelines of multi-billion-dollar infrastructure projects while enhancing job site safety.With $350 million in backing, we are rapidly addressing the increasing demand for housing, data centers, and manufacturing facilities while tackling the construction industry's labor shortages.This role is where cutting-edge algorithms intersect with hands-on construction. You will work alongside industry veterans and elite engineers to tackle real-world challenges that simulations alone cannot resolve. If you are eager to leverage groundbreaking technology to address significant issues and collaborate with a talented team, we invite you to apply.The Integration Engineer at Bedrock Robotics, Inc. will be based in San Francisco, CA. This role is crucial for the design, manufacturing, and testing of our autonomous hardware and software systems. You will be responsible for maintaining uptime, troubleshooting, and resolving fleet-related issues. Additionally, you will bridge the gap between our technical stack (software, hardware, and everything in between) and business applications, guiding the development and deployment of autonomous machines in both new and existing construction projects.Key responsibilities include: (i) integrating hardware and software components to create functional autonomous machines; (ii) conducting fleet issue triage, including debugging and disassembling machines to determine root causes of reported issues; (iii) designing new computer systems optimized for autonomous operations; (iv) integrating new sensors and collaborating with software engineers to develop back-end solutions for data accessibility; and (v) machine integration, which involves evaluating the electrical, mechanical, and software architecture of control systems, along with contributing to hardware and software design reviews.This position offers a hybrid work environment, allowing employees to work remotely within the United States, with a requirement to be present in the San Francisco office at least three days a week. While remote work is permitted, no travel is necessary beyond regular commuting.

Job OverviewJoin Eragon as a Machine Learning Engineer and lead the charge in transforming innovative AI models into scalable, production-grade systems. This position is pivotal in bridging research and real-world applications by designing and optimizing systems that enhance vital workflows throughout the enterprise.In collaboration with our research, product, and engineering teams, you will convert cutting-edge capabilities into dependable, high-performance systems ready for production.Key ResponsibilitiesModel Development & Deployment: Craft, refine, and deploy machine learning models within production settings.Systems Engineering: Architect scalable pipelines for training, inference, evaluation, and comprehensive monitoring.Performance Optimization: Enhance the latency, throughput, cost-efficiency, and reliability of ML systems.Data & Infrastructure: Manipulate large datasets and ensure seamless integration of models with internal systems and APIs.Cross-Functional Collaboration: Collaborate with product and engineering teams to provide end-to-end AI functionalities.Evaluation & Monitoring: Develop robust evaluation frameworks and feedback loops to ensure system effectiveness.

At Sciforium, we are pioneering the future of AI infrastructure by creating cutting-edge multimodal AI models and a proprietary, high-efficiency serving platform. With substantial financial backing and direct support from AMD engineers, our team is rapidly expanding as we develop the comprehensive stack that drives advanced AI models and real-time applications.About the RoleIn the capacity of a Machine Learning Engineer, you will engage with the entire foundation-model stack, encompassing pretraining and scaling, post-training and Reinforcement Learning, sandbox environments for evaluation and agentic learning, and deployment + inference optimization. You’ll have the opportunity to rapidly iterate on research ideas, contribute to production-grade infrastructure, and help deliver models capable of addressing real-world challenges at scale.Your ResponsibilitiesThis position offers diverse tracks - candidates can specialize or contribute across multiple areas. Key responsibilities include:Pretraining & ScalingTrain expansive byte-native foundation models utilizing vast, heterogeneous data sources.Formulate stable training methodologies and scaling laws tailored for innovative architectures.Enhance throughput, memory efficiency, and resource utilization across extensive GPU clusters.Establish and maintain distributed training infrastructures alongside fault-tolerant pipelines.Post-training & Reinforcement LearningBuild out post-training frameworks (SFT, preference optimization, RLHF/RLAIF, RL).Curate and produce specialized datasets aimed at enhancing specific model capabilities.Develop reward models and evaluation systems to facilitate ongoing improvements.Investigate inference-time learning and computational strategies to boost performance.Sandbox Environments & EvaluationCreate scalable sandbox environments for agent assessment and learning.Generate realistic, high-signal automated evaluations for reasoning, tool usage, and safety.Design both offline and online environments that support RL-style training at scale.Implement instrumentation for observability, reproducibility, and rapid iteration.Deployment & Inference OptimizationOptimize deployment strategies to ensure models are efficient and effective in real-world applications.