Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.
Experience Level
Mid to Senior
Qualifications
QualificationsRequiredSolid foundation in deep learning frameworks such as PyTorch and LLM architectures. Proven experience with model evaluation, benchmarking, and quality metrics. Proficiency in Python and modern machine learning development tools. Strong statistical background. Ability to comprehend, apply, and extend academic research papers. Exceptional communication skills. PreferredMaster's degree in Computer Science, Machine Learning, Statistics, or a related quantitative field (PhD preferred). Publications in leading ML/AI conferences such as NeurIPS, ICML, ICLR, or ACL. Experience with RLHF, DPO, or preference optimization techniques. Background in healthcare AI or regulated industries. Experience in building evaluation systems for production LLM applications.
About the job
About the Role
We are seeking a talented Data Scientist to take charge of ensuring the quality, reliability, and trustworthiness of our clinical AI outputs. In this pivotal role, you will develop systems that help our AI recognize its limitations, including the creation of evaluation frameworks, calibrated confidence scoring, and automated quality assurance protocols that healthcare professionals can rely on.
Key Responsibilities
Design and deploy automated evaluation pipelines to assess the quality, accuracy, and safety of AI outputs at scale.
Develop systems for uncertainty quantification where confidence scores are meaningfully aligned with accuracy.
Create comprehensive evaluation frameworks that integrate automated assessments with clinician-validated test cases.
Implement continuous feedback mechanisms to enhance model outputs based on validation signals.
Establish scalable quality gates to identify errors before they impact end users.
Contribute to efforts focused on model alignment and fine-tuning.
About bioscope.ai
At bioscope.ai, we are dedicated to enhancing healthcare through advanced AI technologies. Our team is committed to creating trustworthy AI solutions that improve clinical decision-making and patient outcomes. Join us in revolutionizing the future of healthcare.
Join Our Team as a Joint Test & Evaluation Program Officer:At CGS Federal, we are at the forefront of enhancing the United States' operational effectiveness through our Joint Test & Evaluation (JT&E) program. This initiative focuses on assessing emerging technologies and navigating the complexities of multi-domain operational environments to develop innovati…
Join Veolia Environnement S.A. as a Program Management Officer, where you will play a crucial role in driving engineering and project design initiatives. In this full-time position, you will oversee project planning, execution, and strategic alignment, ensuring that all projects meet quality standards and timelines.
Join Our Team as an Outpatient Physical Therapist!- Be part of a movement that elevates the standard of care!At Joint Ventures Physical Therapy, part of the Highbar Health family, we are committed to advancing the field of outpatient physical therapy! With a stellar reputation for providing exceptional patient care, we are excited to expand our team across New England.Our mission is to empower our clinicians to deliver top-notch care while ensuring a balanced work-life environment. If you're eager to enhance your career in a supportive and innovative setting, we invite you to join us!Why Work with Us?At Joint Ventures, we prioritize our clinicians, allowing you to concentrate on delivering outstanding patient care while we support your professional growth.
Part-time|On-site|Boston, Massachusetts, United States
Transform your enthusiasm for luxury into a rewarding career. Dive into the realm of high-end brands and leave your mark on the fashion, beauty, jewelry, and automotive industries. Join CXG, the world leader in customer experience, collaborating with prestigious names such as Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and many more.Role Overview:As a luxury brand evaluator, you will immerse yourself in the luxury sector to subtly assess customer experiences, providing vital feedback that enables brands to enhance their services. Your insights will help shape the future of luxury, whether through in-store visits, online purchases, or product returns.Flexibility: Each in-store evaluation lasts about 20 minutes, allowing you the freedom to tackle multiple assignments.Frequent Opportunities: Engage in numerous missions each month and collaborate with some of the most esteemed brands across the globe.Our Esteemed Luxury Partners:Fashion & Couture: Louis Vuitton, Saint Laurent, Balenciaga, Versace, Prada, Moncler, Fendi, Bottega Veneta, Ferragamo, COS, Bally, Dolce & Gabbana.Jewelry & Watches: Tiffany & Co., De Beers, Piaget, IWC, Boucheron, Pandora.Beauty & Skincare: Guerlain, Sephora, L’Oréal, Givenchy.Automotive: Bentley, Jaguar, Genesis, Maserati, Vespa.Your Responsibilities:Select assignments that resonate with your preferences and profile.Visit luxury stores or evaluate online—interact with sales associates in-store or from the comfort of your home.Conduct thorough observations regarding ambiance, service quality, and overall customer experience.Deliver candid feedback through our platform using structured questionnaires.Benefits of the Role:Collaborate with iconic brands across various sectors.Enjoy flexible assignments tailored to your interests.Receive compensation for your time and insights, with potential reimbursement for purchases.Utilize a user-friendly platform for managing missions and submitting feedback.How to Become Part of the CXG Community:Register: Sign up at live.cxg.com and confirm your email.Complete your profile: Fill in your details completely and get verified.Get certified: Pass the General Certification to unlock missions.Apply for missions: Discover assignments with brands that excite you.Start evaluating: Make a significant impact in the luxury market.Compensation:Earn a fee based on the complexity of your missions.
About Lyra HealthLyra Health stands at the forefront of mental health innovation, serving over 20 million individuals worldwide. With over 20 peer-reviewed studies backing our approach, we excel in delivering superior outcomes in access, clinical effectiveness, and cost-efficiency. Our transformative care model is scientifically proven to help individuals recover twice as fast, leading to a 26% annual decrease in overall healthcare claims costs. We are revolutionizing access to essential mental health services through Lyra Empower, our fully integrated, AI-driven platform that combines high-quality care with cutting-edge technology solutions.About the RoleIn alignment with our commitment to meeting urgent mental health challenges, Lyra's Center of Excellence for Neurodiversity provides specialized psychological assessments, diagnoses, and customized support for ADHD, autism, and learning differences. We are seeking dedicated contract Testing Psychologists who are passionate about holistic mental health care for individuals and families alike.As a Testing Psychologist, you will conduct thorough psychological assessments that facilitate diagnostic clarity, inform treatment plans, and guide intervention strategies for children, adolescents, and adults. Your role will tackle behavioral health complexities, delivering actionable insights through psychoeducational and psychological evaluations, while working closely with interdisciplinary care teams to enhance patient outcomes.Ideal CandidatesWe are looking for results-driven, detail-oriented professionals who thrive in a structured environment and are comfortable working with data. If you possess a strong independent work ethic and can adapt to varying circumstances, we encourage you to apply.
Whoop, Inc. is hiring an Electrical Test Technician Lead based in Boston, MA. This role centers on managing the testing processes for electrical systems and products, with a focus on maintaining high standards for quality and reliability. Role overview The Electrical Test Technician Lead takes responsibility for organizing and supervising electrical testing operations. This includes planning and executing tests, as well as guiding a team of technicians to ensure consistent results. What you will do Oversee daily electrical testing activities for various products and systems Provide direction and support to a team of test technicians Create, document, and maintain test plans and procedures Carry out detailed testing protocols to verify product performance Confirm that products meet established quality and reliability standards
About the RoleWe are seeking a talented Data Scientist to take charge of ensuring the quality, reliability, and trustworthiness of our clinical AI outputs. In this pivotal role, you will develop systems that help our AI recognize its limitations, including the creation of evaluation frameworks, calibrated confidence scoring, and automated quality assurance protocols that healthcare professionals can rely on.Key ResponsibilitiesDesign and deploy automated evaluation pipelines to assess the quality, accuracy, and safety of AI outputs at scale.Develop systems for uncertainty quantification where confidence scores are meaningfully aligned with accuracy.Create comprehensive evaluation frameworks that integrate automated assessments with clinician-validated test cases.Implement continuous feedback mechanisms to enhance model outputs based on validation signals.Establish scalable quality gates to identify errors before they impact end users.Contribute to efforts focused on model alignment and fine-tuning.
Join Sonsoft Inc. as an IBM Rational Testing Specialist in Boston! We are looking for a talented individual who is passionate about quality assurance and testing methodologies. This is a fantastic opportunity to work with cutting-edge technologies in a dynamic environment.
________This is an example!________IMPORTANT: This posting is intended solely for testing purposes within Lever's testing environment. Please refrain from applying.Founded a decade ago, Lever is addressing the critical challenge of attracting and hiring exceptional talent. Our innovative hiring software is utilized by industry leaders such as Netflix, Yelp, Cirque du Soleil, Shopify, and Spotify as they expand their teams. We are revolutionizing the talent acquisition landscape and are recognized as leaders in innovation. Our pride lies in the culture we’ve cultivated, honored as the #1 workplace in San Francisco and among the top workplaces across the United States. Our team, referred to as 'Leveroos', is our greatest asset, and we are committed to nurturing our people-first culture.
Full-time|$159K/yr - $207K/yr|Hybrid|Boston, Massachusetts, United States; Pittsburgh, Pennsylvania, United States; Remote U.S.
Mission: We are in search of a talented and driven Senior Data Engineering Analyst to join our innovative team focused on large-scale AI model evaluation through our platform, Ground Truth Regression. The ideal candidate will possess a solid foundation in data engineering, machine learning principles, and statistical analysis. At Motional, the orchestration of extensive data analysis is crucial for advancing our machine learning-driven autonomous driving technology. Our robo-taxi ML models and software are developed by a dedicated team of engineers and deployed multiple times daily. The Ground Truth Regression team is responsible for providing a comprehensive perception analysis framework to validate any changes that could influence the behavior of autonomous vehicles. The Ground Truth Regression team assesses the cumulative effects of ML and software modifications during the development phase, equipping the team with tools for root cause analysis and safety evaluations. We meticulously monitor model errors, anomalies, and rare occurrences across extensive driving scenarios, gathering insights over thousands of driving hours. The team is responsible for developing the full-stack infrastructure, including AWS Kubernetes orchestration, re-simulation, model metrics, regression reports, and deep-dive analytical tools. Collaboration with other perception and ML teams is integral for establishing metrics and analyzing outcomes. What You’ll Do: Collaborate with ML Engineers and Autonomy Software Developers to create new data analysis metrics and KPIs for validating autonomous vehicle performance. Pursue innovation by researching and developing new large-scale data analysis frameworks. Lead large-scale data analysis workflows to identify unexpected impacts of both planned and unplanned modifications to ML models and software. Construct high-quality datasets to enhance ML product performance through training and edge case validation. Deliver in-depth statistical insights on model performance and generalization through thorough error and change analysis. What We’re Looking For: Bachelor's or Master’s degree in Computer Science, Data Science, or a related field. Proficient programming skills in Python, SciPy, and related data analysis frameworks. Experience in machine learning, data mining, and statistical analysis. Familiarity with large-scale data processing and distributed computing technologies. Strong communication and software development skills, including goal setting, design documentation, testing frameworks, and collaborative team development.
Join our team at Sonsoft Inc. as an IBM Rational Testing Specialist! In this exciting full-time role, you will be at the forefront of software testing, ensuring that our clients receive top-quality solutions. We are looking for a professional who is passionate about quality assurance and has hands-on experience with IBM Rational Testing tools.
Full-time|$79K/yr - $100K/yr|Remote|Remote — Boston, Massachusetts, United States
Established in 2004, BME Strategies is a premier consulting firm headquartered in Massachusetts, dedicated to the design, execution, and evaluation of public health initiatives for government entities at local, regional, and state levels. Our mission is to empower evidence-based, community-centric solutions that enhance public health frameworks and promote equity throughout the communities we serve.Position OverviewThe Public Health Consultant specializing in Monitoring, Evaluation & Quality Improvement is pivotal in crafting, managing, and executing data-centric projects aimed at bolstering public health infrastructures and fostering community wellness. The ideal candidate will possess proven expertise in monitoring and evaluation (M&E), quality improvement (QI), epidemiology, or public health accreditation, and will be committed to enhancing client capacities in these domains. This role will report directly to the Managing Consultant, MEQ.By collaborating closely with BME’s leadership and partners, Consultants will apply their specialized knowledge in areas such as performance management system development, data analysis and visualization, accreditation readiness, community health assessment (CHA/CHIP) support, epidemiologic evaluations, and QI capacity enhancement. Additionally, Consultants may engage in related project activities including strategic planning, training development, emergency preparedness, and workforce development.This opportunity is ideal for individuals who are methodical, analytical, detail-oriented, and passionate about enabling public health departments to enhance their frameworks through informed decision-making. The successful candidate will relish working alongside clients and communities to identify their challenges and needs, deriving actionable insights from data, and contributing to accreditation or performance improvement initiatives while being part of a supportive and high-performing remote team.Key ResponsibilitiesMonitoring, Evaluation, Epidemiology & Quality ImprovementLead and support M&E initiatives, encompassing logic model creation, indicator development, data collection strategy, analysis, interpretation, and reporting.Conduct epidemiological studies, surveillance assessments, community health evaluations, and other data-driven inquiries that guide client priorities.Design and execute QI frameworks that pinpoint improvement opportunities, facilitate QI initiatives, coach teams in QI methodologies, and produce associated tools and guidance.Assist with public health accreditation (e.g., PHAB) readiness, involving performance management systems, documentation assessment, domain mapping, and the formulation of necessary plans and policies.Engage in community outreach efforts, utilizing participatory evaluation and assessment methodologies.Project Leadership & Client SupportOversee and manage public health projects and programs, ensuring timely completion of deliverables and maintaining high-quality standards.
At WHOOP, we're dedicated to transforming the landscape of human performance. Our innovative platform empowers individuals to optimize their potential through a profound understanding of their physiological data and daily activities.As a pivotal Capital Expenditure Program Manager within our Technical Program Management (TPM) team, you will be instrumental in enhancing our global manufacturing capabilities by converting capital investments into impactful production infrastructure. Your leadership will guide capital planning and execution throughout the entire product lifecycle. Collaborating closely with engineering, operations, and finance, you will ensure the provision of cutting-edge equipment, refined processes, and operational readiness essential for both new product introductions (NPI) and continuous improvement (CI) initiatives. This is a dynamic role for a strategic leader who excels at the intersection of product development and manufacturing operations, with a proven ability to manage risks, align diverse stakeholders, and drive rapid execution in a fast-paced environment.
Join our team as a Vehicle Test Driver in Boston, MA, where you will play a crucial role in ensuring the safety and performance of our vehicles. This is an exciting opportunity for individuals passionate about automotive technology and testing.
Temporary|$22/hr - $24/hr|On-site|Boston, Massachusetts, United States
Job Title: On-Call Office Services Specialist (Temporary)This in-person position is primarily based in Boston, MA, with potential travel to various client locations within a 25-mile radius to ensure seamless service delivery. The On-Call Office Services Specialist plays a vital role in maintaining operational continuity and enhancing customer satisfaction by providing outstanding office services.As an Office Services Specialist, you will be responsible for backfilling positions during staff absences, requiring flexibility and quick adaptability to diverse environments. Your contributions are essential for meeting service level agreements and ensuring that clients receive consistent and high-quality support.Core responsibilities include managing mail services, shipping and receiving, data entry, document scanning, and inventory management. Training will be provided at various SPS sites to familiarize you with our operations and enhance your service delivery capabilities.Your ability to deliver prompt, courteous, and efficient service will reflect positively on our company and contribute to a professional workplace atmosphere.
Role overview AECOM seeks a Program Manager for its Boston office. This position leads multiple projects, emphasizing both successful outcomes and strong client partnerships. The Program Manager coordinates teams and ensures that deliverables align with client expectations. Key responsibilities Guide project teams through all stages of project delivery Create and monitor project plans to achieve goals and meet deadlines Communicate regularly with clients and stakeholders to keep everyone informed Promote client satisfaction by tracking progress and resolving issues promptly About the Boston office The Boston team at AECOM works on engineering and infrastructure projects that serve both communities and industries. Projects span a range of initiatives with local and broader impact.
Join Klaviyo as an Engineering Enablement Program Manager to empower our engineering teams and enhance their productivity. In this dynamic role, you will spearhead initiatives that streamline processes, promote best practices, and foster a culture of continuous improvement. You will work closely with cross-functional teams to identify challenges and implement solutions that drive efficiency and innovation.
Medraai seeks a Systems Test Engineer for a 5-month contract based at a customer location in Boston. This role centers on supporting advanced robotic systems used in biological research. The engineer will work independently on-site, running daily protocols, troubleshooting technical issues, and keeping close communication with the Medraai engineering team in San Francisco through Slack and observability tools. What you will do Keep robotic systems running reliably during daily operations and look for ways to improve performance. Troubleshoot on-site issues using standard operating procedures, playbooks, and hands-on knowledge of the systems. Document and report complex incidents, including relevant data, to the engineering team. Monitor system health using dashboards and alerts to prevent failures in production. Carry out regular calibration and preventive maintenance on robots, peripherals, and consumables. About Medraai's technology Medraai builds Physical AI Scientists, robotic systems that work alongside biopharma partners to accelerate scientific discovery. Their robots handle scientific instruments with dexterity similar to humans, while their AI can analyze results and determine next steps on its own. The company launched its first production system over a year ago and recently closed a $52 million Series A. Medraai is now opening one of the country’s largest autonomous labs. Team and culture Engineers come from organizations such as Tesla, Amazon, SpaceX, and Neuralink. Collaboration and rapid iteration are part of daily work and team activities, including outings like skiing or go-karting. The team values curiosity, engineering, and robotics. Members share interests from race cars to cooking, and learning together is common. Open and direct communication is encouraged. Design trade-offs are discussed thoroughly, and disagreements are handled with empathy and efficiency.
As an integral part of our team at Barnes, the Office Administrator will manage daily administrative operations while also contributing to long-term strategic initiatives related to Human Resources, Operations, Facilities, Administration Support, and Financial Planning. This role requires adherence to established policies and procedures, ensuring a smooth and efficient office environment.Key Responsibilities:Administer human resources functions, ensuring fair application of policies and compliance with employment laws.Oversee performance management for direct reports, providing supervision, training, coaching, and conducting evaluations.Collaborate with Human Resources on employment decisions, including promotions and terminations.Engage with the recruiting team to manage the full-cycle recruitment process for direct reports.Coordinate onboarding for new hires and facilitate scheduling for attorney interviews.Manage the business professionals' compensation budget and ensure operational efficiency within the team.Execute all necessary financial management functions, including processing invoices and maintaining operating expense budgets.
About Merlin Labs: Merlin Labs is an innovative aerospace startup, backed by prominent venture capital, dedicated to developing autonomous pilot systems that facilitate both crewed and uncrewed flight operations. With support from leading global investors, we are collaborating with our clients to harness autonomy today and tackle some of the most significant challenges in aviation.About You: As a Senior Program Manager at Merlin Labs, you will be a strategic leader with extensive program management expertise, focused on driving mission-critical outcomes. You will oversee a suite of impactful customer-oriented defense and autonomy programs, guiding them from initial capture through to successful deployment and operational integration.Your unique combination of technical proficiency, stakeholder engagement, and operational discipline makes you an invaluable asset in fast-paced environments characterized by ambiguity and the need for swift execution. You excel at deeply understanding military operator requirements, converting them into actionable technical and programmatic priorities, and leading teams to achieve meaningful results. If you are passionate about influencing the future of aviation while fostering lasting customer partnerships, we would be thrilled to connect with you.
