About the job
Join Us at Xenon7:
At Xenon7, we are at the forefront of technological innovation, partnering with top enterprises and groundbreaking startups to tackle the most pressing challenges in IT. Our focus spans an array of domains including Data, Web, Infrastructure, AI, and beyond. We pride ourselves on delivering transformative IT solutions that not only enhance business operations but also foster growth and innovation. Our community of elite tech professionals is dedicated to shaping the future of intelligent systems and solving real-world problems.
Position Summary:
We are in search of a talented and proactive Generative AI Tester with a minimum of 5 years of experience in software testing and quality assurance, including 2-3 years specifically focused on Generative AI systems. This role requires expertise in validating AI-driven functionalities, ensuring model reliability, and executing comprehensive testing processes across enterprise-level applications.
Key Responsibilities:
- Collaborate with product, data science, and engineering teams to define test strategies based on AI use cases.
- Design and implement test cases for LLM-based functionalities including summarization, classification, conversational interfaces, and content generation.
- Validate model outputs for factual accuracy, tone, relevance, and adherence to domain-specific standards.
- Create automated test scripts and frameworks for prompt-response validation and regression testing.
- Assess ML models utilizing metrics such as precision, recall, F1-score, and industry-specific benchmarks.
- Perform integration testing across cloud platforms (e.g., AWS, Azure, GCP) and data environments (e.g., Snowflake, Databricks).
- Document test findings, anomalies, and recommendations for enhancements in structured formats.
- Ensure compliance with ethical AI practices and data governance policies.

