Senior AI QA Automation Engineer

About CodeNinja CodeNinja stands at the forefront of global AI and engineering services, empowering enterprises to build, scale, and operate intelligent systems. With a diverse team of over 350 engineers across four continents and a track record of more than 400 successful deployments, we help organizations leverage artificial intelligence through our Global Capability Centers, Work AI, Physical AI, and AI Labs. Proud to be recognized as one of Pakistan’s fastest-growing AI firms and a multi-award recipient on Clutch, CodeNinja is dedicated to enabling over 250 clients worldwide to innovate, automate, and thrive in the intelligence economy.Role Overview We are seeking a highly skilled AI Software Development Engineer in Test II (AI SDET II) to join our dynamic team. As a senior quality engineer, you will be responsible for developing and overseeing the test strategy and automation processes for our AI-enabled products. Your expertise will contribute to designing and maintaining automated tests and AI evaluation suites, integrating quality metrics into our CI/CD pipelines, and collaborating with Scrum teams to ensure the delivery of robust AI capabilities without defects.Key Responsibilities Lead the development and execution of a comprehensive test strategy for assigned AI features, ensuring alignment with Definition of Done and release criteria across unit, API, UI, and end-to-end testing layers. Design, create, and maintain automated AI evaluation suites, which include developing golden datasets, scoring mechanisms, and regression baselines to cover critical user journeys and failure modes. Validate changes in prompt, retrieval, and orchestration through systematic test harnesses and adherence to established acceptance thresholds. Enhance and extend automation frameworks and reusable utilities, focusing on improving test stability, execution speed, and signal-to-noise ratios. Integrate automated tests and AI evaluations into our CI/CD pipeline, effectively triaging pipeline failures and minimizing flaky tests. Collaborate with engineering teams to enhance testability through improved contracts, logging practices, and observability, promoting shift-left quality initiatives. Conduct thorough analysis of defects and AI output issues, performing root cause analysis and implementing regression coverage to mitigate future occurrences. Mentor junior SDETs in automation, test design, and AI validation methodologies, while effectively communicating quality risks to stakeholders. Ensure production readiness by validating guardrails, monitoring performance signals, and confirming compliance with performance requirements for AI features.

About AdalFiAt AdalFi, we are pioneering the fastest-growing AI-driven digital lending infrastructure in Pakistan. We empower banks to roll out innovative credit products in a matter of days, transforming the lending landscape. Leveraging cutting-edge AI and data analytics, our platform facilitates smarter and quicker lending decisions, revolutionizing credit access for millions.About the RoleAs a Senior QA Engineer at AdalFi, your role will be crucial in safeguarding the quality, performance, and reliability of our software offerings. You will work closely with cross-functional teams, particularly developers and product managers, to conduct comprehensive testing of both mobile and web applications. The ideal candidate will possess robust analytical abilities, a passion for software quality, and experience in drafting test cases, reporting bugs, and thriving in Agile/Scrum environments.Responsibilities• Conduct testing on mobile and web applications to ensure adherence to the highest quality standards.• Identify, document, and communicate bugs or discrepancies, collaborating with developers for swift resolution.• Develop and maintain comprehensive test cases and scripts grounded in business requirements and user stories.• Execute various testing types, including UI, regression, cross-browser, integration, and User Acceptance Testing (UAT).• Enhance testing infrastructure and internal QA processes for effective and consistent test execution.• Generate clear, structured test reports summarizing testing outcomes, performance issues, and defect metrics.• Engage actively in all stages of the software development lifecycle, providing insights during design, development, and deployment phases.• Collaborate with cross-functional teams [Development, Business Analysis, and User Experience] to ensure software meets user expectations and is delivered punctually.

About CodeNinja CodeNinja is a leading global AI and engineering services firm dedicated to empowering enterprises in the development, scaling, and management of intelligent systems. With a talented workforce of over 350 engineers spanning four continents and more than 400 successful deployments, we facilitate organizations in leveraging artificial intelligence through our Global Capability Centers, Work AI, Physical AI, and AI Labs. As one of Pakistan's fastest-growing AI companies and a multi-award recipient on Clutch, CodeNinja is proud to help over 250 clients worldwide innovate, automate, and thrive in the intelligence economy.Role Overview We are seeking a proactive and skilled Senior AI Engineer to design, develop, and manage AI-driven software systems that provide immediate and tangible value. This position lies at the nexus of software engineering, product engineering, and applied artificial intelligence, emphasizing practical implementation over theoretical research. As a key player in CodeNinja's AI-first operational strategy, you will utilize Large Language Models (LLMs), AI agents, and automation to significantly enhance software development, deployment, and operations.Key Responsibilities Design, develop, and maintain production-grade software systems with AI as a fundamental component. Implement agentic solutions and automation frameworks to address concrete business and product needs. Convert product specifications into scalable, secure, and reliable AI-enabled solutions. Focus on practical applications of AI, including prompting, orchestration, integration, evaluation, and deployment. Integrate AI in daily engineering tasks such as AI-assisted code generation, debugging, refactoring, and testing. Continuously enhance AI integration throughout the software development lifecycle to improve efficiency, quality, and output. Collaborate effectively with Product, Scrum, and Engineering teams to deliver AI-enhanced features from conception to completion. Contribute to shared platforms, services, and internal tools that facilitate large-scale AI-native development. Ensure that AI-enabled systems comply with standards for security, performance, and reliability. Develop monitoring, safeguards, and evaluation mechanisms for AI behavior in production environments. Take full responsibility for solutions from initial design through deployment and ongoing maintenance.

Position Overview:We are seeking a talented and experienced Senior DevOps Engineer with a strong focus on Puppet Automation to join our dynamic team at creativechaos. In this role, you will be instrumental in ensuring compliance with service level agreements (SLAs) as per contract, leading urgent issues and projects, and effectively communicating status updates to stakeholders.Key Responsibilities:Oversee adherence to SLAs outlined in contracts.Lead urgent projects and issues, ensuring appropriate resources are allocated and statuses communicated.Design, build, and manage cloud engineering initiatives, focusing on automation using Puppet technologies.Troubleshoot and resolve challenges within Puppet Enterprise architectures and related tech stacks, including Linux, networking, and load balancing.Collaborate with development engineering teams to create and implement CI/CD infrastructure.Develop and support environments for quality assurance and development.Deploy and maintain applications in cloud environments, ensuring security, reliability, and scalability.Provide direct server support during deployments and day-to-day operations.Work closely with developers to ensure new environments meet requirements and adhere to best practices.Automate the deployment of Linux applications, system configurations, and security settings.Assist in evaluating candidates for open positions.

Role overview creativechaos seeks a Manual QA Engineer based in Lahore, Punjab, Pakistan. This position centers on hands-on software testing and active participation within Agile and Scrum teams. The Manual QA Engineer will help maintain and improve software quality at every stage of the development lifecycle. What you will do Plan, organize, and perform daily testing activities in collaboration with developers, architects, and technical release managers. Participate in scrum meetings and product planning sessions, managing all phases of testing including strategy, requirements analysis, planning, execution, and reporting. Document issues, bugs, and changes clearly, ensuring each is validated and resolved before delivery to clients. Work closely with QA colleagues to complete daily assignments on schedule and uphold quality standards. Develop and refine processes that support effective quality assurance practices. Review workflows and software regularly to keep testing methods current and efficient. Help design and maintain ongoing training programs for the QA team. Provide orientation and training for new QA team members. Promote open communication with internal teams to support project objectives. Assist with project kickoffs and the collection of requirements or specifications as needed. Analyze complex business and functional requirements, and design technical test cases that evaluate the technology stack and meet project needs. Collaborate with project and engineering teams to establish and enforce quality checkpoints throughout the development process.

Join Devsinc as a Senior AI Engineer and leverage your 4–6 years of experience in crafting, building, and launching production-quality AI systems. We seek a candidate who merges robust machine learning principles with practical knowledge of Large Language Models (LLMs), RAG architectures, and scalable ML infrastructure. In this role, you will take charge of the complete AI lifecycle from research and experimentation through to deployment, optimization, and monitoring. You will play a pivotal role in architectural decisions, mentor fellow engineers, and deliver applied intelligence solutions that yield tangible business outcomes.Key ResponsibilitiesDesign, develop, and implement AI/ML models and LLM-based solutions to tackle real-world business challenges.Create scalable training, fine-tuning, evaluation, and inference pipelines for production-ready AI systems.Design and deploy RAG pipelines, embedding systems, and retrieval-based architectures.Enhance model performance through experimentation, structured evaluations, hyperparameter tuning, and advanced optimization methods (quantization, batching).Develop APIs, microservices, and real-time inference services to integrate AI functionalities into production settings.Oversee and implement MLOps workflows, including experiment tracking, model versioning, CI/CD integration, monitoring, and lifecycle management.Engage in system architecture discussions to ensure scalability, reliability, security, and performance.Deploy AI systems on cloud platforms (AWS, Azure, GCP) with considerations for cost and performance optimization.Investigate emerging AI technologies, including LLMs, multimodal AI, and vector search, assessing their practical use cases.Guide junior engineers and advocate for best practices in AI engineering and MLOps.Document technical designs, workflows, experiments, and project outcomes for internal knowledge sharing.QualificationsBachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, or a related discipline.4–6 years of professional experience in AI/ML engineering roles.Strong proficiency in Python with hands-on experience in PyTorch and/or TensorFlow.

Devsinc is on the lookout for a dedicated and skilled Senior Software Engineer specializing in AI/ML to enhance our dynamic team. In this pivotal role, you will design, develop, and refine cutting-edge AI and machine learning solutions that address complex challenges and elevate our product portfolio. Your deep expertise will play a vital role in steering our AI projects and advancing our technological frontiers.Responsibilities:Architect, develop, and rigorously test advanced machine learning algorithms and models to achieve business goals.Engage in collaborative efforts with product managers and other stakeholders to analyze requirements and translate them into effective AI solutions.Perform experiments to test and validate model efficacy, iterating improvements based on comprehensive data analysis.Stay abreast of emerging trends, methodologies, and best practices within the AI and machine learning landscape.Guide and mentor junior engineers, promoting a culture of continuous learning and knowledge sharing.Document and effectively communicate project outcomes and insights to internal teams and stakeholders.

Join Devsinc as a Senior AI/Machine Learning Engineer, where you will leverage your expertise in Python and machine learning to create innovative solutions. We are looking for a proactive individual with extensive experience in cloud platforms (AWS, Azure, GCP, Databricks) who can design and develop scalable AI applications. You will play a pivotal role in shaping AI-driven features and user interactions within our client applications. Key Responsibilities: Develop and sustain robust AI and machine learning applications using Python and popular frameworks like TensorFlow and PyTorch. Design and deploy machine learning models and algorithms tailored for diverse AI applications, enhancing user engagement and functionality. Integrate external AI/ML APIs and services into existing web platforms. Foster a data-driven culture by consistently delivering impactful AI solutions. Possess a deep understanding of Large Language Models (LLMs) for various NLP applications, including writing assistance and summarization. Lead initiatives in NLP and computer vision model development, promoting a collaborative environment for continuous improvement.

Join our dynamic team at devsinc-17 as a Senior Software Engineer specializing in Artificial Intelligence and Machine Learning. In this pivotal role, you will be responsible for designing, developing, and scaling intelligent systems, including advanced AI agents that excel in reasoning, planning, and automation.Your expertise will drive the creation of production-grade AI models, the integration of Large Language Models (LLMs), and the design of agent architectures that seamlessly interact with APIs, databases, and workflows. This position is a perfect blend of applied ML knowledge, strong backend engineering skills, and a product-oriented approach to problem-solving.Key Responsibilities:- Engineer autonomous or semi-autonomous AI agents with capabilities to plan, reason, and communicate with tools, APIs, or external systems.- Implement agentic frameworks such as LangChain, LlamaIndex, CrewAI, or custom orchestration systems.- Utilize existing industry capabilities to enhance virtual assistant functionalities, including voice interactions.- Optimize reasoning and retrieval pipelines through embeddings, vector databases, and prompt engineering methodologies.- Develop, train, and fine-tune machine learning models utilizing frameworks like PyTorch, TensorFlow, or scikit-learn.- Engage in data preprocessing, feature engineering, and model evaluation for diverse tasks including NLP, computer vision, and predictive analytics.- Construct ML pipelines for training, deployment, and performance monitoring in production settings.- Collaborate with engineering teams to integrate AI components into backend systems and APIs effectively.- Ensure the scalability and maintainability of codebases through CI/CD, observability practices, and cloud-native design on platforms such as AWS, GCP, or Azure.- Contribute to the architectural design and review processes for AI-driven features and platforms.- Stay updated with the latest advancements in LLMs, agent frameworks, and model architectures.- Prototype and assess new methodologies for reasoning, tool usage, and adaptive behaviors in agents.- Share insights and mentor peers in best practices for ML and AI development.Qualifications:- Bachelor's Degree in Computer Science or a related field.- A minimum of 3 years of relevant experience in software engineering.- Exceptional programming skills in Python (mandatory) and proficiency in frameworks such as PyTorch, TensorFlow, or transformers-based models.- Demonstrated experience in building or integrating AI agents using frameworks like LangChain, LlamaIndex, CrewAI, or custom solutions.- Strong understanding of the machine learning model lifecycle including data processing, model training, evaluation, deployment, and monitoring.- Familiarity with cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).- Knowledge of API integrations, microservices, and asynchronous systems.- Solid grasp of vector databases such as Pinecone, Weaviate, FAISS, and Chroma, and their retrieval architectures.- Strong foundation in software engineering principles including testing, version control, and system design.- Experience in LLM fine-tuning, prompt optimization, or Retrieval-Augmented Generation (RAG) systems.

Core ResponsibilitiesAs a Senior Software Engineer specializing in AI/ML, you will:Identify and engage potential clients seeking advanced AI/ML solutions using Python.Craft and implement effective strategies to generate leads and broaden our client base.Oversee the complete sales cycle from prospecting to deal closure.Conduct client meetings and presentations, demonstrating our AI/ML capabilities through product demos.Lead contract negotiations ensuring mutually beneficial agreements.Establish and nurture long-term client relationships to facilitate repeat business.Collaborate with technical teams to design and propose tailored Python-based AI/ML solutions.Provide ongoing support to clients, ensuring their satisfaction and successful project implementation.Stay updated on industry trends and emerging AI/ML technologies to fine-tune sales strategies.

Job Duties and Responsibilities: Offer expert insights and strategic guidance on business and quality metrics. Design and continuously refine a robust test automation framework tailored to project requirements. Evaluate and improve test cases, scripts, plans, and procedures, both manual and automated. Ensure adherence to defined standards and procedures during both manual and automated test execution. Oversee and facilitate the business and QA components of software development activities, encompassing requirement analysis and application QA. Create automation scripts that address user story scenarios identified for sprints, employing various tools such as Selenium, Java, TestNG, Appium, Jenkins, Maven, etc., for regression and performance testing of application releases. Collaborate with cross-functional teams to uphold quality standards throughout the software development lifecycle. Estimate, prioritize, and coordinate testing activities effectively. Proactively pursue learning opportunities and adapt quickly to innovative ideas, concepts, and methodologies, sharing findings with the team. Assist in the recruitment of talented software testing professionals.

Lead the design, configuration, integration, and implementation of cutting-edge process control solutions across diverse industries.Create and refine P&IDs and loop descriptions for various plants, processes, and equipment.Draft comprehensive User Requirement Specifications tailored to client needs.Develop detailed software and hardware design specifications.Design, code, test, and document PLC, DCS, and HMI software to ensure optimal performance.Establish control system validation and testing protocols to guarantee reliability.Specify and procure process instrumentation and essential electrical components including PLCs, DCSs, and drives.Design and develop electrical and control panel schematics.Prepare detailed scope of supply documents for automation projects.Assist in estimating man-hours required for successful project completion.Oversee and manage assigned automation projects to ensure timely delivery.Monitor project progress and address any emerging issues.Perform on-site installation, testing, and commissioning of control systems.Provide training for operators and engineers on the use of control systems.

Join the Innovators at Devsinc! We are on the lookout for a skilled Senior Software Engineer specializing in Python to bolster our dynamic team. This pivotal role entails harnessing your Python programming skills to optimize sales processes and foster business growth. By collaborating closely with our sales team, you will develop customized technical solutions that cater to client needs, enhancing productivity and streamlining communication. If you possess a passion for technology and a flair for sales, we have the perfect opportunity for you!Key Responsibilities:Leverage Python scripting for automating sales processes, managing customer relationships, and improving productivity.Work alongside the sales team to pinpoint areas for improvement and craft tailored solutions utilizing Python.Engage with clients to comprehend their requirements and present customized offerings that incorporate innovative technical solutions.Analyze sales performance data to discern trends and facilitate data-driven decision-making.Draft and maintain documentation for processes, scripts, and tools to ensure clarity and replicability.Support the training and onboarding of new sales team members regarding automated processes and tools.

Join the innovative team at Devsinc as a Software Engineer II – AI & Data Engineering. We are seeking a talented individual with over 2.5 years of professional experience in developing and deploying robust AI/ML systems, applications powered by LLMs, and scalable data engineering solutions.This position demands a strong foundation in AI/ML Engineering, MLOps, Backend Engineering, and Data Engineering. You will take ownership of the project lifecycle, from the design of LLM applications, RAG pipelines, embeddings, and inference systems to the construction of ETL/ELT pipelines, cloud-native infrastructures, and architectures for real-time data processing.Key Responsibilities:Craft, develop, enhance, and deploy AI/ML models, including LLM-powered applications, RAG pipelines, embeddings, vector search architectures, and inference systems tailored for real-world applications.Develop and refine high-performance Python APIs, microservices, and backend services for AI workloads, collaborating with Engineering teams, Project Managers, and business stakeholders to deliver scalable, production-ready AI solutions.Establish and manage MLOps workflows and cloud-native infrastructures across AWS, Azure, and GCP, covering experiment tracking, model versioning, deployment automation, monitoring, and model optimization techniques like hyperparameter tuning and quantization.Design, develop, and sustain scalable ETL/ELT pipelines for both structured and unstructured datasets.Create and enhance data transformation, cleansing, validation, and quality frameworks, utilizing distributed and streaming technologies such as Kafka, Spark, Kinesis, and Pub/Sub for real-time data processing.Guarantee reliability, scalability, security, and cost-efficiency across AI and data infrastructures, while documenting architectural decisions, technical workflows, and engineering standards.

Code Ninja Pakistan offers an AI Engineer Internship in Lahore, Punjab. This position gives interns the chance to work directly on artificial intelligence projects and see how AI concepts translate into real-world solutions. What you will do Collaborate with experienced engineers on ongoing AI projects Use AI methodologies to address practical challenges Learn about current tools and techniques in the field of artificial intelligence Location The internship takes place onsite in Lahore, Punjab, Pakistan.

Join Devsinc as a Senior Software Engineer specializing in Artificial Intelligence. We are looking for an accomplished professional with a minimum of 3 years of hands-on experience in AI and Machine Learning. In this role, you will be responsible for designing, developing, and implementing advanced AI systems in production settings. The ideal candidate will possess a solid foundation in software engineering, extensive knowledge of machine learning techniques, and a successful track record of delivering scalable AI solutions. This position requires strong architectural insight, technical leadership, and the ability to drive cross-functional teams through complex AI projects from inception to launch.Key Responsibilities:Oversee the complete development cycle and deployment of AI projects, from ideation to production.Design, develop, and enhance AI/ML models, including deep learning, natural language processing, computer vision, and large language models.Create robust pipelines for training, fine-tuning, evaluation, deployment, and ongoing improvement.Develop production-grade inference services, APIs, and microservices, ensuring high performance, reliability, and cost-effectiveness.Implement and manage MLOps workflows using tools like SageMaker, MLflow, Vertex AI, Docker, and Kubernetes.Utilize advanced model optimization strategies such as quantization, distillation, batching, and GPU/TPU acceleration.Conduct experiments and explore emerging AI methodologies (LLMs, RAG, multimodal AI, vector search) to apply insights to practical scenarios.Collaborate effectively with Data Engineering, Product, DevOps, and Business teams to deliver AI-enhanced features.Mentor junior and mid-level engineers, fostering best practices in AI and software engineering.Engage in system architecture design, CI/CD implementation, monitoring, and lifecycle management of AI systems.Maintain high standards of code quality, documentation, security, and compliance throughout the AI development cycle.

Join Speechify as a Senior Software Engineer in our Core Experiences team, where you will play a pivotal role in designing and developing innovative software solutions that enhance user experiences. Collaborate with a talented team of engineers to deliver high-quality code and contribute to the full software development lifecycle.

Join Devsinc as a passionate Software Engineer – AI/ML and contribute to the creation of intelligent, data-driven solutions. We seek a candidate with a robust understanding of machine learning and artificial intelligence, along with hands-on experience in model development, deployment, and adherence to software engineering best practices. You will engage in the entire AI/ML lifecycle—from data preparation and model training to seamless integration and optimization within production environments. This role emphasizes collaboration with cross-functional teams and mentoring junior engineers.Key Responsibilities:Design, develop, and enhance machine learning models to meet business needs.Work with both structured and unstructured data for effective training and evaluation.Implement ML solutions primarily using Python.Deploy models into production and ensure their integration with backend systems.Continuously monitor model performance and conduct retraining as necessary.Collaborate with multidisciplinary teams to convert business challenges into ML solutions.Maintain clean, efficient, and well-documented code.Engage in code reviews and contribute to technical discussions.

Job Description: Design and implement a robust test automation framework, including harnesses and code libraries, facilitating team utilization and enhancement across multiple projects. Offer expert consultation on sophisticated testing strategies tailored for each project. Lead efforts on critical issues and projects, ensuring effective communication of statuses and appropriate resource allocation. Deliver technical expertise, comprehensive documentation, and training for testing and related business functions. Continuously update knowledge on process improvements, industry practices, and technological advancements to incorporate into in-house solutions for testing challenges. Identify and recommend tools and technologies compatible with the existing development framework and aligned with the team's skill set. Maintain a broad understanding of testing methodologies, practices, and techniques to shape and enhance the overall testing strategy employed by the team. Develop and validate automated scripts supporting the Continuous Integration/Continuous Delivery pipeline. Define and implement automation strategies while ensuring compliance with standards. Apply Testing Lifecycle Management principles effectively within project contexts. Mentor the entire quality assurance team to foster professional growth. Assist in evaluating candidates for open positions within the team.

About the Role Devsinc is looking for a DevOps Engineer to join the engineering team in Lahore, Punjab, Pakistan. This position is ideal for someone with 1–2 years of hands-on experience in DevOps practices. The role focuses on supporting deployment processes, system reliability, and close collaboration with both development and operations teams. What You Will Do Build and maintain CI/CD pipelines using tools like Jenkins, GitHub Actions, or GitLab CI/CD. Deploy and monitor applications on cloud platforms such as AWS, Azure, or GCP. Work with containerization tools, including Docker, and orchestration platforms like Kubernetes. Automate infrastructure provisioning with Terraform or CloudFormation. Monitor system performance and troubleshoot issues in development and production. Collaborate with development teams to improve deployment frequency and system reliability. Document infrastructure setups, processes, and workflows clearly. Follow security best practices during deployments and infrastructure management. Requirements 1–2 years of practical experience in DevOps or a related field. Familiarity with CI/CD tools, cloud platforms, containerization, and infrastructure automation.