Sr. QA Specialist (Conversational AI Testing)

Job-ID28991336Reference26-21577 Remote 50% Remote Remote with occassional onsite visit. Role Will require occasional onsite meetings during the duration of the contract. Final interview in person Possible roll over to FTEPosition Overview We are seeking an experienced Senior QA Engineer to lead quality assurance efforts for our conversational AI applications. This role requires deep expertise in testing AI-driven systems, prompt engineering validation, and test automation. You will be responsible for designing comprehensive test strategies, identifying edge cases in AI behavior, and ensuring our conversational AI products meet the highest standards of reliability, accuracy, and security. Key ResponsibilitiesAI Application Testing: Design and execute test plans specifically for conversational AI systems, including chatbots, virtual assistants, and language model-based applications Prompt Engineering Validation: Collaborate with AI/ML teams to test and validate prompt effectiveness, consistency, and safety across various user scenarios Test Automation Development: Build and maintain automated test suites for conversational AI workflows, including API testing, response validation, and regression testing Quality Strategy: Develop QA strategies that address unique challenges of AI testing, including non-deterministic outputs, hallucination detection, and bias identification Security & Compliance: Ensure testing aligns with organizational security standards, including HIPAA compliance (Standard 4500), information protection requirements (Standard 5110), and access control protocols Documentation & Reporting: Create detailed test cases, defect reports, and quality metrics; communicate findings to stakeholders Cross-functional Collaboration: Work with product, engineering, and AI/ML teams to understand requirements and validate solutions Required Qualifications 5+ years of QA experience, with at least 2+ years testing AI/ML-based applications or conversational systems Prompt Engineering Expertise: Demonstrated experience designing, testing, and validating prompts for language models; understanding of prompt injection, jailbreaking, and safety considerations Test Automation Proficiency: Strong hands-on experience with test automation frameworks and tools (e.g., Selenium, Cypress, Postman, REST Assured, or equivalent); ability to write clean, maintainable automation code

Security and compliance testing Required Experience:5-8 years of Professional experience in an IT related field preferably in a development or testing environment REQUIRED EDUCATION:Bachelor's Degree in an IT related field or relevant work experience EEO:"Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans."