AI Tester at Dallas, Texas, USA |
Email: manish@scalable-systems.com |
https://jobs.nvoids.com/job_details.jsp?id=2272131&uid= From: Manish Kumar, Scalable manish@scalable-systems.com Reply to: manish@scalable-systems.com Job Title: AI Tester (Automation- Selenium) Location: Dallas, TX, Tampa, FL, Jersey City, NJ (Onsite) Key Responsibilities: System Integration Testing: Lead and execute system integration testing of newly developed or enhanced applications, ensuring that all components work together as expected. Testing Process Ownership: Work with project teams in the early stages to establish plans, standards, and procedures for testing that add value to the effort and meet project constraints. Project Monitoring: Track progress and milestones, report work status, and monitor dependencies and project timelines. Ensure all activities are accurately recorded and reported. Testing Methodology Education: Educate business and development teams on testing models, methodologies, and AGILE processes to ensure smooth end-to-end testing and quality assurance. Leadership: Demonstrate leadership by managing stakeholders including product teams, development teams, and other departments. Quality and Issue Management: Proactively identify process improvement opportunities, manage project and quality management, and resolve issues as they arise. Automation Testing: Write, execute, and maintain automated tests using Selenium and other industry-standard tools for functional and regression testing. AI-Specific Testing: Hands-on experience in testing LLMs and RAG architectures using vector databases or embeddings for accuracy in retrieval-based models. Implement automated testing frameworks for gen AI applications like Deep eval, RAGAs, etc., to evaluate and test LLMs. Develop custom validation scripts to assess the accuracy, relevancy, faithfulness, and performance benchmarks of Gen AI model outputs. Test and optimize prompt engineering techniques to improve AI model responses. Database Integrity Testing: Familiarity with Snowflake and writing SQL queries to validate data integrity and ensure accurate application responses. Qualifications: 3+ years of experience in functional testing and automation using tools like Selenium. Strong understanding of AI testing, especially in Gen AI applications, including LLMs and RAG architectures. Hands-on experience with Python and related AI testing libraries (e.g., LangChain, Pytest, Pytorch). Experience in testing AI-based applications, including the ability to develop custom validation scripts for Gen AI model outputs. Familiarity with SQL and executing queries in Snowflake to validate database integrity. Knowledge of AGILE methodology and experience working with Jira and ALM. Strong problem-solving and analytical skills. Excellent communication and collaboration skills for working with business and development teams. Competencies: AI & Gen AI - Products & Tools Selenium Automation Testing AI Testing (LLMs, RAG) Python Development SQL/Database Integrity Validation AGILE Methodology Project & Quality Management Preferred Skills: Familiarity with Snowflake and querying for database testing. Experience with large-scale AI deployments and testing in production environments. PMP or ITIL certification would be a plus. ------------ Manish Kumar Scalable Systems Technical Recruiter Mailto: manish@scalable-systems.com Keywords: artificial intelligence Florida New Jersey Texas AI Tester manish@scalable-systems.com https://jobs.nvoids.com/job_details.jsp?id=2272131&uid= |
manish@scalable-systems.com View All |
07:29 PM 20-Mar-25 |