Quality Assurance Specialist - INSPYR Solutions
Tallahassee, FL 32399
About the Job
Title: Quality Assurance Specialist
Location: Remote
Duration: 22 Month Contract
Compensation: $80-$88/hr
Work Requirements: US Citizen, GC Holders or Authorized to Work in the US
We are seeking an experienced LLM Quality Assurance Test Engineer to evaluate, validate, and enhance our client’s generative AI platforms.
These role is critical for ensuring our client’s generative AI platforms provide accurate and helpful experiences.
Responsibilities:
Skillset / Experience:
Our benefits package includes:
About INSPYR Solutions:
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.
Location: Remote
Duration: 22 Month Contract
Compensation: $80-$88/hr
Work Requirements: US Citizen, GC Holders or Authorized to Work in the US
We are seeking an experienced LLM Quality Assurance Test Engineer to evaluate, validate, and enhance our client’s generative AI platforms.
These role is critical for ensuring our client’s generative AI platforms provide accurate and helpful experiences.
Responsibilities:
- Design and execute comprehensive test strategies for Large Language Models
- Develop sophisticated prompting techniques to evaluate LLM responses about our client’s offerings
- Create test cases that validate accurate knowledge of our client’s operations
- Identify potential vulnerabilities and edge cases in guest-facing LLM interactions
- Document and track model behaviors, issues, and improvements
- Collaborate with AI/ML teams to improve model performance and safety
Skillset / Experience:
- BA or equiv
- 3+ years of experience in Quality Assurance, with at least 1 year focused on AI/ML systems
- Demonstrated expertise in LLM evaluation methodologies and prompt engineering
- Strong understanding of LLM limitations, biases, and potential failure modes
- Excellent analytical and problem-solving skills
- Strong documentation and communication abilities.
- Experience with LLM testing frameworks and evaluation metrics
- Knowledge of prompt engineering best practices
- Understanding of AI safety and ethical considerations
- Familiarity with version control systems and bug tracking tools
- Basic programming skills for test automation (Python preferred)
- Creative problem-solving for edge case discovery
- Attention to detail in identifying subtle model behaviors
- Strong analytical thinking for systematic testing approaches
- Ability to think like both a guest and an adversary
- Excellence in cross-functional collaboration
Our benefits package includes:
- Comprehensive medical benefits
- Competitive pay,
- 401(k) Retirement plan
- ...and much more!
About INSPYR Solutions:
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.
Source : INSPYR Solutions