A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI……
UiPath Automation Developer Associate or Professional certification. Tuition reimbursement, certification programs, and professional development.…
Proficiency in AI-driven QA tools for test case generation and analysis is required to support quality assurance processes. Develop automated test cases using.…
Please understand that any job offer that requires approval of an export license will be conditional on AeroVironment’s determination that it will be able to……
Bachelor's degree in Computer Science or a related field or 2+ years of equivalent practical experience. You will collaborate closely with senior engineers,……
*Collaborate closely with multidisciplinary engineering teams (fluidics, embedded,mechanical, electrical).*. *Strong technical documentation and communication……
Bachelor of Science degree from an accredited course of study in engineering, chemistry, physics, mathematics, data science, or computer science and 5+ years of……
Brooksource is looking for someone who can provide technical and operational support for our client’s internal password management tool and power systems……
You will own escalated customer issues, investigate complex application behavior, identify root causes, communicate clearly with customers, and partner with……
*Understanding of FDCPA, state-level compliance requirements, or regulated collections environments*. We are seeking an experienced Director of Technology……
Collaborate with UI/UX designers, QA teams, and mission stakeholders to define, develop, and implement financial tool capabilities. NET Core, Java, or Python.…
Capital Management / Stress Testing: Capital planning and enterprise stress testing execution (e.g., scenario design support, model methodology governance,……
Act as a hands-on technical voice into the Data Studio platform's evolution - translating real-world delivery learnings into concrete product, data model, and……
Capital Management / Stress Testing: Capital planning and enterprise stress testing execution (e.g., scenario design support, model methodology governance,……
As Data Manager, Retail & Commerce Media, you will own the analysis, reporting, and audience work that powers advertiser relationships across the the buy and……
Bachelor’s degree in computer science, engineering or related field. Hands-on experience with AWS services, automation frameworks, and DevOps best practices,……
Build solution designs and technical designs for data pipelines based on business and technical requirements. Streaming concepts and implementation patterns.…
Bachelor's degree in Computer Science / Information Technology / Computer Engineering or related field. UnitedHealth Group is an Equal Employment Opportunity……
Build solution designs and technical designs for data pipelines based on business and technical requirements. Operational efficiency and reduced run-cost.…
Bachelor's degree in Computer Science or a related field or 2+ years of equivalent practical experience. You will collaborate closely with senior engineers,……
AI QA Trainer - LLM Evaluation - Freelance Project
Remote
$6.00 - $65.00 Per Hour (Employer provided)
Is your resume a good match?
Use AI to find out how well the skills on your resume fit this job description.
Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow's AI can democratize world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability.
We're looking for AI QA trainers who live and breathe model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You'll challenge advanced language models on tasks like hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation—documenting every failure mode so we can raise the bar.
On a typical day, you will converse with the model on real-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build clear rubrics and pass/fail criteria, capture reproducible error traces with root-cause hypotheses, and suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You'll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time.
A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting. Clear, metacognitive communication—"showing your work"—is essential.
Ready to turn your QA expertise into the quality backbone for tomorrow's AI? Apply today and start teaching the model that will teach the world.
We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you'll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
The minimum salary is $6.00 and the max salary is $65.00.
$6.00 – $65.00/hr (Employer provided)
$35.50
/hr Median
Remote
If an employer includes a salary or salary range on their job, we display it as "Employer Provided". If a job has no salary data, Glassdoor displays a "Glassdoor Estimate" if available. To learn more about "Glassdoor Estimates," see our FAQ page.
Working here doesn’t have to be a secret
Sign in to browse authentic reviews, anonymous ratings and salary data before you apply.