Oncologic builds AI solutions for community oncology. Our cloud-native platform runs on Google Cloud Platform and uses frontier LLMs (Claude, GPT, Gemini) in a model-agnostic way to automate complex clinical workflows, from patient intake and EHR summarization to care coordination and exception detection. These products run in high-stakes clinical settings where reliability is not negotiable.
We are hiring our founding QA engineer. This is a hands-on role for someone who will personally build the test automation, define how we evaluate AI features, and set the quality bar that the QA function grows from. You will architect and write the frameworks yourself, not hand them off. As the team grows, you will shape the standards, tooling, and early hires that scale quality across the organization.
What you will own
- Test automation (hands-on). Architect and build maintainable automated suites in Playwright with JavaScript or TypeScript across the web, API, and AI layers of the platform. You own the code, not only the strategy.
- CI/CD quality gates. Wire automated suites into GCP-based CI/CD (Cloud Build, GitHub Actions, or equivalent) and enforce quality gates at every stage, driving functional, regression, integration, and performance coverage.
- AI and LLM quality. Define and build evaluation frameworks for RAG pipelines, agentic workflows (LangGraph, CrewAI), and LLM outputs, testing for accuracy, groundedness, hallucination risk, and clinical safety against oncology-specific cases. Build repeatable regression testing as models and pipelines evolve.
- Quality strategy and standards. Own the end-to-end test strategy and the KPIs that matter (defect escape rate, automation coverage, cycle time), and represent quality in architecture reviews and release decisions.
- Release quality and compliance. Own release go / no-go criteria and risk sign-off, and maintain QA documentation and test records appropriate for a HIPAA-regulated environment.
- Foundation and influence. Embed shift-left quality across product squads, from refinement and design through production. As QA grows, shape the standards, tooling, and mentoring for the team you help build.
Who you are
- Hands-on QA depth: 7+ years in software QA with deep, current test automation experience. You still write test code and want to keep doing it.
- Automation mastery: Expert with Playwright and/or Selenium WebDriver in JavaScript or TypeScript, able to architect frameworks and set the bar for test code quality.
- Comfort with AI/LLM quality: You are excited to define how we test non-deterministic LLM outputs, and you can reason about evaluating accuracy, groundedness, and hallucination risk even if you have not yet built such frameworks in production.
- Strategy ownership: A track record owning end-to-end test strategy across web, API, and integration layers, with automated testing wired into CI/CD quality gates.
- Foundational mindset: Comfortable being the first and only QA for a stretch, building the function from scratch and setting standards others will follow.
- API testing and communication: Strong REST API testing (Postman or equivalent), and the ability to translate quality metrics into a clear, actionable narrative for engineering and business stakeholders.
Nice to have
- Hands-on experience building eval frameworks for RAG, agentic workflows, or LLM-as-judge in production.
- Healthcare or regulated software experience (HIPAA, EHR integrations, FHIR / HL7).
- Hands-on GCP (Vertex AI, Cloud Run, GKE, Cloud Build).
- Test management platforms (TestRail, Zephyr, or Xray) and ISTQB Advanced or equivalent certification.
- Genuine interest in oncology and the operational complexity of clinical environments.
Details: Pay range $85,000 to $100,000 per year. Travel up to 25%. Benefits include 401(k), medical, dental, and vision, flexible schedule, and paid time off.
Pay: $85,000.00 - $100,000.00 per year
Benefits:
- 401(k)
- Dental insurance
- Flexible schedule
- Health insurance
- Life insurance
- Paid time off
- Vision insurance
Application Question(s):
- How many years of hands-on QA/test automation experience do you have, and have you personally architected and built test automation frameworks using Playwright or Selenium WebDriver in JavaScript or TypeScript? Please describe the scope of a framework you built.
- Have you worked as the first or sole QA engineer at a company, building the testing function and standards from scratch? If yes, briefly describe what you built.
- This role involves testing non-deterministic LLM/AI outputs (RAG pipelines, agentic workflows) for accuracy, groundedness, and hallucination risk. Do you have direct experience with this, or a strong conceptual understanding of how you'd approach it? Please explain
- Describe your experience integrating automated test suites into CI/CD pipelines (e.g., GitHub Actions, Cloud Build) and your experience with REST API testing tools like Postman.
Education:
Location:
- Orlando, FL 32819 (Preferred)
Ability to Commute:
- Orlando, FL 32819 (Required)
Ability to Relocate:
- Orlando, FL 32819: Relocate before starting work (Preferred)
Willingness to travel:
Work Location: In person