Clinical Evaluator, AI Products (Contract)

About The Role

Headway is building AI powered tools for both patients and providers, and we are dedicated to ensuring that clinical experts are included throughout the process. As a Clinical Evaluator, you'll work with our Clinical and Product teams to refine evaluation rubrics that set the standards for what safe, clinically sound, high quality output looks like. You'll test our AI products against those standards to help decide when one is ready to launch. While the ultimate goal is a set of standards, building those standards is challenging – you'll frequently be asked to apply your clinical judgment flexibly and work through hard calls with your peer evaluators.

You will be great for this role if:

• You are a current licensed therapist or professional counselor with an independent, unrestricted license and 3+ years of direct therapy experience.

• You have a strong grasp of risk assessment, safety planning, documentation standards, and you notice quickly when an output could put a patient at risk.

• You are comfortable working alongside AI-assisted review tools: critically evaluating a model's output and giving structured feedback that improves both the rubric and the model over time.

• You can explain your clinical reasoning clearly in writing. You hold your view with conviction and change it quickly when a peer or the data makes a better case.

• You like working through ambiguous edge cases with peers until the group reaches a consistent, well-reasoned call.

• You are comfortable adapting to various healthcare technology platforms, and to workflows that continue to evolve as our programs scale.

• Experience with AI chart reviews, quality audits, or clinical documentation standards is a plus.

Role responsibilities:

• Review output from AI tools across Headway's patient and provider products for clinical accuracy, safety, and appropriateness.

• Apply evaluation rubrics and help improve them. Use your clinical judgment where a rubric falls short, and document your reasoning.

• Take part in calibration sessions and inter-rater reliability rounds, working through ambiguous cases with peers so our standards stay consistent and defensible.

• Work with the Clinical Product team to turn your clinical feedback into specific rubric or output changes.

• Take on other evaluation work as our AI programs grow, such as labeling datasets and reviewing new product use cases before launch.

• Complete all review and feedback work within Headway's designated systems, adhering to HIPAA and Headway's privacy and confidentiality requirements. Patient information is never stored or maintained outside those systems.

Compensation

We have two openings for contracted Clinical Evaluators. Each role requires a minimum commitment of 10 hours per week. Evaluators are paid an hourly rate of $125 and must set up or already have an LLC or S-Corp.