Job Description

Apply medical knowledge and clinical reasoning to help evaluate and improve advanced AI systems. This remote contract role focuses on creating challenging, evidence-based medical questions and answers, verifying clinical accuracy, and assessing how well AI models handle nuanced medical reasoning. Prior AI experience is not required. Key Responsibilities

• Create original, high-difficulty medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, clinical guidelines, and medical judgment.
• Research and verify answers using primary literature, clinical guidelines, and other authoritative medical references.
• Document supporting rationale and citations thoroughly.
• Develop questions that require synthesis and genuine clinical reasoning rather than simple factual recall.
• Evaluate AI-generated responses to medical questions for accuracy, depth, and reliability.
• Refine questions that are too straightforward and increase their complexity while maintaining clinical accuracy.
• Write clear, precise, defensible questions and answers that avoid ambiguity.
• Incorporate reviewer feedback and adapt work to evolving project guidelines and quality standards.

• Current medical training or clinical practice as a medical student, resident, or physician, or equivalent biomedical expertise.
• Strong research and source-triangulation skills.
• Demonstrated ability to locate, interpret, and synthesize information from primary medical literature and clinical guidelines.
• Strong analytical thinking and clinical reasoning skills.
• Exceptional attention to detail and written precision.
• Proficiency in written English. Native-level fluency is not required.
• Ability to create engaging, well-structured, clinically nuanced medical questions.
• Self-direction, reliability, and the ability to manage independent remote work.
• Experience with medical question writing, peer review, or evaluation projects is advantageous.
• Familiarity with AI, machine learning systems, or model evaluation is a plus but is not required.

• Remote independent contractor engagement.
• Work is completed on a task basis rather than through a fixed hourly schedule.
• Minimum submission requirements apply, including a required minimum number of tasks each week.
• Candidates should be prepared to begin promptly. Selected contributors are expected to start their first tasks within 24 to 48 hours after completing onboarding.

• Advertised compensation range: $40 to $90 per hour.
• Actual compensation is output-based, with payment made for each task that meets project specifications.
• The amount of time required per task may vary based on experience and individual workflow.

Roles are generally filled quickly, with qualified experts expected to be available to begin soon after selection. Participation is subject to selection and completion of the required onboarding process.

Submit an application using the available application method. Candidates who are selected complete the required onboarding steps before beginning project tasks, with the first assignments expected to start within 24 to 48 hours after onboarding is finished.

Job Tags

Similar Jobs