Doctor (MD) - AI trainer

Job Title: Doctor (MD) - AI trainer

Job Type: Part-time, contract

Location: Remote

Job Summary:

Join our customer's team as a Doctor (MD)- AI trainer and help shape the next frontier of artificial intelligence. In this role, you will leverage your advanced medical expertise to design highly challenging, domain-specific evaluation content for cutting-edge AI models. Collaborate remotely with expert peers to ensure the robustness and reliability of AI advancements in medicine.

Key Responsibilities:

• Develop complex, medically rigorous questions that challenge the reasoning and knowledge boundaries of advanced AI models.

• Design and implement comprehensive rubrics for evaluating AI model responses to the crafted questions.

• Ensure all created questions and rubrics are aligned with current medical standards and best practices.

• Analyze AI model outputs and rigorously assess their strengths and weaknesses based on your evaluation frameworks.

• Communicate findings and recommendations clearly in both written and verbal formats to technical and non-technical stakeholders.

• Collaborate with interdisciplinary teams to refine assessment strategies and contribute to continual improvement of model evaluation processes.

• Maintain meticulous documentation of evaluation materials and outcomes for ongoing research and development.

Required Skills and Qualifications:

• Medical doctorate (MD, PhD, or equivalent) with deep domain knowledge and critical thinking abilities.

• Demonstrated experience in medical education, assessment, or research.

• Exceptional written and verbal communication skills with a keen attention to detail.

• Proven ability to formulate advanced, nuanced medical questions and assessment criteria.

• Experience analyzing complex information and synthesizing clear, actionable insights.

• Self-motivated and comfortable working independently in a remote, distributed team environment.

• Strong commitment to ethical standards and continuous learning.

Preferred Qualifications:

• Prior experience in AI training, machine learning, or data annotation projects.

• Published research or contributions to medical board exam content.

• Familiarity with evaluation methodologies for large language models.