Software Engineer - AI trainer

Job Title: Software Engineer - AI trainer

Job Type: Part-time, Paid per task

Location: Remote

Job Summary:

Join our customer's team as a Software Engineer - AI trainer, where your deep computer science expertise and passion for effective communication will directly enhance the capabilities of cutting-edge AI systems. In this highly collaborative, remote position, you will design, evaluate, and iterate on complex technical questions and robust assessment criteria to rigorously test and refine advanced AI models—no graduate degree required, just strong fundamentals and a love for teaching computers to think.

Key Responsibilities:

• Develop and refine challenging, domain-specific computer science questions that push the boundaries of current AI models.

• Create comprehensive rubrics to systematically assess AI-generated solutions for accuracy, efficiency, and sophistication.

• Collaborate closely with both technical and non-technical stakeholders to ensure all assessments are aligned with real-world software engineering practices.

• Analyze AI model responses, identifying reasoning gaps and opportunities for improvement in problem-solving.

• Leverage your coding skills to simulate real-world programming challenges and assess AI performance.

• Iterate on assessments and rubrics based on AI results, maintaining a high bar for evaluation and driving continuous model advancement.

• Document your methodologies, rationales, and findings with exceptional precision in both written and verbal formats.

Required Skills and Qualifications:

• Bachelor's degree or equivalent experience in computer science, software engineering, or a related field.

• Strong foundation in software engineering principles and a track record of solving complex technical problems.

• Exceptional written and verbal communication skills, with a keen attention to clarity and detail.

• Experience developing or evaluating technical assessments, rubrics, or structured coding challenges.

• Analytical mindset with a passion for critical thinking and improving established standards.

• Ability to collaborate effectively within a fully remote, cross-functional team.

• Commitment to staying current with emerging trends in computer science and AI.

Preferred Qualifications:

• Experience training or evaluating AI models, particularly large language models or code generation tools.

• Background in creating educational content or assessments for technical training programs.

• Demonstrated commitment to knowledge sharing and continuous personal and technical development.