Python Specialist Evaluator
$20 - $55/hourpay
Contractor
remote
Required Skills
Python
LeetCode
About micro1
micro1 is a data engine that helps AI labs train foundational models and enterprises build AI agents. We provide frontier evaluations and reinforcement learning environments used to improve LLM capabilities, as well as contextual evaluations used to monitor and improve AI agents in enterprise settings. Our data engine includes an AI recruiter agent that sources and vets domain experts, a data platform that enables rapid production of high-quality training data, and a pipeline performance system that ensures both quality and velocity.
Our goal is to have 1 billion people doing meaningful work by contributing their expertise to the development of frontier AI models. We’ve raised $40M+ in funding, and our AI recruiter has powered more than 1 million AI-led interviews as our global network of experts expands to form the human intelligence layer for AGI.
Job Summary
Become a pivotal part of our micro1 team as a Python Specialist Evaluator, supporting a groundbreaking AI training initiative. This contract position gives you the opportunity to apply your elite Python skills in high-level technical interviews and code assessments, directly shaping the capabilities of next-generation AI coding models.
Key Responsibilities
- Conduct live, 1-hour technical interviews centered on advanced algorithmic challenges using Python.
- Critically evaluate and document participant performance, emphasizing logical reasoning, code structure, and optimization.
- Accurately classify sessions by proficiency tiers, with attention to data structures, recursion, and dynamic programming expertise.
- Produce comprehensive written trajectories detailing problem-solving strategies, successes, and error analysis.
- Collaborate with the AI training team, providing actionable feedback to refine model learning and evaluation processes.
- Uphold exemplary written and verbal communication standards, ensuring technical concepts are conveyed with clarity and precision.
- Follow structured evaluation protocols and meet established deadlines consistently.
Required Skills and Qualifications
- Demonstrated production-level mastery of Python and effective engineering best practices.
- Ability to independently solve and clearly articulate solutions to LeetCode Medium-level algorithm problems.
- Bachelor’s degree or higher in Computer Science or a related STEM discipline.
- At least 3 to 4 years of professional software engineering experience.
- Exceptional command of English, with a strong emphasis on both written and verbal communication.
- Proven capacity to explain complex technical trade-offs and provide critical analysis of programming approaches.
Preferred Qualifications
- Experience designing or conducting technical interviews or code assessments.
- Familiarity with AI training, model evaluation, or research environments.
- Active contributions to Python open-source projects or technical communities.