Mobile Agent QA Evaluator (Android)

$6 - $10/hourpay

Required Skills

About micro1
micro1 connects domain experts to the development of frontier AI models. Real-world expertise is turned into training data, evaluations, and feedback loops that improve how models perform. AI labs and enterprises use micro1 to train models and build reliable AI agents through advanced evaluations and reinforcement learning environments. Experts contribute directly to how AI systems learn, reason, and perform across domains like finance, healthcare, engineering, and more. Our platform identifies and vets top talent through an AI recruiter, enabling high-quality contributions at scale.
Our goal is to enable 1 billion people to do meaningful work by applying their expertise to AI. We’ve raised $40M+ in funding, and our AI recruiter has powered over 1 million AI-led interviews as our global network of experts grows into the human intelligence layer for AI.

Job Description

Job Title: Mobile Agent QA Evaluator (Android)


Job Type: Contract / Project-based


Location: Remote


Job Summary

Join our customer's team as a Mobile Agent QA Evaluator (Android) and play a key role in shaping the future of AI-driven mobile experiences. You will assess the performance of AI agents executing various tasks on Android apps, ensuring high-quality interactions and seamless user journeys. This flexible, task-based opportunity is perfect for detail-oriented Android users eager to contribute to cutting-edge technology initiatives from the comfort of their own home.


Key Responsibilities

  1. Review sequences of actions and screenshots to evaluate AI agent performance on Android apps.
  2. Determine if tasks were completed accurately based on the provided instructions.
  3. Mark tasks as pass or fail using clear, predefined criteria.
  4. Identify and flag points of failure such as incorrect taps, inputs, or unnecessary steps.
  5. Consistently apply written guidelines to all evaluations to ensure quality and reliability.
  6. Complete concise, minute-long tasks efficiently and accurately.
  7. Communicate effectively in English, both in written and verbal formats, as you share feedback or flag issues.


Required Skills and Qualifications

  1. Regular user of Android smartphones with personal device access.
  2. Comfortable navigating common apps like ride-hailing, food delivery, messaging, and maps.
  3. Strong attention to detail and commitment to accuracy.
  4. Ability to follow step-by-step written guidelines and make clear pass/fail decisions.
  5. Reliable, consistent, and self-motivated in completing assigned tasks.
  6. English proficiency at B1 level or higher (reading and writing).
  7. Demonstrated care for effective written and verbal communication.


Preferred Qualifications

  1. Previous experience in QA, software testing, or data annotation.
  2. Proven ability to execute tasks rapidly while maintaining high quality.

This job is currently closed and not accepting applications. Thank you for your interest!

Refer and Earn