Mobile Agent QA Evaluator (Android)

$6 - $10/hourpay

Job Description

Job Title: Mobile Agent QA Evaluator (Android)


Job Type: Contract / Project-based


Location: Remote


Job Summary

Join our customer's team as a Mobile Agent QA Evaluator (Android) and play a key role in shaping the future of AI-driven mobile experiences. You will assess the performance of AI agents executing various tasks on Android apps, ensuring high-quality interactions and seamless user journeys. This flexible, task-based opportunity is perfect for detail-oriented Android users eager to contribute to cutting-edge technology initiatives from the comfort of their own home.


Key Responsibilities

  1. Review sequences of actions and screenshots to evaluate AI agent performance on Android apps.
  2. Determine if tasks were completed accurately based on the provided instructions.
  3. Mark tasks as pass or fail using clear, predefined criteria.
  4. Identify and flag points of failure such as incorrect taps, inputs, or unnecessary steps.
  5. Consistently apply written guidelines to all evaluations to ensure quality and reliability.
  6. Complete concise, minute-long tasks efficiently and accurately.
  7. Communicate effectively in English, both in written and verbal formats, as you share feedback or flag issues.


Required Skills and Qualifications

  1. Regular user of Android smartphones with personal device access.
  2. Comfortable navigating common apps like ride-hailing, food delivery, messaging, and maps.
  3. Strong attention to detail and commitment to accuracy.
  4. Ability to follow step-by-step written guidelines and make clear pass/fail decisions.
  5. Reliable, consistent, and self-motivated in completing assigned tasks.
  6. English proficiency at B1 level or higher (reading and writing).
  7. Demonstrated care for effective written and verbal communication.


Preferred Qualifications

  1. Previous experience in QA, software testing, or data annotation.
  2. Proven ability to execute tasks rapidly while maintaining high quality.
About micro1
micro1 is a data engine that helps AI labs train foundational models and enterprises build AI agents. We provide frontier evaluations and reinforcement learning environments used to improve LLM capabilities, as well as contextual evaluations used to monitor and improve AI agents in enterprise settings. Our data engine includes an AI recruiter agent that sources and vets domain experts, a data platform that enables rapid production of high-quality training data, and a pipeline performance system that ensures both quality and velocity.
Our goal is to have 1 billion people doing meaningful work by contributing their expertise to the development of frontier AI models. We’ve raised $40M+ in funding, and our AI recruiter has powered more than 1 million AI-led interviews as our global network of experts expands to form the human intelligence layer for AGI.

This job is currently closed and not accepting applications. Thank you for your interest!

Refer and Earn