Mobile Agent QA Evaluator (Android)

Job Title: Mobile Agent QA Evaluator (Android)

Job Type: Contract / Project-based

Location: Remote

Job Summary

Join our customer's team as a Mobile Agent QA Evaluator (Android) and play a key role in shaping the future of AI-driven mobile experiences. You will assess the performance of AI agents executing various tasks on Android apps, ensuring high-quality interactions and seamless user journeys. This flexible, task-based opportunity is perfect for detail-oriented Android users eager to contribute to cutting-edge technology initiatives from the comfort of their own home.

Key Responsibilities

1. Review sequences of actions and screenshots to evaluate AI agent performance on Android apps.
2. Determine if tasks were completed accurately based on the provided instructions.
3. Mark tasks as pass or fail using clear, predefined criteria.
4. Identify and flag points of failure such as incorrect taps, inputs, or unnecessary steps.
5. Consistently apply written guidelines to all evaluations to ensure quality and reliability.
6. Complete concise, minute-long tasks efficiently and accurately.
7. Communicate effectively in English, both in written and verbal formats, as you share feedback or flag issues.

Required Skills and Qualifications

1. Regular user of Android smartphones with personal device access.
2. Comfortable navigating common apps like ride-hailing, food delivery, messaging, and maps.
3. Strong attention to detail and commitment to accuracy.
4. Ability to follow step-by-step written guidelines and make clear pass/fail decisions.
5. Reliable, consistent, and self-motivated in completing assigned tasks.
6. English proficiency at B1 level or higher (reading and writing).
7. Demonstrated care for effective written and verbal communication.

Preferred Qualifications

1. Previous experience in QA, software testing, or data annotation.
2. Proven ability to execute tasks rapidly while maintaining high quality.