Product Validation Expert

Job Title: Product Validation Expert

Job Type: Contract (Full-time or Part-time)

Location: Remote

Job Summary:

Join our customer's team as a Product Validation Expert and play a key role in ensuring that a widely used AI-powered consumer product deliver safe, accurate, and helpful experiences. You will design and implement evaluation processes to understand user perceptions.

Key Responsibilities:

1. Design and develop robust rubrics for evaluating AI model outputs from a user experience (UX) perspective.
2. Receive, analyze, and execute evaluation tasks focused on identifying potential issues that could lead to a poor user experience of this AI product.
3. Collaborate closely with cross-functional teams to define and refine product validation criteria and safety standards.
4. Translate user insights into actionable feedback for model improvement, focusing on accuracy, safety, and helpfulness.
5. Document findings and recommendations with clarity, ensuring stakeholders understand the impact on end-user satisfaction.
6. Continuously monitor evolving AI product usage and proactively identify emerging risks or concerns from a UX point of view.

Required Skills and Qualifications:

1. Exceptional written and verbal communication skills, with a strong emphasis on clarity and precision.
2. Ability to develop and apply evaluative frameworks that balance user experience, safety, and product performance.
3. Strong analytical mindset and attention to detail when assessing user risks or usability issues.
4. Comfort collaborating with diverse teams and adapting to fast-changing project requirements.
5. Proficiency in documenting complex findings in a user-friendly and actionable manner.
6. Ability to commit at least 15 hours per week to sharing experiences and tasks.

Preferred Qualifications:

1. Familiarity with current widely used AI consumer products and their typical user journeys.