Linguistics Expert - AI Evaluator

Required Skills

Linguistic Analysis
Evaluation and Grading
Attention to Detail

Job Description

Job Title: Linguistics Expert - AI Evaluator


Job Type: Part-time, Contract.


Location: Remote


About Us:

Our mission at micro1 is to match the most talented people in the world with their dream jobs. If you are looking to be at the forefront of AI innovation and work with some of the fastest growing companies in Silicon Valley, we invite you to apply for a role. By joining the micro1 community, your resume will become visible to top industry leaders, unlocking access to the best career opportunities on the market.


Job Summary:

Join our team as a Linguistics Expert - AI Evaluator and contribute to the development of AI systems with exceptional reasoning abilities. As an AI Tutor in Linguistics, you will create and refine complex question-answer pairs and establish rubrics for quality assessment. Use your expertise to challenge AI capabilities and enhance their accuracy and depth.


Key Responsibilities:

  • Generate prompts designed to challenge AI, identifying potential errors in responses.
  • Develop comprehensive scoring criteria to evaluate AI's answer quality.
  • Analyze AI responses and implement corrections using domain-specific linguistic knowledge.
  • Collaborate with interdisciplinary teams to refine AI's specialized question-answering capabilities.
  • Perform detailed evaluations and grading to ensure AI accuracy and improvement.
  • Guide AI development through linguistic insights and expert feedback.
  • Contribute to the continuous development of AI instructional methodologies.


Required Skills and Qualifications:

  • C1/C2 English proficiency or native English speaker.
  • MA+ in Linguistics or Computational Linguistics, or PhD students with MA, or higher.
  • 3+ years of relevant professional experience in a related field.
  • Expertise in at least one of the following areas: Syntax, Morphology, Phonology, Semantics, Phonetics, Pragmatics, Psycholinguistics, Neurolinguistics, Second Language Acquisition, Sociolinguistics, Computational Linguistics.
  • Proven ability to learn new methods and adapt to complex guidelines quickly.
  • Strong written and verbal communication skills, with attention to detail.
  • Experience with evaluation and grading processes.


Preferred Qualifications:

  • PhD holders, postdoctoral researchers, professors, and research scientists are encouraged to apply.

Apply now

Please note that by applying & completing our interview process, you will be added to our talent pool. This means you’ll be considered for this and all other possible roles that may match your skills. These potential opportunities will be sent your way as a micro1 certified candidate.

Have any questions? See FAQs