AI Content Evaluator | $150/hr Remote | Mercor

At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world’s leading AI research labs to build and train cutting-edge AI models.

Organization: Mercor

Position: Generalist

Referral Partner: Crossing Hurdles

Type: Hourly Contract

Compensation: $30–$150/hour

Location: Remote

Duration: Varies by project (1–3 months typical)

Commitment: 10–40 hours/week

Role Responsibilities

• Evaluate AI-generated outputs for accuracy, clarity, and alignment with real-world reasoning.
• Contribute written assessments and structured feedback on model performance.
• Identify conceptual, logical, and stylistic strengths and weaknesses in AI responses.
• Collaborate asynchronously with Mercor’s research and operations teams to maintain quality and consistency across evaluations.
• Apply strong analytical judgment, precise communication, and consistent evaluation criteria across diverse tasks and topics.

Requirements

• Strong English fluency and written communication skills.
• Exceptional attention to detail and ability to identify subtle errors or inconsistencies.
• Strong analytical and critical thinking skills across a wide range of subjects.
• No formal educational background or specific degree required — curiosity, clarity, and reasoning skill are key.
• Comfort working independently in a remote and asynchronous environment.

Application process: (Takes 20 min)

• Upload resume
• Complete a short qualifying assessment introducing core data types and task formats
• AI interview based on your resume (15 min)
• Submit form