Data Evaluator

About the Role

This is a remote contract opportunity with Mercor, a company that connects top-tier creative and technical professionals with AI research teams. The organization is based in San Francisco and is backed by investors such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

The opening is for a Software / AI / IT / Data Evaluator who will assess AI-produced work and help improve model quality through detailed review and feedback.

What You’ll Do

• Review AI-generated materials using role-specific quality standards.
• Spot factual, visual, and formatting issues in documents, spreadsheets, and presentation decks.
• Write precise, organized feedback that helps refine model outputs.
• Use strong subject expertise to judge the correctness and quality of responses.
• Operate independently and manage work asynchronously within deadlines.

Required Qualifications

• At least 5 years of professional experience in Software, AI, IT, or Data.
• Strong command of English at native or professional level.
• Advanced proficiency with Microsoft Office and Google Workspace, with particular strength in Slides.

Preferred Profile

• A Master's degree or higher from a well-regarded institution is an advantage.

Application Process

The application process is expected to take around 20 to 30 minutes and includes three steps: uploading a resume, completing an AI-based interview from your resume, and submitting the final form.

Support Information

If applicants need help or clarification, support is available through the provided company support email. Additional details about the interview flow and platform can be found in the company’s documentation resources.

Compensation

This position pays between $80 and $120 per hour.

Notes

Applications are reviewed daily. Candidates must complete both the AI interview and all application steps to be considered.