Talent.com
Mercor
AI Evaluator - Software ExpertMercor • Sydney, New South Wales, Australia
AI Evaluator - Software Expert

AI Evaluator - Software Expert

Mercor • Sydney, New South Wales, Australia
11 hours ago
Job type
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in outputs.
  • Provide clear, structured written feedback to improve quality.
  • Work independently and asynchronously to meet deadlines.
  • Utilize expertise in Microsoft Office and Google Workspace, especially Slides.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

AI Evaluator - Software Expert • Sydney, New South Wales, Australia

Similar jobs

ICT Business Analyst

Careerone Partner NetworkChatswood, NSW, AU

We are seeking a ICT Business Analyst to join our team and support data-driven decision-making across strategic initiatives, investment analysis, and operational improvement projects.This is a key ... Show more

Expressions of Interest - Real Estate Sales Associates

AveoBayview, NSW, AU

Aveo Retirement Communities – North Shore and Northern Beaches communities.K package (base + super) + $5K car allowance + KPIs (OTE $100K+).Are you passionate about people and looking to build a me... Show more

Software Engineer – AI Production Platform

Connecting Plots Pty ltdBeaconsfield, NSW, AU

Connecting Plots is one of Australia's leading independent creative agencies, delivering integrated campaigns, social content, production and brand experiences for some of Australia's most recognis... Show more

Technical Support Engineer Full-time

TomraSt Leonards, NSW, AU

TOMRA: Where Innovation Meets Impact.At TOMRA, we’re not just recycling - we’re reinventing it.Our mission? Clean Loop Recycling: a smarter, greener way to keep drink containers in circulation and ... Show more

Game Designer

Aristocrat Technologies Australia P/LBrookvale, NSW, AU

At Aristocrat, we believe in bringing happiness to life through the power of play—a mission that drives us to build world-class gaming experiences.As a Game Designer, you will be instrumental in cr... Show more

Senior AI Engineer

MYOBSydney, NSW, AU

We’re a leading business management solution with a core purpose: helping more businesses in Australia and New Zealand start, survive and succeed.At MYOB, we believe what’s good for one business is... Show more

AI Manager

GPT GROUPSydney, NSW, AU

Together, we can do great things.We shape leading experiences across office, retail, logistics and student accommodation.We’re one of Australia’s largest property groups, managing $38.Our sustainab... Show more

Threat Response Technology and Capabilities Product Owner

MasterCardSt Leonards, NSW, AU

Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we’re helping build a sustainable economy where everyone can prosper.We supp... Show more

Staff Applied AI Scientist

Culture AmpSydney, NSW, AU

We’re big believers in the power of IRL, so for most roles we ask Campers to work from their local Culture Amp office an average of 2 days a week to unlock connection, pace and culture together.Joi... Show more

Technology & AI Trainer

Thomson GeerSydney, NSW, AU

We are seeking to appoint a service-focused and motivated Technology Trainer to join our Sydney office on a full-time or part-time basis.Thomsons is a leading national law firm with offices in Sydn... Show more

Science Tutor

Matrix EducationChatswood, NSW, AU

Matrix Education is now hiring.Castle Hill, Chatswood, Epping, Strathfield.This position is ideal for an undergraduate student who loves to share their knowledge of Science and is seeking a stable ... Show more

Software Engineer - Investigate

NuixSydney, NSW, AU

We're on a mission to be a Force For Good, through our People, Products and Purpose at Nuix.Nuix is one of the greatest comeback Technology success stories in Australia, and we're making massive wa... Show more

Databricks Data Engineer | Mid Level

Mane ConsultingChatswood, NSW, AU

Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Engineer to collaborate a highly respected team.... Show more

Automotive Parts Interpreters

Alto GroupArtarmon, NSW, AU

We currently have a fantastic opportunity available in the group as a.We are looking for an experienced, dedicated and motivated Vehicle Parts Interpreter to join our team working on a range of veh... Show more