Audio Transcription Evaluator Specialist
Mercor
Date: 12 hours ago
City: Remote, Remote
Contract type: Part time
Remote
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Transcribing/Writing Expert
Type: Freelance
Compensation: $25–$40/hour
Location: On-site (San Francisco)
Duration: 2–4 weeks
Commitment: 20 hours/week
Role Responsibilities
Must-Have
,
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Transcribing/Writing Expert
Type: Freelance
Compensation: $25–$40/hour
Location: On-site (San Francisco)
Duration: 2–4 weeks
Commitment: 20 hours/week
Role Responsibilities
- Transcribe and optimize audio/video by creating detailed audio transcriptions with multiple constraints and instructions.
- Define and document evaluation standards by establishing high-level expectations for correct responses in general audio consumer contexts and developing a comprehensive rubric.
- Conduct model testing and grading by running prompts through models and assessing preliminary outputs against expectations.
- Support benchmarking and quality assurance by collaborating in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
- Work independently and meet deadlines while contributing to a structured project environment with clear goals and tools.
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- Available to work from office 20 hours a week on the client’s location.
- College students/grads.
- Complete an AI-led interview, this should take around 15 minutes.
- If selected, you will be invited to work on the project.
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [email protected]
,
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resume