Terac
Professionals: Designing Challenging AI Prompts
United States · Remote (country restricted) · Contract
Apply on the employer’s site ↗See how well you match this job
You apply directly with the employer. ROLIVA does not submit applications from this page and is not the employer.
About the role
Description from the employer’s posting. Check the employer’s page for the current version.
- EmployerTerac
- LocationUnited States
- Work styleRemote (country restricted)
- Employment typeContract
- Employer posted
What We're Researching
We're running a paid study to build a bench of people who are exceptionally good at designing tasks that expose AI model limitations. By turning real-world workflows into demanding requests, we can better evaluate where current models break down. This initial trial helps us identify individuals suited for ongoing prompt engineering and evaluation work.
How It Works
You will spend about an hour translating a complex workflow from your job or personal life into a demanding prompt that requires reasoning and real-world lookup. After running it in ChatGPT to identify where the model fails, you will refine the prompt until it breaks the system. Finally, you will write a clear grading rubric that a stranger could use to evaluate any AI's attempt at your task. This entire process is screen-recorded, as we are assessing your thought process just as much as the final submitted files.
Show full description
Who This Is For
We welcome professionals, domain experts, and power users who have deep knowledge of specific workflows. You need to be capable of evaluating an AI's output within seconds and comfortable working on a laptop or desktop with a ChatGPT account. Candidates who excel at this trial will be considered for a long-term bench of evaluators.
What You'll Do
Pick a familiar workflow and convert it into a demanding AI prompt
Test your prompt in ChatGPT to find failure points, making it harder if the AI succeeds
Write a comprehensive rubric for grading the AI's performance
Share your screen, camera, and microphone while completing the task
Submit your prompt, failure notes, rubric, and the generated output file
Who Should Apply
Deep familiarity with a specific professional or personal workflow
Ability to quickly evaluate the accuracy and quality of AI outputs
Access to a laptop or desktop computer
An active ChatGPT account
Comfortable being screen-recorded while thinking through complex tasks
Compensation
$20 one-time
Ready to participate?
Start your paid interview now
About Terac
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at terac.com or on YouTube at @jointerac.
Check your resume against this job Free, no sign-up. Nothing you paste is stored.
Staying safe while you apply
- Never pay to apply, interview or accept an offer. ROLIVA never asks you for payment to apply to a job.
- Apply only through the official “Apply on the employer’s site” button, on the employer’s own site, and check that a recruiter’s email uses that employer’s own domain rather than a free email address.
- Be cautious of an offer made with no real interview, or pressure to decide quickly or share financial details early.
Does something look wrong with this listing? Use “Report broken link” in the role details, or read ROLIVA’s full job-safety guidance ↗.
Preparing for this role with ROLIVA
- Check the fit.
Compare the requirements with the experience you have confirmed, including gaps.
- Prepare honestly.
Build interview stories and application drafts from your own evidence.
- Keep track.
Save the role and record your own application status and follow-ups.
At a glance
- Work styleRemote (country restricted)
- Employment typeContract
- Employer posted
- Added to ROLIVA
- Last checked