The job in 20 seconds
Job summary
Evaluate AI-generated explanations and scenario-based conversations or media for logical consistency, completeness, and alignment with prompts. Compare outputs, explain ratings using prompt details, record evaluations according to project guidelines, and flag difficult examples.
Job details
Role: Business Systems Analyst (Remote) Location: Remote from US, CA, UK, IE, AU, NZ Engagement Type: Freelance / Hourly Contract Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States. Overview We are looking for structured problem solvers who can trace requirements and identify contradictory content details. You will perform generalist AI evaluation of scenario-based conversations and media for logic, completeness, and prompt alignment. This opportunity is remote, with flexible hours and assignments based on project availability. Students, recent graduates and working professionals are welcome to apply. Key Responsibilities Review generated explanations for clear requirements, coherent steps, and missing information. Compare two outputs and identify which follows the stated logic more completely. Explain your rating with references to prompts, labels, and visible details. Take part in English conversations with AI models when assigned to voice tasks. Record your ratings using project guidelines and flag examples that are difficult to judge. Requirements Confident spoken English and clear written communication. Structured analysis of requirements and content logic. Ability to judge content logic from prompts and observable details. A computer, reliable internet and headphones, with a quiet space for voice-based tasks. Ability to produce your own ratings and written explanations without using AI tools. Equal Opportunity We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law. Apply Now!
What you’ll do
Evaluate AI-generated explanations and scenario-based conversations or media for logical consistency, completeness, and alignment with prompts. Compare outputs, explain ratings using prompt details, record evaluations according to project guidelines, and flag difficult examples.
Requirements
Applicants must have confident spoken English, clear written communication, and the ability to analyze requirements and content logic using prompts and observable details. They need a computer, reliable internet, headphones, and a quiet space for voice tasks, and must complete ratings and explanations without AI tools.
Listed skills
- Critical Thinking · Preferred
- written communication · Preferred
- Attention to detail · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Requirements Analysis
- Structured Analysis
- Content Logic Evaluation
- Critical Thinking
- Written Communication
- Spoken English
- Prompt Alignment
- Output Comparison
- Rating and Evaluation
- Attention to Detail
Job areas
- Data & Analytics
- Technology
- Administrative