Data Annotation

Role Overview

We are looking for an experienced professional to evaluate AI-generated responses for conversational AI agents used in travel-related products. The role focuses on assessing response accuracy, relevance, completeness, and quality to improve AI performance.

Key Responsibilities

Evaluate AI-generated responses against predefined guidelines and quality standards.

Perform data annotation, labeling, classification, and quality reviews.

Identify incorrect, misleading, irrelevant, or incomplete responses and potential AI hallucinations.

Analyze evaluation data to identify recurring errors, quality gaps, and improvement opportunities.

Track quality metrics, document findings, and recommend improvements.

Use Excel/Google Sheets and basic SQL, where applicable, to analyze evaluation data.

Collaborate with AI and Machine Learning teams to improve conversational AI performance.

Required Skills

5–8 years of experience in Data Annotation, AI Evaluation, Content Quality, Search Relevance, or Quality Assurance.

Strong analytical, problem-solving, and attention-to-detail skills.

Experience applying evaluation guidelines and quality standards consistently.

Proficiency in Excel or Google Sheets.

Good written communication and documentation skills.

Understanding of quality metrics and data analysis.

Good to Have

Exposure to Generative AI, LLMs, conversational AI, or AI response evaluation.

Experience with Human-in-the-Loop (HITL), AI training data validation, or hallucination detection.

Basic SQL knowledge.

Experience in travel, hospitality, or search quality evaluation.