Jobs›Automation Product, Bangalore

Automation and AI product testing

Nasugroupcom · Bangalore
वेतन₹9L–10Lसाल, जैसा लिखा है
कहाँBangaloreKarnataka
प्रकारFull time3-6 years
Posted5 Nov13 दिन पहले, the company site से
Kaam ने check किया
Fee, deposit या पैसे माँगने के निशान नहीं
दिन का काम
गाड़ी या licence नहीं चाहिए
जो skills माँगे हैं5 लिखे हैं
PlaywrightevalsgoldenLarge Language Models (LLM)AI product testing
इस job के बारे में

Job Summary

We are looking for an experienced AI Automation Tester with hands-on experience in testing AI-powered products and applications. The ideal candidate should have strong expertise in Playwright automation, along with practical experience in LLM evaluations (Evals), Golden Datasets (Goldens), and AI Observability.

Key Responsibilities

Design, develop and execute automated test scripts using Playwright.

Test AI-powered applications, LLM-based products and Generative AI solutions.

Work on Evals to assess AI response accuracy, relevance, quality and consistency.

Create, maintain and validate Golden Datasets (Goldens) for benchmarking AI outputs.

Implement and work with AI Observability to monitor model performance, response quality, latency and failures.

Perform functional, regression, API and end-to-end testing.

Identify, report and track defects to ensure product quality and reliability.

काम पाने के लिए कभी पैसे मत दो। Fee माँगे तो scam है। दस निशान →

the company site पर apply करो
cutshort.io नए tab में खुलेगा