Amazon
Chennai, Tamil Nadu, India Posted 2d ago
Act as APAJ's technical lead for automated quality judgment at Amazon, partnering with Quality Specialists, Science, and Engineering to move workflows to trustworthy unit-level judgment.
Key Responsibilities
Turn workflow requirements and conventions into judge designs, deterministic checks and transformation logic.
Streamline existing judge measurement and onboarding mechanisms so they run consistently and at scale.
Provide technical input to RED certification and data-classification work for critical-data workflows.
Develop and assess judge-builder candidates; contribute reusable components, runbooks and lessons to the network.
Requirements
2+ years of design, implementation, or consulting in applications and infrastructures experience.
4+ years of specific technology domain areas experience.
5+ years of IT development or implementation/consulting in the software or Internet industries experience.
Experience using a current programming language, such as Python, to build scripts, prototypes or reusable components.
Experience with large language models, prompt design or automated evaluation.
Preferred Qualifications
Experience working with AWS technologies from a dev/ops perspective.
Experience building or evaluating ML- or LLM-based quality systems.
