AI Evaluator – Healthcare (Remote)

About the role

Grayde.ai is seeking qualified medical and pharmacy professionals to rank AI‑generated drug information responses. You will create preference‑pair data that trains reinforcement‑learning‑from‑human‑feedback (RLHF) models, ensuring clinical accuracy, completeness, and proper sourcing.

Key responsibilities

• Rank multiple AI‑generated drug information responses according to a defined rubric.
• Validate dosing, interaction, contraindication, and off‑label use information using authoritative sources.
• Confirm that responses cite appropriate evidence or labeling.
• Use drug databases such as DrugBank, Micromedex, Lexicomp, FDA labeling, and PubMed for verification.
• Flag any response that could mislead prescribers or patients.
• Provide clear, written rationale for each ranking decision.

Required profile

• Medical degree (MBBS/MBChB, MD) or pharmacy/nursing qualification (BPharm, MPharm, PharmD, MN, MSN).
• Background in pharmacology, toxicology, clinical pharmacy, pharmacovigilance, or related fields.
• Full professional fluency in English.
• Completion of a Grayde.ai profile to be considered.

Required skills

• Proficiency with DrugBank.
• Proficiency with Micromedex.
• Proficiency with Lexicomp.
• Proficiency with FDA drug labeling resources.
• Proficiency with PubMed literature searches.