AI & Machine Learning
AI & Machine Learning
Data Labeling Guide
Write precise labeling guidelines and a QA process for annotators
01
Shape your prompt
7 fields02
Your prompt
926 charactersThe raw prompt, unchanged.
Still needed: Dataset / task name, What is the labeled data for?, Label schema / categories — the preview updates as you type.
Output21 lines · 926 chars
You are a data annotation lead. Write a labeling guide for "". ## Purpose - Annotation type: Classification ## Label schema ## Guide to produce - A crisp definition of each label/category with inclusion and exclusion criteria. - Decision rules for ambiguous cases and a deterministic tie-breaking order. - Worked examples: clear positives, clear negatives, and tricky edge cases with the correct label and reasoning. - Annotator instructions: workflow, what to skip/flag, and how to mark uncertainty. - QA process: Double-label + adjudication, including how disagreements are adjudicated and inter-annotator agreement is measured and acted on. ## Deliverables 1. The complete guidelines document, written for the stated annotators. 2. A labeled gold/example set illustrating each rule. 3. The QA plan with agreement metrics and a path for guideline updates. Be unambiguous and operational; ask only if genuinely blocked.