01
Your experts are clinicians with twenty free minutes a day
The people qualified to judge a lesion boundary or a discharge summary are practicing specialists, and their review time comes in short windows between clinical duties. The pipeline has to be built around that scarcity.
02
Expert disagreement needs adjudication
Two radiologists will draw the same lesion boundary differently, and clinicians will disagree on what counts as an error in a model-written note. The dataset needs a documented way to resolve those cases.
03
Labels need provenance a regulator can check
A regulatory submission asks who reviewed each item, with what qualifications, under which version of the instructions. Most pipelines cannot reconstruct that after the fact.