I've kept guessed labels outside tuning before. Now our planned UR5e cover-inspection station has moving bright streaks labelled scratches. How do I rebuild useful references without losing the awkward examples?
Keep the awkward examples. Link each image to its physical cover and ask inspection to judge the surface independently of that bright stripe. An uncertain example can remain uncertain.
I wouldn't call it empty until the physical review. Some covers may be perfectly useful, just incorrectly annotated. Rebuilding every example could waste the preparation you've already paid for.
Start there. Give the covers stable identities before another capture session; otherwise a better picture still leaves you guessing which surface was examined.
Oscar, agreed. I mean separate trusted decisions from guesses, not throw the files away. Keep original annotations visible as superseded if inspection changes them.
Before you collect hundreds, try a small identified set through repeat placements. If the supposed scratch moves but a confirmed mark disappears, you have two different imaging problems to solve.
That's a useful difficult reference. Record the mark's location on the part, then see whether candidate viewing conditions reveal it consistently across the presentation variation you expect.
Then I would leave the threshold deadline separate from the reference-review deadline. A corrected label doesn't by itself make that faint mark reliably visible.