Please leave the bad attempts in the experiment notes

JasperAbbott0029 · 2025年10月24日 17:31 UTC

已关闭

主帖中文翻译暂不可用,以下显示英文原文;回复保留原文。 查看英文原文

JA
JasperAbbott0029
SO101 manipulation experiments from the SmolVLA release article
June 2025 research release. Demonstration results are not a production reliability guarantee. Research demonstration: Hugging Face SmolVLA team. Published 2025-06-03. Source

Revisiting the SmolVLA release while thinking about a shared practice dataset. I'd find a folder of failed attempts genuinely useful if it said what went wrong. Is there appetite here for comparing failures without turning it into a leaderboard? My concern is that everyone quietly uploads only the clean bits.

https://huggingface.co/blog/smolvla

3 条回复

OL
OliverAli0189

Keep evaluation failures, absolutely. Don't silently mix them into a training set labelled as successful demonstrations. Those are different uses.

0分
JA
JasperAbbott0029

Yes, separate collection. I should've said that.

0分
IS
IsabelAbbott0039

Include the camera position and lighting notes. 'Missed the block' doesn't tell me whether it was visible.

0分

讨论已关闭

此讨论已连续六个月没有活动,现已关闭新回复。 最后活动: .