Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

grasp: insufficient negative data #420

Open
ahundt opened this issue Jan 17, 2018 · 0 comments
Open

grasp: insufficient negative data #420

ahundt opened this issue Jan 17, 2018 · 0 comments
Assignees
Labels

Comments

@ahundt
Copy link
Member

ahundt commented Jan 17, 2018

Currently, a typical output is as follows:

 loss: 0.5930 - segmentation_single_pixel_binary_accuracy: 0.6826 - mean_pred_single_pixel: 0.3928 - mean_pred: 0.4465 - mean_true: 0.3928

mean_pred_single_pixel is lower than mean_pred, when it should be the opposite. Based on visual inspection, most of the visible scenes are not positions where a grasp attempt would succeed. This means there is a bias towards successful grasps, because most positions in the world should fail to grasp objects successfully. We need to add additional negative data.

  • One way to do this would be to take time steps where the gripper did not close and assume a grasp attempt would fail at those positions, although this would not always be true for every case, it should be for the vast majority.
  • Another would be to suggest or collect real poses with delta depth large enough that it wouldn't contact any objects. However, might also be subject to errors.
@ahundt ahundt self-assigned this Jan 17, 2018
@ahundt ahundt added the bug label Jan 17, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant