Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Having a hard time getting the right output as explained in the paper. #5

Open
DHDanielSuh opened this issue Oct 5, 2021 · 5 comments
Labels
question Further information is requested

Comments

@DHDanielSuh
Copy link

Hello.
I really enjoyed reading your paper and am so excited to test your code.

Here are some outputs that used your pretrained model, both Structure3D and NYU303.
0_select (1)
0_select (2)
0_select

I am having a hard time getting the right output as explained in the paper.
It was happening for both pretrained models.

  • Do you have any restrictions on input images by pretrained models?
  • Two models is outputting different results. Which model do you recommend more?
  • Do you have any restrictions on the environment settings?

Could you please share some more explanations on how to use the pretrained model you provided?
And it would be great if you can share some sample images you used for the inference.

Thank you.

@CYang0515
Copy link
Owner

Hi,
which dataset do you use separately in the three case? And the results of the first two lines seem to be correct?

@DHDanielSuh
Copy link
Author

DHDanielSuh commented Oct 6, 2021

Hi.
I just randomly collected these images online. These images didn't belong to any dataset. In terms of the result, both first and second image wasn't outputting correct layout lines. If you see the first image, the sidewall is totally off. And for the second image, the front wall is off too.
I have also tried with images in the NYU303 dataset, but it wasn't working correctly.

  • Is there any specific dataset that I have to use to do some inference?
  • Is there any restrictions on input images?
  • Could you please walk me through how to follow the paper's result?

Thank you.

Here are some more inference images that I tried.
Structure3D_pretrained.pt OUTPUT
0_select

NYU303_pretrained.pt OUTPUT
0_select

Structure3D_pretrained.pt OUTPUT
0_select

NYU303_pretrained.pt OUTPUT
0_select

@CYang0515
Copy link
Owner

You should do some inference on Structured3D and NYU303 test dataset. For randomly collected images online, maybe the predicted 3D parameters of planes are incorrect as the different intric metric and the data bias.

@marcomiglionico94
Copy link

marcomiglionico94 commented Oct 8, 2021

I tried too and my results looks even worse than what you are showing here. I tried both the models on random images collected online and on some examples from the NYU303 dataset but none of them seem to work good. Have you done any progress?

@Mps24-7uk
Copy link

@CYang0515 I am facing the same issue, the layout inclination are going off. Can you walk us through how to replicate the same result?

@bertjiazheng bertjiazheng added the question Further information is requested label Oct 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

5 participants