How long is the evaluation time?

[wanghao9610]

Hi, could you tell us how long is the evaluation time? And could you give a web to disply the process imformation of submission, just like the CodaLab.

[binwang777]

Hi, the evaluation time is related to the size of the submitted Json file, and the duration is usually between 3 and 15 minutes. Our evaluation scheme is that the Json files submitted by the players on that day will be calculated uniformly in the early morning and an email will be sent to the players immediately after the calculation. Codalab is a good suggestion, but for the time being we have more business to deal with.

[wanghao9610]

Do you consider another evaluation scheme? Once submission is recevied then evaluate and report it immediately, which will give a quick response to participators.