Frequently Asked Questions

How are the methods evaluated?
The evaluation framework (data, reference standard, measures, scores, and ranking) is described in this document.

I have downloaded the data. How do I read it?
Read the data format section on the about page.

What's the submission format
Read the submssion format section on the about page.

Why can't I download the reference segmentation for the test data and perform the evaluation myself?
From our previous experiences with making data sets publicly available we have learned that if we would release the 'truth' for the test data, groups would perform slightly or vastly different types of evaluations. This may lead to incomparable results between papers that have used the same data. To avoid this, we decided on the current procedure, which makes sure that each system is evaluated in exactly the same way.

I have lost the password of my registered team. What should I do?
Send us an email. A password reminder will be mailed to the e-mail address provided with the registered team.

Can I join the challenge workshop?
Yes, you can. Register for the workshop via the MICCAI organization.

Can I join the on-site competition for this challenge?
Yes, you can, under the following conditions:

  • You must have registered for the workshop via the MICCAI organization, and
  • You must have participated in the pre-workshop challenge, and submitted the results before the deadline, and
  • You must have submitted a paper with a detailed description of your method, and the paper must have been accepted by the challenge organizers, and
  • You are not involved in the organization of this challenge.

What to do if I have further questions?
Send an e-mail to one of the organizers.