Frequently Asked Questions
How are the methods evaluated?
The evaluation framework (data, reference standard, measures, scores,
and ranking) is described in
.
I have downloaded the data. How do I read it?
Read the data format section on the
.
What's the submission format
Read the submssion format section on the
.
Why can't I download the reference segmentation for
the test data and perform the evaluation myself?
From our previous experiences with making data sets publicly
available we have learned that if we would release the 'truth'
for the test data, groups would perform slightly or vastly
different types of evaluations. This may lead to incomparable
results between papers that have used the same data.
To avoid this, we decided on the current procedure, which makes sure
that each system is evaluated in exactly the same way.
I have lost the password of my registered team.
What should I do?
Send us an . A password reminder
will be mailed to the e-mail address provided with the
registered team.
Can I submit my results to this evaluation framework?
Yes, you can, under the following conditions:
- You must have registerd your team and send in the data confidentiality form
- You must have submitted a paper with a detailed description of your method, and the paper must have been accepted by the framework organisation
What to do if I have further questions?
Send an e-mail to one of the
.
|
