Evaluation

Submitted algorithms will be evaluated by the two groups: the PRMU committee of the IEICE and the ISMAR2015 Tracking Competition committee. Level 1 and Level 2 submissions will be evaluated by the PRMU committee and Level 3 submissions will be evaluated by the ISMAR2015 Tracking Competition committee.

PRMU Evaluation

The PRMU committee mainly focuses on the creativity and originality of the algorithm from the source code submitted by participants. Therefore, the source code should contain brief comments of the algorithm to indicate the appealing points of it.

ISMAR Evaluation

The ISMAR2015 Tracking Competition committee employs the TrakMark evaluation criterion. In this criterion, the sum of projection errors of  virtual 3-D points is calculated to evaluate the camera pose accuracy for each frame. For synthesized image sequences, the ground truth of the camera poses is created from the camera parameters input by the CG renderer.