The COMFORT Localization Benchmark evaluates real-time state-estimation and localization methods using the GrandTour Dataset. Explore the GrandTour dataset, quick-start guide, and localization task for data access and technical details.
The benchmark is hosted on Codabench. Participants must create a Codabench account before they can register for the competition and submit results.
The challenge follows a two-phase structure:
- Validation Phase (July 13, 2026 at 00:00 UTC–August 3, 2026 at 00:00 UTC): The leaderboard is open, and participants can develop and evaluate their methods using the training data.
- Test Phase (August 3, 2026 at 00:00 UTC–October 30, 2026 at 23:59 UTC): Reference trajectories remain hidden. Participants can view their own scores, choose whether to make a submission public, and add one result to the leaderboard. The benchmark remains open after the workshop for continued evaluation.
Final ranking and award eligibility: Only test-phase submissions count toward the final benchmark ranking, which is determined by average Absolute Trajectory Error (ATE); lower is better. To be eligible for an award, a submission must be made from August 3, 2026 at 00:00 UTC through September 21, 2026 at 23:59 Anywhere on Earth (AOE), equivalent to September 22, 2026 at 11:59 UTC.
Method requirements: Post-processing is not allowed, and submitted methods must be applicable in real time.
Award selection: Awards are intended for research participants, including students and researchers in academia or industry. Novel methods will be prioritized. Award recipients must present their results at the workshop.
Awards
- 1st Place: TBD
- 2nd Place: TBD
- 3rd Place: TBD
Further details on awards, submission process, evaluation, and additional constraints will be announced soon.