University of Surrey :: Centre for Vision, Speech and Signal Processing :: Karel Lebeda :: 3DCars benchmark ::

download data / submit results / view leader-board / synthetic data and results

Download data

The copyright of the 3DCars dataset is owned by The Centre for Vision, Speech and Signal Processing, University of Surrey, UK. Permission is hereby granted to use the 3DCars dataset or its part for academic purposes only, provided that it is referenced in publications related to its use as follows:
K. Lebeda, S. Hadfield, R. Bowden. 2D Or Not 2D: Bridging the Gap Between Tracking and Structure from Motion. In Proceedings of the Asian Conference on Computer Vision, 2015.

Download

Videos (75 MB), Ground truth, Evaluation script (including GT and example results).

Submit results

Submission address: K.Lebeda@Surrey (in case of any problems, try my personal address).

To be placed on the leader-board, please email us your results as returned by the evaluation script. Please copy&paste the results from your Matlab window into the email body and/or attach the created result file. In case you don't get a response within a few days, feel free to urge us.

If you want to have your submission marked as "confirmed", please send us the source code or binary of your implementation for a check. Your implementation will be used solely for the purpose of validating your benchmark entry; should you wish to discuss this issue, please reach us on the aforementioned address.

Leader Board

The following table shows quantitative results on the 3DCars dataset, given the ground truth. The tabulated values (for every tracker and sequence combination) are localisation error (distance of bounding box centres, in pixels) and overlap (of bounding boxes, in percent points).

Conf. Tracker 2D / 3D Doughnut Rally-Audi Rally-Lancer Rally-Opel Rally-OTS Rally-VW TopGear 1 TopGear 2 Average
YES LGT 2D 131.0/35 71.0/37 145.8/19 97.7/17 28.7/22 91.3/21 16.3/49 84.3/37 83.3/30
YES TLD 2D 63.9/56 18.21)/ 3 333.5/13 226.6/43 89.9/25 152.5/48 65.1/34 104.3/21 131.7/30
YES FoT 2D 181.7/44 212.4/33 734.5/13 165.9/38 116.2/29 196.9/39 80.4/41 117.9/29 225.7/33
YES TMAGIC 3D 87.9/57 110.2/48 94.3/53 44.0/52 48.9/59 47.6/62 40.0/56 34.7/59 63.5/56

1)TLD on Rally-Audi reported loss of tracking after only 3 frames.


Valid XHTML 1.0 Strict