Method Details
Details for method 'Scale invariant CNN + CRF'
Method overview
| name | Scale invariant CNN + CRF |
| challenge | pixel-level semantic labeling |
| details | We propose an effective technique to address large scale variation in images taken from a moving car by cross-breeding deep learning with stereo reconstruction. Our main contribution is a novel scale selection layer which extracts convolutional features at the scale which matches the corresponding reconstructed depth. The recovered scaleinvariant representation disentangles appearance from scale and frees the pixel-level classifier from the need to learn the laws of the perspective. This results in improved segmentation results due to more effi- cient exploitation of representation capacity and training data. We perform experiments on two challenging stereoscopic datasets (KITTI and Cityscapes) and report competitive class-level IoU performance. |
| publication | Convolutional Scale Invariance for Semantic Segmentation I. Kreso, D. Causevic, J. Krapac, and S. Segvic GCPR 2016 https://ivankreso.github.io/papers/kreso16gcpr.pdf |
| project page / code | https://github.com/ivankreso/scale-invariant-cnn |
| used Cityscapes data | fine annotations, stereo |
| used external data | ImageNet |
| runtime | n/a |
| subsampling | no |
| submission date | April, 2016 |
| previous submissions |
Average results
| Metric | Value |
|---|---|
| IoU Classes | 66.281 |
| iIoU Classes | 44.8593 |
| IoU Categories | 85.0125 |
| iIoU Categories | 71.1596 |
Class results
| Class | IoU | iIoU |
|---|---|---|
| road | 96.2716 | - |
| sidewalk | 76.792 | - |
| building | 88.8319 | - |
| wall | 40.0224 | - |
| fence | 45.4312 | - |
| pole | 50.1187 | - |
| traffic light | 63.3179 | - |
| traffic sign | 69.6063 | - |
| vegetation | 90.6168 | - |
| terrain | 67.1449 | - |
| sky | 92.197 | - |
| person | 77.6231 | 58.9594 |
| rider | 55.8633 | 40.0069 |
| car | 90.0512 | 84.011 |
| truck | 39.2087 | 19.7231 |
| bus | 51.3082 | 35.7663 |
| train | 44.4082 | 32.971 |
| motorcycle | 54.3873 | 35.9963 |
| bicycle | 66.1389 | 51.4409 |
Category results
| Category | IoU | iIoU |
|---|---|---|
| flat | 97.1543 | - |
| nature | 90.2285 | - |
| object | 59.931 | - |
| sky | 92.197 | - |
| construction | 89.0092 | - |
| human | 78.2105 | 60.5889 |
| vehicle | 88.3571 | 81.7302 |
