Method Details


Details for method 'Deep Layer Cascade (LC)'

 

Method overview

name Deep Layer Cascade (LC)
challenge pixel-level semantic labeling
details We propose a novel deep layer cascade (LC) method to improve the accuracy and speed of semantic segmentation. Unlike the conventional model cascade (MC) that is composed of multiple independent models, LC treats a single deep model as a cascade of several sub-models. Earlier sub-models are trained to handle easy and confident regions, and they progressively feed-forward harder regions to the next sub-model for processing. Convolutions are only calculated on these regions to reduce computations. The proposed method possesses several advantages. First, LC classifies most of the easy regions in the shallow stage and makes deeper stage focuses on a few hard regions. Such an adaptive and 'difficulty-aware' learning improves segmentation performance. Second, LC accelerates both training and testing of deep network thanks to early decisions in the shallow stage. Third, in comparison to MC, LC is an end-to-end trainable framework, allowing joint learning of all sub-models. We evaluate our method on PASCAL VOC and
publication Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascade
Xiaoxiao Li, Ziwei Liu, Ping Luo, Chen Change Loy, Xiaoou Tang
CVPR 2017
https://arxiv.org/abs/1704.01344
project page / code
used Cityscapes data fine annotations
used external data ImageNet
runtime n/a
subsampling no
submission date November, 2016
previous submissions

 

Average results

Metric Value
IoU Classes 71.0873
iIoU Classes 47.0059
IoU Categories 88.1093
iIoU Categories 74.1373

 

Class results

Class IoU iIoU
road 98.0943 -
sidewalk 82.7777 -
building 91.1705 -
wall 47.0663 -
fence 52.8011 -
pole 57.3194 -
traffic light 63.8946 -
traffic sign 70.6799 -
vegetation 92.4828 -
terrain 70.5149 -
sky 94.1945 -
person 81.2132 60.4551
rider 57.9176 36.0679
car 94.0807 87.9179
truck 50.1397 26.0923
bus 59.5682 42.1022
train 57.034 32.2838
motorcycle 58.6405 35.1202
bicycle 71.0684 56.0078

 

Category results

Category IoU iIoU
flat 98.4356 -
nature 92.1254 -
object 64.5369 -
sky 94.1945 -
construction 91.5332 -
human 82.4686 62.0367
vehicle 93.4706 86.2379

 

Links

Download results as .csv file

Benchmark page