Method Details


Details for method 'MRFM'

 

Method overview

name MRFM
challenge pixel-level semantic labeling
details Semantic segmentation is one of the key tasks in comput- er vision, which is to assign a category label to each pixel in an image. Despite significant progress achieved recently, most existing methods still suffer from two challenging is- sues: 1) the size of objects and stuff in an image can be very diverse, demanding for incorporating multi-scale features into the fully convolutional networks (FCNs); 2) the pixel- s close to or at the boundaries of object/stuff are hard to classify due to the intrinsic weakness of convolutional net- works. To address the first issue, we propose a new Multi- Receptive Field Module (MRFM), explicitly taking multi- scale features into account. For the second issue, we design an edge-aware loss which is effective in distinguishing the boundaries of object/stuff. With these two designs, our Mul- ti Receptive Field Network achieves new state-of-the-art re- sults on two widely-used semantic segmentation benchmark datasets. Specifically, we achieve a mean IoU of 83.0% on the Cityscapes dataset and 88.4% mean IoU on the Pascal VOC2012 dataset.
publication Multi Receptive Field Network for Semantic Segmentation
Jianlong Yuan, Zelu Deng, Shu Wang, Zhenbo Luo
WACV2020
https://github.com/jianlong-yuan/MRFM
project page / code
used Cityscapes data fine annotations, coarse annotations
used external data
runtime n/a
subsampling no
submission date April, 2019
previous submissions

 

Average results

Metric Value
IoU Classes 82.9574
iIoU Classes 62.2141
IoU Categories 92.0421
iIoU Categories 82.0154

 

Class results

Class IoU iIoU
road 98.8 -
sidewalk 88.0024 -
building 94.2349 -
wall 63.8028 -
fence 64.7345 -
pole 72.249 -
traffic light 78.3417 -
traffic sign 81.8391 -
vegetation 94.1502 -
terrain 73.8695 -
sky 95.6843 -
person 88.3245 74.1299
rider 74.5622 54.728
car 96.4322 91.3081
truck 79.4738 47.7118
bus 92.164 57.0284
train 88.1155 53.8644
motorcycle 72.7978 51.374
bicycle 78.612 67.5684

 

Category results

Category IoU iIoU
flat 98.8132 -
nature 93.7504 -
object 77.6356 -
sky 95.6843 -
construction 94.11 -
human 88.3547 74.8295
vehicle 95.9461 89.2013

 

Links

Download results as .csv file

Benchmark page