Method Details

Details for method 'RelationNet_Coarse'

name	RelationNet_Coarse
challenge	pixel-level semantic labeling
details	Semantic image segmentation, which assigns labels in pixel level, plays a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep learning. However, one central problem of these methods is that deep convolution neural network gives little consideration to the correlation among pixels. To handle this issue, in this paper, we propose a novel deep neural network named RelationNet, which utilizes CNN and RNN to aggregate context information. Besides, a spatial correlation loss is applied to supervise RelationNet to align features of spatial pixels belonging to same category. Importantly, since it is expensive to obtain pixel-wise annotations, we exploit a new training method for combining the coarsely and finely labeled data. Separate experiments show the detailed improvements of each proposal. Experimental results demonstrate the effectiveness of our proposed method to the problem of semantic image segmentation.
publication	RelationNet: Learning Deep-Aligned Representation for Semantic Image Segmentation Yueqing Zhuang ICPR
project page / code
used Cityscapes data	fine annotations, coarse annotations
used external data	ImageNet
runtime	n/a
subsampling	no
submission date	December, 2017
previous submissions