Method Details


Details for method 'ENet with the Lovász-Softmax loss'

 

Method overview

name ENet with the Lovász-Softmax loss
challenge pixel-level semantic labeling
details The Lovász-Softmax loss is a novel surrogate for optimizing the IoU measure in neural networks. Here we finetune the weights provided by the authors of ENet (arXiv:1606.02147) with this loss, for 10'000 iterations on training dataset. The runtimes are unchanged with respect to the ENet architecture.
publication The Lovász-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks
Maxim Berman, Amal Rannen Triki, Matthew B. Blaschko
arxiv
https://arxiv.org/abs/1705.08790
project page / code https://github.com/bermanmaxim/jaccardSegment
used Cityscapes data fine annotations
used external data
runtime 0.013 s
Titan X
subsampling 2
submission date January, 2018
previous submissions

 

Average results

Metric Value
IoU Classes 63.0688
iIoU Classes 34.068
IoU Categories 83.5801
iIoU Categories 61.0457

 

Class results

Class IoU iIoU
road 97.2726 -
sidewalk 77.1999 -
building 87.2229 -
wall 36.0573 -
fence 38.9875 -
pole 48.5271 -
traffic light 51.9527 -
traffic sign 58.0642 -
vegetation 89.9274 -
terrain 67.7387 -
sky 92.7402 -
person 71.3531 42.8165
rider 49.6112 26.2903
car 91.0136 79.4057
truck 39.3755 18.0535
bus 49.3227 25.8609
train 50.5174 21.7427
motorcycle 41.6142 22.0658
bicycle 59.8086 36.3086

 

Category results

Category IoU iIoU
flat 97.9788 -
nature 89.636 -
object 54.5008 -
sky 92.7402 -
construction 87.6349 -
human 72.8364 45.0031
vehicle 89.734 77.0883

 

Links

Download results as .csv file

Benchmark page