Semantic Segmentation of Urban Scenes Using Spatial Contexts
This paper proposes a method for the joint inference of road layouts and the semantic segmentation of urban scenes by applying spatial contexts. The proposed method is based on the conjecture that a set of relevant elements in an urban environment contains a locational relationship among them. This...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9040269/ |
id |
doaj-61d4f262106f406489a6bd09013d1091 |
---|---|
record_format |
Article |
spelling |
doaj-61d4f262106f406489a6bd09013d10912021-03-30T01:21:57ZengIEEEIEEE Access2169-35362020-01-018552545526810.1109/ACCESS.2020.29816669040269Semantic Segmentation of Urban Scenes Using Spatial ContextsJeonghyeon Wang0https://orcid.org/0000-0002-4053-2306Jinwhan Kim1Robotics Program, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South KoreaDepartment of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South KoreaThis paper proposes a method for the joint inference of road layouts and the semantic segmentation of urban scenes by applying spatial contexts. The proposed method is based on the conjecture that a set of relevant elements in an urban environment contains a locational relationship among them. This relationship can be modeled as a location prior and label co-occurrences to help segment an image accurately. To apply these environmental characteristics, special coordinates referred to as road-normal coordinates are defined on the inferred road layout. These coordinates are determined by obtaining the most befitting road layout based on the marginal probability from the result of an existing segmentation algorithm. All possible segments in an image having depth information from the lidar sensor are projected into the road-normal coordinates, and the learned location prior and label co-occurrence statistics are applied to each segment as additional potentials of a conditional random field model. The proposed method is evaluated with the publicly available urban dataset including images and the corresponding point clouds.https://ieeexplore.ieee.org/document/9040269/Semantic segmentationlocation priorslabel co-occurrenceroad-normal coordinates |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jeonghyeon Wang Jinwhan Kim |
spellingShingle |
Jeonghyeon Wang Jinwhan Kim Semantic Segmentation of Urban Scenes Using Spatial Contexts IEEE Access Semantic segmentation location priors label co-occurrence road-normal coordinates |
author_facet |
Jeonghyeon Wang Jinwhan Kim |
author_sort |
Jeonghyeon Wang |
title |
Semantic Segmentation of Urban Scenes Using Spatial Contexts |
title_short |
Semantic Segmentation of Urban Scenes Using Spatial Contexts |
title_full |
Semantic Segmentation of Urban Scenes Using Spatial Contexts |
title_fullStr |
Semantic Segmentation of Urban Scenes Using Spatial Contexts |
title_full_unstemmed |
Semantic Segmentation of Urban Scenes Using Spatial Contexts |
title_sort |
semantic segmentation of urban scenes using spatial contexts |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
This paper proposes a method for the joint inference of road layouts and the semantic segmentation of urban scenes by applying spatial contexts. The proposed method is based on the conjecture that a set of relevant elements in an urban environment contains a locational relationship among them. This relationship can be modeled as a location prior and label co-occurrences to help segment an image accurately. To apply these environmental characteristics, special coordinates referred to as road-normal coordinates are defined on the inferred road layout. These coordinates are determined by obtaining the most befitting road layout based on the marginal probability from the result of an existing segmentation algorithm. All possible segments in an image having depth information from the lidar sensor are projected into the road-normal coordinates, and the learned location prior and label co-occurrence statistics are applied to each segment as additional potentials of a conditional random field model. The proposed method is evaluated with the publicly available urban dataset including images and the corresponding point clouds. |
topic |
Semantic segmentation location priors label co-occurrence road-normal coordinates |
url |
https://ieeexplore.ieee.org/document/9040269/ |
work_keys_str_mv |
AT jeonghyeonwang semanticsegmentationofurbanscenesusingspatialcontexts AT jinwhankim semanticsegmentationofurbanscenesusingspatialcontexts |
_version_ |
1724187140902879232 |