Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing
Path tracing is a commonly used but computationally highly expensive stochastic ray tracing method for rendering photorealistic visual content. Combined with a real-time constraint, for example in stereoscopic virtual/augmented reality applications, it typically limits us to rendering at most a few...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9144193/ |
id |
doaj-16ddfa82842640cfb5be4040b1b2a944 |
---|---|
record_format |
Article |
spelling |
doaj-16ddfa82842640cfb5be4040b1b2a9442021-03-30T04:42:47ZengIEEEIEEE Access2169-35362020-01-01813351413352610.1109/ACCESS.2020.30104529144193Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path TracingMarkku J. Makitalo0https://orcid.org/0000-0001-8164-0031Petrus E. J. Kivi1https://orcid.org/0000-0001-9680-7113Pekka O. Jaaskelainen2https://orcid.org/0000-0001-5707-8544Unit of Computing Sciences, Tampere University, Tampere, FinlandUnit of Computing Sciences, Tampere University, Tampere, FinlandUnit of Computing Sciences, Tampere University, Tampere, FinlandPath tracing is a commonly used but computationally highly expensive stochastic ray tracing method for rendering photorealistic visual content. Combined with a real-time constraint, for example in stereoscopic virtual/augmented reality applications, it typically limits us to rendering at most a few samples per pixel, yielding very noisy results. However, the spatial and temporal redundancies are commonly utilized by reprojecting existing samples between different viewpoints and frames, thus cheaply improving the quality. We provide new insights to the quality benefits of reprojection by systematically evaluating the effective quality of spatiotemporally reprojected stereoscopic path traced data. We show that spatiotemporal reprojection increases the quality of 1 sample per pixel (spp) data by almost a factor of 25 on average, in terms of the effective spp count of the result. Since we are able to reproject 94-98% of the samples, only the remaining 2-6% of the samples in the target frame need to be path traced. We also evaluate how the quality improvement gained through spatiotemporal reprojection scales as the number of input samples per pixel increases, showing that the highest gains are achieved at the lowest input spp counts. Finally, we show how blending existing path traced data and stereoscopically reprojected data further improves the quality of spatiotemporal reprojection, on average yielding a 47% higher effective spp than without blending.https://ieeexplore.ieee.org/document/9144193/Computer graphicspath tracingray tracingreal-time renderingstereoscopic |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Markku J. Makitalo Petrus E. J. Kivi Pekka O. Jaaskelainen |
spellingShingle |
Markku J. Makitalo Petrus E. J. Kivi Pekka O. Jaaskelainen Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing IEEE Access Computer graphics path tracing ray tracing real-time rendering stereoscopic |
author_facet |
Markku J. Makitalo Petrus E. J. Kivi Pekka O. Jaaskelainen |
author_sort |
Markku J. Makitalo |
title |
Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing |
title_short |
Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing |
title_full |
Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing |
title_fullStr |
Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing |
title_full_unstemmed |
Systematic Evaluation of the Quality Benefits of Spatiotemporal Sample Reprojection in Real-Time Stereoscopic Path Tracing |
title_sort |
systematic evaluation of the quality benefits of spatiotemporal sample reprojection in real-time stereoscopic path tracing |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Path tracing is a commonly used but computationally highly expensive stochastic ray tracing method for rendering photorealistic visual content. Combined with a real-time constraint, for example in stereoscopic virtual/augmented reality applications, it typically limits us to rendering at most a few samples per pixel, yielding very noisy results. However, the spatial and temporal redundancies are commonly utilized by reprojecting existing samples between different viewpoints and frames, thus cheaply improving the quality. We provide new insights to the quality benefits of reprojection by systematically evaluating the effective quality of spatiotemporally reprojected stereoscopic path traced data. We show that spatiotemporal reprojection increases the quality of 1 sample per pixel (spp) data by almost a factor of 25 on average, in terms of the effective spp count of the result. Since we are able to reproject 94-98% of the samples, only the remaining 2-6% of the samples in the target frame need to be path traced. We also evaluate how the quality improvement gained through spatiotemporal reprojection scales as the number of input samples per pixel increases, showing that the highest gains are achieved at the lowest input spp counts. Finally, we show how blending existing path traced data and stereoscopically reprojected data further improves the quality of spatiotemporal reprojection, on average yielding a 47% higher effective spp than without blending. |
topic |
Computer graphics path tracing ray tracing real-time rendering stereoscopic |
url |
https://ieeexplore.ieee.org/document/9144193/ |
work_keys_str_mv |
AT markkujmakitalo systematicevaluationofthequalitybenefitsofspatiotemporalsamplereprojectioninrealtimestereoscopicpathtracing AT petrusejkivi systematicevaluationofthequalitybenefitsofspatiotemporalsamplereprojectioninrealtimestereoscopicpathtracing AT pekkaojaaskelainen systematicevaluationofthequalitybenefitsofspatiotemporalsamplereprojectioninrealtimestereoscopicpathtracing |
_version_ |
1724181294587314176 |