Transformer-Based Global Zenith Tropospheric Delay Forecasting Model

Zenith tropospheric delay (ZTD) plays an important role in high-precision global navigation satellite system (GNSS) positioning and meteorology. At present, commonly used ZTD forecasting models comprise empirical, meteorological parameter, and neural network models. The empirical model can only fit...

詳細記述

書誌詳細
出版年:Remote Sensing
主要な著者: Huan Zhang, Yibin Yao, Chaoqian Xu, Wei Xu, Junbo Shi
フォーマット: 論文
言語:英語
出版事項: MDPI AG 2022-07-01
主題:
オンライン・アクセス:https://www.mdpi.com/2072-4292/14/14/3335
_version_ 1851940963193192448
author Huan Zhang
Yibin Yao
Chaoqian Xu
Wei Xu
Junbo Shi
author_facet Huan Zhang
Yibin Yao
Chaoqian Xu
Wei Xu
Junbo Shi
author_sort Huan Zhang
collection DOAJ
container_title Remote Sensing
description Zenith tropospheric delay (ZTD) plays an important role in high-precision global navigation satellite system (GNSS) positioning and meteorology. At present, commonly used ZTD forecasting models comprise empirical, meteorological parameter, and neural network models. The empirical model can only fit approximate periodic variations, and its accuracy is relatively low. The accuracy of the meteorological parameter model depends heavily on the accuracy of the meteorological parameters. The recurrent neural network (RNN) is suitable for short-term series data prediction, but for long-term series, the ZTD prediction accuracy is clearly reduced. Long short-term memory (LSTM) has superior forecasting accuracy for long-term ZTD series; however, the LSTM model is complex, cannot be parallelized, and is time-consuming. In this study, we propose a novel ZTD time-series forecasting utilizing transformer-based machine-learning methods that are popular in natural language processing (NLP) and forecasting global ZTD, the training parameters provided by the global geodetic observing system (GGOS). The proposed transformer model leverages self-attention mechanisms by encoder and decoder modules to learn complex patterns and dynamics from long ZTD time series. The numeric results showed that the root mean square error (RMSE) of the forecasting ZTD results were 1.8 cm and mean bias, STD, MAE, and R 0.0, 1.7, 1.3, and 0.95, respectively, which is superior to that of the LSTM, RNN, convolutional neural network (CNN), and GPT3 series models. We investigated the global distribution of these accuracy indicators, and the results demonstrated that the accuracy in continents was superior to maritime space transformer ZTD forecasting model accuracy at high latitudes superior to that at low latitude. In addition to the overall accuracy improvement, the proposed transformer ZTD forecast model also mitigates the accuracy variations in space and time, thereby guaranteeing high accuracy globally. This study provides a novel method to estimate the ZTD, which could potentially contribute to precise GNSS positioning and meteorology.
format Article
id doaj-art-5cee7bcd9503475eade2ce18f9bfcd1d
institution Directory of Open Access Journals
issn 2072-4292
language English
publishDate 2022-07-01
publisher MDPI AG
record_format Article
spelling doaj-art-5cee7bcd9503475eade2ce18f9bfcd1d2025-08-19T21:50:28ZengMDPI AGRemote Sensing2072-42922022-07-011414333510.3390/rs14143335Transformer-Based Global Zenith Tropospheric Delay Forecasting ModelHuan Zhang0Yibin Yao1Chaoqian Xu2Wei Xu3Junbo Shi4School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaSchool of Business and Administration, North China Electric Power University, Baoding 071003, ChinaSchool of Geodesy and Geomatics, Wuhan University, Wuhan 430079, ChinaZenith tropospheric delay (ZTD) plays an important role in high-precision global navigation satellite system (GNSS) positioning and meteorology. At present, commonly used ZTD forecasting models comprise empirical, meteorological parameter, and neural network models. The empirical model can only fit approximate periodic variations, and its accuracy is relatively low. The accuracy of the meteorological parameter model depends heavily on the accuracy of the meteorological parameters. The recurrent neural network (RNN) is suitable for short-term series data prediction, but for long-term series, the ZTD prediction accuracy is clearly reduced. Long short-term memory (LSTM) has superior forecasting accuracy for long-term ZTD series; however, the LSTM model is complex, cannot be parallelized, and is time-consuming. In this study, we propose a novel ZTD time-series forecasting utilizing transformer-based machine-learning methods that are popular in natural language processing (NLP) and forecasting global ZTD, the training parameters provided by the global geodetic observing system (GGOS). The proposed transformer model leverages self-attention mechanisms by encoder and decoder modules to learn complex patterns and dynamics from long ZTD time series. The numeric results showed that the root mean square error (RMSE) of the forecasting ZTD results were 1.8 cm and mean bias, STD, MAE, and R 0.0, 1.7, 1.3, and 0.95, respectively, which is superior to that of the LSTM, RNN, convolutional neural network (CNN), and GPT3 series models. We investigated the global distribution of these accuracy indicators, and the results demonstrated that the accuracy in continents was superior to maritime space transformer ZTD forecasting model accuracy at high latitudes superior to that at low latitude. In addition to the overall accuracy improvement, the proposed transformer ZTD forecast model also mitigates the accuracy variations in space and time, thereby guaranteeing high accuracy globally. This study provides a novel method to estimate the ZTD, which could potentially contribute to precise GNSS positioning and meteorology.https://www.mdpi.com/2072-4292/14/14/3335zenith tropospheric delayrecurrent neural networklong short-term memorytransformerzenith tropospheric delay forecasting
spellingShingle Huan Zhang
Yibin Yao
Chaoqian Xu
Wei Xu
Junbo Shi
Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
zenith tropospheric delay
recurrent neural network
long short-term memory
transformer
zenith tropospheric delay forecasting
title Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
title_full Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
title_fullStr Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
title_full_unstemmed Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
title_short Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
title_sort transformer based global zenith tropospheric delay forecasting model
topic zenith tropospheric delay
recurrent neural network
long short-term memory
transformer
zenith tropospheric delay forecasting
url https://www.mdpi.com/2072-4292/14/14/3335
work_keys_str_mv AT huanzhang transformerbasedglobalzenithtroposphericdelayforecastingmodel
AT yibinyao transformerbasedglobalzenithtroposphericdelayforecastingmodel
AT chaoqianxu transformerbasedglobalzenithtroposphericdelayforecastingmodel
AT weixu transformerbasedglobalzenithtroposphericdelayforecastingmodel
AT junboshi transformerbasedglobalzenithtroposphericdelayforecastingmodel