Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms

With the great progress made recently in next generation sequencing (NGS) technology, sequencing accuracy and throughput have increased, while the cost for data has decreased. Various human leukocyte antigen (HLA) typing algorithms and assays have been developed and have begun to be used in clinical...

Full description

Bibliographic Details
Main Authors: Ping Liu, Minya Yao, Yu Gong, Yunjie Song, Yanan Chen, Yizhou Ye, Xiao Liu, Fugen Li, Hua Dong, Rui Meng, Hao Chen, Aiwen Zheng
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-03-01
Series:Frontiers in Immunology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fimmu.2021.652258/full
id doaj-b6e896f3c8994897a525104aa0d4b3a4
record_format Article
spelling doaj-b6e896f3c8994897a525104aa0d4b3a42021-03-31T14:42:26ZengFrontiers Media S.A.Frontiers in Immunology1664-32242021-03-011210.3389/fimmu.2021.652258652258Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based AlgorithmsPing Liu0Minya Yao1Yu Gong2Yunjie Song3Yanan Chen4Yizhou Ye5Xiao Liu6Fugen Li7Hua Dong8Rui Meng9Hao Chen10Aiwen Zheng11Aiwen Zheng12Department of Oncology, The Second Xiangya Hospital of Central South University, Changsha, ChinaThe First Affiliated Hospital of Zhejiang University, School of Medicine, Hangzhou, ChinaDepartment of Urology, Second Affiliated Hospital, Zhejiang University College of Medicine, Hangzhou, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaTongji Medical College, Huazhong University of Science and Technology, Wuhan, ChinaThe Bioinformatics Department, 3DMed Inc., Shanghai, ChinaCancer Hospital of the University of Chinese Academy of Sciences (Zhejiang Cancer Hospital), Hangzhou, ChinaInstitute of Cancer and Basic Medicine (IBMC), Chinese Academy of Sciences, Hangzhou, ChinaWith the great progress made recently in next generation sequencing (NGS) technology, sequencing accuracy and throughput have increased, while the cost for data has decreased. Various human leukocyte antigen (HLA) typing algorithms and assays have been developed and have begun to be used in clinical practice. In this study, we compared the HLA typing performance of three HLA assays and seven NGS-based HLA algorithms and assessed the impact of sequencing depth and length on HLA typing accuracy based on 24 benchmarked samples. The algorithms HISAT-genotype and HLA-HD showed the highest accuracy at both the first field and the second field resolution, followed by HLAscan. Our internal capture-based HLA assay showed comparable performance with whole exome sequencing (WES). We found that the minimal depth was 100X for HISAT-genotype and HLA-HD to obtain more than 90% accuracy at the third field level. The top three algorithms were quite robust to the change of read length. Thus, we recommend using HISAT-genotype and HLA-HD for NGS-based HLA genotyping because of their higher accuracy and robustness to read length. We propose that a minimal sequence depth for obtaining more than 90% HLA typing accuracy at the third field level is 100X. Besides, targeting capture-based NGS HLA typing may be more suitable than WES in clinical practice due to its lower sequencing cost and higher HLA sequencing depth.https://www.frontiersin.org/articles/10.3389/fimmu.2021.652258/fullhuman leukocyte antigenaccuracynext-generation sequencingalgorithmsbenchmark
collection DOAJ
language English
format Article
sources DOAJ
author Ping Liu
Minya Yao
Yu Gong
Yunjie Song
Yanan Chen
Yizhou Ye
Xiao Liu
Fugen Li
Hua Dong
Rui Meng
Hao Chen
Aiwen Zheng
Aiwen Zheng
spellingShingle Ping Liu
Minya Yao
Yu Gong
Yunjie Song
Yanan Chen
Yizhou Ye
Xiao Liu
Fugen Li
Hua Dong
Rui Meng
Hao Chen
Aiwen Zheng
Aiwen Zheng
Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
Frontiers in Immunology
human leukocyte antigen
accuracy
next-generation sequencing
algorithms
benchmark
author_facet Ping Liu
Minya Yao
Yu Gong
Yunjie Song
Yanan Chen
Yizhou Ye
Xiao Liu
Fugen Li
Hua Dong
Rui Meng
Hao Chen
Aiwen Zheng
Aiwen Zheng
author_sort Ping Liu
title Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
title_short Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
title_full Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
title_fullStr Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
title_full_unstemmed Benchmarking the Human Leukocyte Antigen Typing Performance of Three Assays and Seven Next-Generation Sequencing-Based Algorithms
title_sort benchmarking the human leukocyte antigen typing performance of three assays and seven next-generation sequencing-based algorithms
publisher Frontiers Media S.A.
series Frontiers in Immunology
issn 1664-3224
publishDate 2021-03-01
description With the great progress made recently in next generation sequencing (NGS) technology, sequencing accuracy and throughput have increased, while the cost for data has decreased. Various human leukocyte antigen (HLA) typing algorithms and assays have been developed and have begun to be used in clinical practice. In this study, we compared the HLA typing performance of three HLA assays and seven NGS-based HLA algorithms and assessed the impact of sequencing depth and length on HLA typing accuracy based on 24 benchmarked samples. The algorithms HISAT-genotype and HLA-HD showed the highest accuracy at both the first field and the second field resolution, followed by HLAscan. Our internal capture-based HLA assay showed comparable performance with whole exome sequencing (WES). We found that the minimal depth was 100X for HISAT-genotype and HLA-HD to obtain more than 90% accuracy at the third field level. The top three algorithms were quite robust to the change of read length. Thus, we recommend using HISAT-genotype and HLA-HD for NGS-based HLA genotyping because of their higher accuracy and robustness to read length. We propose that a minimal sequence depth for obtaining more than 90% HLA typing accuracy at the third field level is 100X. Besides, targeting capture-based NGS HLA typing may be more suitable than WES in clinical practice due to its lower sequencing cost and higher HLA sequencing depth.
topic human leukocyte antigen
accuracy
next-generation sequencing
algorithms
benchmark
url https://www.frontiersin.org/articles/10.3389/fimmu.2021.652258/full
work_keys_str_mv AT pingliu benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT minyayao benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT yugong benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT yunjiesong benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT yananchen benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT yizhouye benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT xiaoliu benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT fugenli benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT huadong benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT ruimeng benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT haochen benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT aiwenzheng benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
AT aiwenzheng benchmarkingthehumanleukocyteantigentypingperformanceofthreeassaysandsevennextgenerationsequencingbasedalgorithms
_version_ 1724177569907998720