Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database

Classical methods used for signal detection in pharmacovigilance rely on disproportionality analysis of counts aggregating spontaneous reports of a given adverse drug reaction. In recent years, alternative methods have been proposed to analyze individual spontaneous reports such as penalized multipl...

Full description

Bibliographic Details
Main Authors: Émeline Courtois, Antoine Pariente, Francesco Salvo, Étienne Volatier, Pascale Tubert-Bitter, Ismaïl Ahmed
Format: Article
Language:English
Published: Frontiers Media S.A. 2018-09-01
Series:Frontiers in Pharmacology
Subjects:
FDR
Online Access:https://www.frontiersin.org/article/10.3389/fphar.2018.01010/full
id doaj-2e016fe370af40e783415268faa13451
record_format Article
spelling doaj-2e016fe370af40e783415268faa134512020-11-25T00:21:13ZengFrontiers Media S.A.Frontiers in Pharmacology1663-98122018-09-01910.3389/fphar.2018.01010333466Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting DatabaseÉmeline Courtois0Antoine Pariente1Francesco Salvo2Étienne Volatier3Pascale Tubert-Bitter4Ismaïl Ahmed5Biostatistics, Biomathematics, Pharmacoepidemiology and Infectious Diseases, INSERM, UVSQ (Université Paris-Saclay), Institut Pasteur, Villejuif, FranceBordeaux Population Health Research Center, Pharmacoepidemiology Team (UMR 1219), INSERM, University of Bordeaux, Bordeaux, FranceBordeaux Population Health Research Center, Pharmacoepidemiology Team (UMR 1219), INSERM, University of Bordeaux, Bordeaux, FranceBiostatistics, Biomathematics, Pharmacoepidemiology and Infectious Diseases, INSERM, UVSQ (Université Paris-Saclay), Institut Pasteur, Villejuif, FranceBiostatistics, Biomathematics, Pharmacoepidemiology and Infectious Diseases, INSERM, UVSQ (Université Paris-Saclay), Institut Pasteur, Villejuif, FranceBiostatistics, Biomathematics, Pharmacoepidemiology and Infectious Diseases, INSERM, UVSQ (Université Paris-Saclay), Institut Pasteur, Villejuif, FranceClassical methods used for signal detection in pharmacovigilance rely on disproportionality analysis of counts aggregating spontaneous reports of a given adverse drug reaction. In recent years, alternative methods have been proposed to analyze individual spontaneous reports such as penalized multiple logistic regression approaches. These approaches address some well-known biases resulting from disproportionality methods. However, while penalization accounts for computational constraints due to high-dimensional data, it raises the issue of determining the regularization parameter and eventually that of an error-controlling decision rule. We present a new automated signal detection strategy for pharmacovigilance systems, based on propensity scores (PS) in high dimension. PSs are increasingly used to assess a given association with high-dimensional observational healthcare databases in accounting for confusion bias. Our main aim was to develop a method having the same advantages as multiple regression approaches in dealing with bias, while relying on the statistical multiple comparison framework as regards decision thresholds, by considering false discovery rate (FDR)-based decision rules. We investigate four PS estimation methods in high dimension: a gradient tree boosting (GTB) algorithm from machine-learning and three variable selection algorithms. For each (drug, adverse event) pair, the PS is then applied as adjustment covariate or by using two kinds of weighting: inverse proportional treatment weighting and matching weights. The different versions of the new approach were compared to a univariate approach, which is a disproportionality method, and to two penalized multiple logistic regression approaches, directly applied on spontaneous reporting data. Performance was assessed through an empirical comparative study conducted on a reference signal set in the French national pharmacovigilance database (2000–2016) that was recently proposed for drug-induced liver injury. Multiple regression approaches performed better in detecting true positives and false positives. Nonetheless, the performances of the PS-based methods using matching weights was very similar to that of multiple regression and better than with the univariate approach. In addition to being able to control FDR statistical errors, the proposed PS-based strategy is an interesting alternative to multiple regression approaches.https://www.frontiersin.org/article/10.3389/fphar.2018.01010/fullpharmacovigilancesignal detectionpropensity score in high dimensionspontaneous reportspenalized multiple regressionFDR
collection DOAJ
language English
format Article
sources DOAJ
author Émeline Courtois
Antoine Pariente
Francesco Salvo
Étienne Volatier
Pascale Tubert-Bitter
Ismaïl Ahmed
spellingShingle Émeline Courtois
Antoine Pariente
Francesco Salvo
Étienne Volatier
Pascale Tubert-Bitter
Ismaïl Ahmed
Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
Frontiers in Pharmacology
pharmacovigilance
signal detection
propensity score in high dimension
spontaneous reports
penalized multiple regression
FDR
author_facet Émeline Courtois
Antoine Pariente
Francesco Salvo
Étienne Volatier
Pascale Tubert-Bitter
Ismaïl Ahmed
author_sort Émeline Courtois
title Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
title_short Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
title_full Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
title_fullStr Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
title_full_unstemmed Propensity Score-Based Approaches in High Dimension for Pharmacovigilance Signal Detection: an Empirical Comparison on the French Spontaneous Reporting Database
title_sort propensity score-based approaches in high dimension for pharmacovigilance signal detection: an empirical comparison on the french spontaneous reporting database
publisher Frontiers Media S.A.
series Frontiers in Pharmacology
issn 1663-9812
publishDate 2018-09-01
description Classical methods used for signal detection in pharmacovigilance rely on disproportionality analysis of counts aggregating spontaneous reports of a given adverse drug reaction. In recent years, alternative methods have been proposed to analyze individual spontaneous reports such as penalized multiple logistic regression approaches. These approaches address some well-known biases resulting from disproportionality methods. However, while penalization accounts for computational constraints due to high-dimensional data, it raises the issue of determining the regularization parameter and eventually that of an error-controlling decision rule. We present a new automated signal detection strategy for pharmacovigilance systems, based on propensity scores (PS) in high dimension. PSs are increasingly used to assess a given association with high-dimensional observational healthcare databases in accounting for confusion bias. Our main aim was to develop a method having the same advantages as multiple regression approaches in dealing with bias, while relying on the statistical multiple comparison framework as regards decision thresholds, by considering false discovery rate (FDR)-based decision rules. We investigate four PS estimation methods in high dimension: a gradient tree boosting (GTB) algorithm from machine-learning and three variable selection algorithms. For each (drug, adverse event) pair, the PS is then applied as adjustment covariate or by using two kinds of weighting: inverse proportional treatment weighting and matching weights. The different versions of the new approach were compared to a univariate approach, which is a disproportionality method, and to two penalized multiple logistic regression approaches, directly applied on spontaneous reporting data. Performance was assessed through an empirical comparative study conducted on a reference signal set in the French national pharmacovigilance database (2000–2016) that was recently proposed for drug-induced liver injury. Multiple regression approaches performed better in detecting true positives and false positives. Nonetheless, the performances of the PS-based methods using matching weights was very similar to that of multiple regression and better than with the univariate approach. In addition to being able to control FDR statistical errors, the proposed PS-based strategy is an interesting alternative to multiple regression approaches.
topic pharmacovigilance
signal detection
propensity score in high dimension
spontaneous reports
penalized multiple regression
FDR
url https://www.frontiersin.org/article/10.3389/fphar.2018.01010/full
work_keys_str_mv AT emelinecourtois propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
AT antoinepariente propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
AT francescosalvo propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
AT etiennevolatier propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
AT pascaletubertbitter propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
AT ismailahmed propensityscorebasedapproachesinhighdimensionforpharmacovigilancesignaldetectionanempiricalcomparisononthefrenchspontaneousreportingdatabase
_version_ 1725363264643137536