Abstract
This study aimed to identify biomarkers of major depressive disorder (MDD), by relating neuroimage-derived measures to binary (MDD/control), ordinal (severe MDD/mild MDD/control), or continuous (depression severity) outcomes. To address MDD heterogeneity, factors (severity of psychic depression, motivation, anxiety, psychosis, and sleep disturbance) were also used as outcomes. A multisite, multimodal imaging (diffusion MRI [dMRI] and structural MRI [sMRI]) cohort (52 controls and 147 MDD patients) and several modeling techniques—penalized logistic regression, random forest, and support vector machine (SVM)—were used. An additional cohort (25 controls and 83 MDD patients) was used for validation. The optimally performing classifier (SVM) had a 26.0% misclassification rate (binary), 52.2 ± 1.69% accuracy (ordinal) and r =.36 correlation coefficient (p <.001, continuous). Using SVM, R2 values for prediction of any MDD factors were <10%. Binary classification in the external data set resulted in 87.95% sensitivity and 32.00% specificity. Though observed classification rates are too low for clinical utility, four image-based features contributed to accuracy across all models and analyses—two dMRI-based measures (average fractional anisotropy in the right cuneus and left insula) and two sMRI-based measures (asymmetry in the volume of the pars triangularis and the cerebellum) and may serve as a priori regions for future analyses. The poor accuracy of classification and predictive results found here reflects current equivocal findings and sheds light on challenges of using these modalities for MDD biomarker identification. Further, this study suggests a paradigm (e.g., multiple classifier evaluation with external validation) for future studies to avoid nongeneralizable results.
Original language | English (US) |
---|---|
Pages (from-to) | 4420-4439 |
Number of pages | 20 |
Journal | Human Brain Mapping |
Volume | 39 |
Issue number | 11 |
DOIs | |
State | Published - Nov 2018 |
Keywords
- diffusion MRI
- magnetic resonance imaging
- major depressive disorder
- structural MRI
- support vector machine
ASJC Scopus subject areas
- Anatomy
- Radiological and Ultrasound Technology
- Radiology Nuclear Medicine and imaging
- Neurology
- Clinical Neurology
Fingerprint
Dive into the research topics of 'Development and evaluation of a multimodal marker of major depressive disorder'. Together they form a unique fingerprint.Cite this
- APA
- Standard
- Harvard
- Vancouver
- Author
- BIBTEX
- RIS
In: Human Brain Mapping, Vol. 39, No. 11, 11.2018, p. 4420-4439.
Research output: Contribution to journal › Article › peer-review
}
TY - JOUR
T1 - Development and evaluation of a multimodal marker of major depressive disorder
AU - Yang, Jie
AU - Zhang, Mengru
AU - Ahn, Hongshik
AU - Zhang, Qing
AU - Jin, Tony B.
AU - Li, Ien
AU - Nemesure, Matthew
AU - Joshi, Nandita
AU - Jiang, Haoran
AU - Miller, Jeffrey M.
AU - Ogden, Robert Todd
AU - Petkova, Eva
AU - Milak, Matthew S.
AU - Sublette, Mary Elizabeth
AU - Sullivan, Gregory M.
AU - Trivedi, Madhukar H.
AU - Weissman, Myrna
AU - McGrath, Patrick J.
AU - Fava, Maurizio
AU - Kurian, Benji T.
AU - Pizzagalli, Diego A.
AU - Cooper, Crystal M.
AU - McInnis, Melvin
AU - Oquendo, Maria A.
AU - Mann, Joseph John
AU - Parsey, Ramin V.
AU - DeLorenzo, Christine
N1 - Funding Information: Dr. McGrath has received funding from the National Institute of Mental Health, New York State Department of Mental Hygiene, Research Foundation for Mental Hygiene (New York State), Forest Research Laboratories, Sunovion Pharmaceuticals, and Naurex Pharmaceuticals (now Allergan). Funding Information: National Institute of Mental Health, Grant/ Award Numbers: K08 MH067015, K08 MH076258, K08 MH079033, P50 MH62185, R01 MH040695, R01 MH074813, U01 MH092250; Stony Brook School of Medicine and the Office of the Vice President for Research, Targeted Research Opportunity Program - FUSION Award; National Center for Funding Information: We would like to thank Rose Boyle and Alexander Hogenhuis for their diligent work performing literature searches and aiding in the development of this manuscript. We acknowledge the biostatistical consultation and support provided by the Biostatistical Consulting Core at School of Medicine, Stony Brook University. This publication was supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through grant number UL1 TR000040. This work was also supported by U01 MH092250 (EMBARC, PIs: Weissman, Parsey, McGrath), P50 MH62185 and R01 MH040695 (PI: Mann), K08 MH079033 (PI: Sublette), K08 MH076258 (PI: Milak), K08 MH067015 (PI: Sullivan), R01 MH074813 (PI: Parsey) as well as the Stony Brook School of Medicine and the Office of the Vice President for Research through the Targeted Research Opportunity Program – FUSION Award (PIs: DeLorenzo, Ahn, Yang). Funding Information: We would like to thank Rose Boyle and Alexander Hogenhuis for their diligent work performing literature searches and aiding in the development of this manuscript. We acknowledge the biostatistical consultation and support provided by the Biostatistical Consulting Core at School of Medicine, Stony Brook University. This publication was supported by the National Center for Advancing Translational Sciences, National Institutes of Health, through grant number UL1 TR000040. This work was also supported by U01 MH092250 (EMBARC, PIs: Weissman, Parsey, McGrath), P50 MH62185 and R01 MH040695 (PI: Mann), K08 MH079033 (PI: Sublette), K08 MH076258 (PI: Milak), K08 MH067015 (PI: Sullivan), R01 MH074813 (PI: Parsey) as well as the Stony Brook School of Medicine and the Office of the Vice President for Research through the Targeted Research Opportunity Program – FUSION Award (PIs: DeLorenzo, Ahn, Yang). Dr. Miller reports receiving financial compensation for psychiatric evaluations of patients enrolled in medication studies sponsored by Pfizer and Orexigen Therapeutics and family ownership of stock in Johnson & Johnson. Dr. Trivedi is or has been an advisor/consultant and received fees from (lifetime disclosure): Abbott Laboratories, Inc., Abdi Ibrahim, Akzo (Organon Pharmaceuticals Inc.), Alkermes, AstraZeneca, Axon Advisors, Bristol-Myers Squibb Company, Cephalon, Inc., Cerecor, CME Institute of Physicians, Concert Pharmaceuticals, Inc., Eli Lilly & Company, Evotec, Fabre Kramer Pharmaceuticals, Inc., Forest Pharmaceuticals, GlaxoSmithKline, Janssen Global Services, LLC, Janssen Pharmaceutica Products, LP, Johnson & Johnson PRD, Libby, Lundbeck, Meade Johnson, MedAvante, Medtronic, Merck, Mitsubishi Tanabe Pharma Development America, Inc., Naurex, Neuronetics, Otsuka Pharmaceuticals, Pamlab, Parke-Davis Pharmaceuticals, Inc., Pfizer Inc., PgxHealth, Phoenix Marketing Solutions, Rexahn Pharmaceuticals, Ridge Diagnostics, Roche Products Ltd., Sepracor, SHIRE Development, Sierra, SK Life and Science, Sunovion, Takeda, Tal Medical/Puretech Venture, Targacept, Transcept, VantagePoint, Vivus, and Wyeth-Ayerst Laboratories. In addition, he has received grants/research support from: Agency for Healthcare Research and Quality (AHRQ), Cyberonics, Inc., National Alliance for Research in Schizophrenia and Depression, National Institute of Mental Health and National Institute on Drug Abuse. In the past 2 years, Dr. Weissman received funding from the National Institute of Mental Health (NIMH), the National Alliance for Research on Schizophrenia and Depression (NARSAD), the Sackler Foundation, the Templeton Foundation; and receives royalties from the Oxford University Press, Perseus Press, the American Psychiatric Association Press, and MultiHealth Systems. Dr. McGrath has received funding from the National Institute of Mental Health, New York State Department of Mental Hygiene, Research Foundation for Mental Hygiene (New York State), Forest Research Laboratories, Sunovion Pharmaceuticals, and Naurex Pharmaceuticals (now Allergan). Dr. Fava has received research support from Abbot Laboratories; Alkermes, Inc.; American Cyanamid; Aspect Medical Systems; AstraZeneca; Avanir Pharmaceuticals; BioResearch; BrainCells Inc.; Bristol-Myers Squibb; CeNeRx BioPharma; Cephalon; Clintara, LLC; Cerecor; Covance; Covidien; Eli Lilly and Company; EnVivo Pharmaceuticals, Inc.; Euthymics Bioscience, Inc.; Forest Pharmaceuticals, Inc.; Ganeden Biotech, Inc.; GlaxoSmithKline; Harvard Clinical Research Institute; Hoffman-LaRoche; Icon Clinical Research; i3 Innovus/Ingenix; Janssen R&D, LLC; Jed Foundation; Johnson & Johnson Pharmaceutical Research & Development; Lichtwer Pharma GmbH; Lorex Pharmaceuticals; Lundbeck Inc.; MedAvante; Methylation Sciences Inc.; National Alliance for Research on Schizophrenia & Depression (NARSAD); National Center for Complementary and Alternative Medicine (NCCAM); National Institute of Drug Abuse (NIDA); National Institute of Mental Health (NIMH); Neuralstem, Inc.; Novartis AG; Organon Pharmaceuticals; PamLab, LLC.; Pfizer Inc.; Pharmacia-Upjohn; Pharmaceutical Research Associates., Inc.; Pharmavite® LLC; PharmoRx Therapeutics; Photothera; Reckitt Benckiser; Roche Pharmaceuticals; RCT Logic, LLC (formerly Clinical Trials Solutions, LLC); Sanofi-Aventis US LLC; Shire; Solvay Pharmaceuticals, Inc.; Stanley Medical Research Institute (SMRI); Synthelabo; Tal Medical; Wyeth-Ayerst Laboratories; he has served as advisor or consultant to Abbott Laboratories; Acadia; Affectis Pharmaceuticals AG; Alkermes, Inc.; Amarin Pharma Inc.; Aspect Medical Systems; AstraZeneca; Auspex Pharmaceuticals; Avanir Pharmaceuticals; AXSOME Therapeutics; Bayer AG; Best Practice Project Management, Inc.; Biogen; BioMarin Pharmaceuticals, Inc.; Biovail Corporation; BrainCells Inc; Bristol-Myers Squibb; CeNeRx BioPharma; Cephalon, Inc.; Cerecor; CNS Response, Inc.; Compellis Pharmaceuticals; Cypress Pharmaceutical, Inc.; DiagnoSearch Life Sciences (P) Ltd.; Dinippon Sumitomo Pharma Co. Inc.; Dov Pharmaceuticals, Inc.; Edgemont Pharmaceuticals, Inc.; Eisai Inc.; Eli Lilly and Company; EnVivo Pharmaceuticals, Inc.; ePharmaSolutions; EPIX Pharmaceuticals, Inc.; Euthymics Bioscience, Inc.; Fabre-Kramer Pharmaceuticals, Inc.; Forest Pharmaceuticals, Inc.; Forum Pharmaceuticals; GenOmind, LLC; GlaxoSmithKline; Grunenthal GmbH; i3 Innovus/Ingenis; Intracellular; Janssen Pharmaceutica; Jazz Pharmaceuticals, Inc.; Johnson & Johnson Pharmaceutical Research & Development, LLC; Knoll Pharmaceuticals Corp.; Labopharm Inc.; Lorex Pharmaceuticals; Lundbeck Inc.; MedAvante, Inc.; Merck & Co., Inc.; MSI Methylation Sciences, Inc.; Naurex, Inc.; Nestle Health Sciences; Neuralstem, Inc.; Neuronetics, Inc.; NextWave Pharmaceuticals; Novartis AG; Nutrition 21; Orexigen Therapeutics, Inc.; Organon Pharmaceuticals; Osmotica; Otsuka Pharmaceuticals; Pamlab, LLC.; Pfizer Inc.; PharmaStar; Pharmavite® LLC.; PharmoRx Therapeutics; Precision Human Biolaboratory; Prexa Pharmaceuticals, Inc.; Puretech Ventures; PsychoGenics; Psylin Neurosciences, Inc.; RCT Logic, LLC Formerly Clinical Trials Solutions, LLC; Rexahn Pharmaceuticals, Inc.; Ridge Diagnostics, Inc.; Roche; Sanofi-Aventis US LLC.; Sepracor Inc.; Servier Laboratories; Schering-Plow Corporation; Solvay Pharmaceuticals, Inc.; Somaxon Pharmaceuticals, Inc.; Somerset Pharmaceuticals, Inc.; Sunovion Pharmaceuticals; Supernus Pharmaceuticals, Inc.; Synthelabo; Taisho Pharmaceutical; Takeda Pharmaceutical Company Limited; Tal Medical, Inc.; Tetragenex Pharmaceuticals, Inc.; TransForm Pharmaceuticals, Inc.; Transcept Pharmaceuticals, Inc.; Vanda Pharmaceuticals, Inc.; VistaGen; he has received speaking or publishing fees from Adamed, Co; Advanced Meeting Partners; American Psychiatric Association; American Society of Clinical Psychopharmacology; AstraZeneca; Belvoir Media Group; Boehringer Ingelheim GmbH; Bristol-Myers Squibb; Cephalon, Inc.; CME Institute/Physicians Postgraduate Press, Inc.; Eli Lilly and Company; Forest Pharmaceuticals, Inc.; GlaxoSmithKline; Imedex, LLC; MGH Psychiatry Academy/Primedia; MGH Psychiatry Academy/Reed Elsevier; Novartis AG; Organon Pharmaceuticals; Pfizer Inc.; PharmaStar; United BioSource, Corp.; Wyeth-Ayerst Laboratories; he has equity holdings in Compellis and PsyBrain, Inc.; he has a patent for Sequential Parallel Comparison Design (SPCD), which are licensed by MGH to Pharmaceutical Product Development, LLC (PPD); and patent application for a combination of Ketamine plus Scopolamine in Major Depressive Disorder (MDD), licensed by MGH to Biohaven; and he receives copyright royalties for the MGH Cognitive & Physical Functioning Questionnaire (CPFQ), Sexual Functioning Inventory (SFI), Antidepressant Treatment Response Questionnaire (ATRQ), Discontinuation-Emergent Signs & Symptoms (DESS), Symptoms of Depression Questionnaire (SDQ), and SAFER; Lippincott, Williams & Wilkins; Wolkers Kluwer; World Scientific Publishing Co. Pte. Ltd. Dr. Kurian has received research grant support from the following organizations: Targacept, Inc., Pfizer, Inc., Johnson & Johnson, Evotec, Rexahn, Naurex, Forest Pharmaceuticals and the National Institute of Mental Health (NIMH). Mary L. Phillips has received funding from NIMH and the Emmerling-Pittsburgh Foundation. Over the past 3 years, Dr. Pizzagalli has received honoraria/consulting fees from Akili Interactive Labs, BlackThorn Therapeutics, Pfizer, and Posit Science. Dr. Oquendo receives royalties for use of the Columbia Suicide Severity Rating Scale. Her family owns stock in Bristol Myers Squibb. Dr. Mann receives royalties for commercial use of the Columbia Suicide Severity Rating Scales from the Research Foundation for Mental Hygiene. No other disclosures are reported. Funding Information: Dr. Kurian has received research grant support from the following organizations: Targacept, Inc., Pfizer, Inc., Johnson & Johnson, Evotec, Rexahn, Naurex, Forest Pharmaceuticals and the National Institute of Mental Health (NIMH). Mary L. Phillips has received funding from NIMH and the Emmerling-Pittsburgh Foundation. Funding Information: In the past 2 years, Dr. Weissman received funding from the National Institute of Mental Health (NIMH), the National Alliance for Research on Schizophrenia and Depression (NARSAD), the Sackler Foundation, the Templeton Foundation; and receives royalties from the Oxford University Press, Perseus Press, the American Psychiatric Association Press, and MultiHealth Systems. Publisher Copyright: © 2018 Wiley Periodicals, Inc.
PY - 2018/11
Y1 - 2018/11
N2 - This study aimed to identify biomarkers of major depressive disorder (MDD), by relating neuroimage-derived measures to binary (MDD/control), ordinal (severe MDD/mild MDD/control), or continuous (depression severity) outcomes. To address MDD heterogeneity, factors (severity of psychic depression, motivation, anxiety, psychosis, and sleep disturbance) were also used as outcomes. A multisite, multimodal imaging (diffusion MRI [dMRI] and structural MRI [sMRI]) cohort (52 controls and 147 MDD patients) and several modeling techniques—penalized logistic regression, random forest, and support vector machine (SVM)—were used. An additional cohort (25 controls and 83 MDD patients) was used for validation. The optimally performing classifier (SVM) had a 26.0% misclassification rate (binary), 52.2 ± 1.69% accuracy (ordinal) and r =.36 correlation coefficient (p <.001, continuous). Using SVM, R2 values for prediction of any MDD factors were <10%. Binary classification in the external data set resulted in 87.95% sensitivity and 32.00% specificity. Though observed classification rates are too low for clinical utility, four image-based features contributed to accuracy across all models and analyses—two dMRI-based measures (average fractional anisotropy in the right cuneus and left insula) and two sMRI-based measures (asymmetry in the volume of the pars triangularis and the cerebellum) and may serve as a priori regions for future analyses. The poor accuracy of classification and predictive results found here reflects current equivocal findings and sheds light on challenges of using these modalities for MDD biomarker identification. Further, this study suggests a paradigm (e.g., multiple classifier evaluation with external validation) for future studies to avoid nongeneralizable results.
AB - This study aimed to identify biomarkers of major depressive disorder (MDD), by relating neuroimage-derived measures to binary (MDD/control), ordinal (severe MDD/mild MDD/control), or continuous (depression severity) outcomes. To address MDD heterogeneity, factors (severity of psychic depression, motivation, anxiety, psychosis, and sleep disturbance) were also used as outcomes. A multisite, multimodal imaging (diffusion MRI [dMRI] and structural MRI [sMRI]) cohort (52 controls and 147 MDD patients) and several modeling techniques—penalized logistic regression, random forest, and support vector machine (SVM)—were used. An additional cohort (25 controls and 83 MDD patients) was used for validation. The optimally performing classifier (SVM) had a 26.0% misclassification rate (binary), 52.2 ± 1.69% accuracy (ordinal) and r =.36 correlation coefficient (p <.001, continuous). Using SVM, R2 values for prediction of any MDD factors were <10%. Binary classification in the external data set resulted in 87.95% sensitivity and 32.00% specificity. Though observed classification rates are too low for clinical utility, four image-based features contributed to accuracy across all models and analyses—two dMRI-based measures (average fractional anisotropy in the right cuneus and left insula) and two sMRI-based measures (asymmetry in the volume of the pars triangularis and the cerebellum) and may serve as a priori regions for future analyses. The poor accuracy of classification and predictive results found here reflects current equivocal findings and sheds light on challenges of using these modalities for MDD biomarker identification. Further, this study suggests a paradigm (e.g., multiple classifier evaluation with external validation) for future studies to avoid nongeneralizable results.
KW - diffusion MRI
KW - magnetic resonance imaging
KW - major depressive disorder
KW - structural MRI
KW - support vector machine
UR - http://www.scopus.com/inward/record.url?scp=85052534441&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85052534441&partnerID=8YFLogxK
U2 - 10.1002/hbm.24282
DO - 10.1002/hbm.24282
M3 - Article
C2 - 30113112
AN - SCOPUS:85052534441
SN - 1065-9471
VL - 39
SP - 4420
EP - 4439
JO - Human Brain Mapping
JF - Human Brain Mapping
IS - 11
ER -