Monday, May 12, 2025

New England Journal of Medicine E-Cigarette Meta-Analysis is a Mega-Disaster

 

The scientific publishing community is in love with meta-analyses.  Metas apply statistical techniques to combine results from multiple studies with the aim of producing more precise estimates of specific effects.

A Medline search reveals almost 215,000 metas in the medical literature, with 75% of them published since 2015.  Of the 9,488 Medline studies involving e-cigarettes, 104 are metas.

I have written about the tsunami of deficient studies on e-cigarettes and vaping fueled by funding from the National Institutes of Health.  My colleague and I have spent considerable time over recent years documenting the flawed and downright fraudulent findings in many of these.  Unfortunately, we are now seeing an outbreak of metas that compound the distorted results of those prior studies, resulting in further obfuscation of the facts. 

One such meta-analysis is the work of retired professor Stanton Glantz and his colleagues, published in a spin-off journal, the New England Journal of Medicine – Evidence.  The article includes 181 references, 107 of which were used as sources for their risk calculations, and it runs to 18 pages, with a supplementary appendix of 117 pages. 

The main conclusion reads: “…the odds of disease between current e-cigarette and cigarette use were similar…There is a need to reassess the assumption that e-cigarette use provides substantial harm reduction across all cigarette-caused diseases.”

In short, “E-cigarettes = cigarettes = deadly = no harm reduction.”

Following publication, several issues were raised in letters posted on the journal website (here), including the small number of e-cigarette users and short duration of exposure, the lack of dose-response assessment, and two serious methodologic flaws involving assessing bias and certainty of evidence.

My colleague Nantaporn Plurphanswat and I had additional concerns.  We spent several months dissecting the meta, and we had help from Jordan Rodu, a statistics professor at the University of Virginia.  Our results have just been published (here).  In our abstract we identified “three principal deficits that were avoidable: (1) mixing unjustified and incomprehensible disease outcomes; (2) using survey datasets containing no temporal information about smoking/vaping initiation and disease diagnosis; (3) using longitudinal studies that didn’t account for changes in vaping and smoking during follow-up waves.”  Let’s take a closer look at these deficits.

We chose to focus on the Glantz meta results for e-cigarettes and cardiovascular disease (CVD), stroke and chronic obstructive pulmonary disease (COPD), because these are serious, and often fatal conditions.  When we looked at the CVD results, we were astounded to find that Glantz et al. included erectile dysfunction.  Maybe ED is associated with smoking, and it is medical problem, but there is no scientific rationale for including it in this study, but for the fact that it contributed the largest, most significant risk estimate to the CVD category. 

The meta authors made a similar error with COPD: they included a study of influenza, which isn’t remotely related. 

Medical diagnoses are not suggestions that can be categorized sloppily.  They are organized and structured by the World Health Organization in the International Classification of Diseases, and they should be employed legitimately.

We also documented that Glantz and colleagues based their results on numerous studies of cross-sectional datasets such as the National Health Interview Surveys (NHIS) and the Behavioral Risk Factor Surveillance System (BRFSS).  We have previously published research showing that these datasets contain no information about the age at initiation of e-cigarette and cigarette use, nor on the age that participants were diagnosed with diseases.  None of these studies should have been used in the Glantz meta. 

The Glantz team’s results were partially derived from longitudinal studies, mainly from the FDA’s Population Assessment of Tobacco and Health (PATH) survey, which is appropriate.  However, the only study of this type that showed a positive result for e-cigarettes and COPD was done by Xie et al. (here).  We re-analyzed that entire study, and we proved that the original results were almost entirely confounded by smoking. 

In summary, we demonstrated that the Glantz meta “failed to meet a basic criterion, described by Egger et al. as “Garbage in – garbage out?: The quality of component trials is of crucial importance: if the ‘raw material’ is flawed, the findings of reviews of this material may also be compromised.” 

Our study concluded, “the results of the [Glantz et al.] meta-analysis are invalid.”

     


Monday, May 5, 2025

Fake Science Denying the Relative Safety of Smokeless Tobacco Cost Millions of Lives; Don’t Repeat that Error with New Smoke-Free Products

 

Dr. Jay Bhattacharya, recently confirmed as director of the National Institutes of Health, tweeted on November 23, 2024, “If the NIH were serious about the replication crisis, it would devote a significant chunk of its budget to funding replication studies by independent researchers and require NIH funded researchers to make research materials available to replicators.”

I welcomed that statement because, over the past decade, my colleague Nantaporn Plurphanswat and I have challenged distorted and blatantly false studies concerning safer tobacco products (examples here, here, here and the list below).  Those efforts followed my earlier work with other authors on similar flawed research articles, but together they addressed only a fraction of defective FDA/NIH-sponsored tobacco research.  Because replication is time-consuming, it detracts from the performance of original research; additionally, findings are rarely published, and they often draw derision from the original authors and the research establishment. 

One might ask, why bother to address bad studies?  I answer that question in a new Sensible Medicine article titled, “Defining the Risk of Oral Tobacco Products,” in which I focus on the false narrative of a 1981 New England Journal of Medicine study that fatally undercut the fact that smokeless tobacco is vastly safer than cigarettes.  As a result of the 1981 publication, millions of smokers were denied information that could have extended their lives. 

Repeating that deadly error with vapor products, heat-not-burn tobacco and nicotine pouches will cost millions more lives.

 


 

List

Plurphanswat N, Rodu B.  Is the smoking population in the United States really softening?  Addiction, 2016 Jul;111(7):1299-303. doi: 10.1111/add.13340. Epub 2016 May 13. http://www.ncbi.nlm.nih.gov/pubmed/27177450

Farsalinos K, Rodu B.  Metal emissions from e-cigarettes: a risk assessment analysis of a recently-published study.  Inhalation Toxicology 2018. https://pubmed.ncbi.nlm.nih.gov/30384783/ 

Rodu B, Plurphanswat N.  A re‐analysis of e‐cigarette use and heart attacks in PATH wave 1 data. Addiction, First published 13 August 2020.  https://pubmed.ncbi.nlm.nih.gov/32794213/

Rodu B, Plurphanswat N. Heterogeneity and other problems in a pooled analysis of snus use and mortality. F1000Research 2021, 10:388 (https://doi.org/10.12688/f1000research.52127.1 )

Rodu B, Plurphanswat N.  Cross-sectional e-cigarette studies are unreliable without timing of exposure and disease diagnosis. Internal and Emergency Medicine 18(1):319-323, 2023. Epub 2022 Nov 25. https://link.springer.com/article/10.1007/s11739-022-03141-3

Plurphanswat N, Selya A, Rodu B. Questionable effects of electronic cigarette use on cardiovascular diseases from the National Health Interview Survey (NHIS, 2014-2021). Cureus 2024. DOI:10.7759/cureus.57119. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11055619/

Rodu B, Cole P.  Excess Mortality in Smokeless Tobacco Users Not Meaningful (Letter).  American Journal of Public Health 85:118, 1995. https://pubmed.ncbi.nlm.nih.gov/7832248/

Rodu B, Cole P. A deficient study of smokeless tobacco use and cancer (letter).  International Journal of Cancer 118: 1585, 2006.  https://pubmed.ncbi.nlm.nih.gov/16206262/

Rodu B. Snus and the risk of cancer of the mouth, lung, and pancreas.  Lancet 370: 1207, 2007.  https://pubmed.ncbi.nlm.nih.gov/17920914/

Rodu B, Heavner KK.  Errors and omissions in the study of snuff use and hypertension (letter).  Journal of Internal Medicine 265: 507-8, 2009. https://pubmed.ncbi.nlm.nih.gov/19019185/

Rodu B, Heavner KK, Phillips CV.  Snuff use and stroke (letter).  Epidemiology 20: 468-9, 2009.  https://pubmed.ncbi.nlm.nih.gov/19363361/

Rodu B, Plurphanswat N, Phillips CV.  Discrepant results for smoking and cessation among electronic cigarette users (letter).  Cancer 2015 Mar 4. doi: 10.1002/cncr.29307. https://pubmed.ncbi.nlm.nih.gov/25740231/

Rodu B, Phillips CV.  Regarding “Discontinuation of Smokeless Tobacco and Mortality Risk after Myocardial Infarction” (letter).  Circulation 2015 Apr 28;131(17):e422. doi: 10.1161/CIRCULATIONAHA.114.012038.  https://pubmed.ncbi.nlm.nih.gov/25918044/

Rodu B.  Re: Smokeless tobacco use and the risk of head and neck cancer: pooled analysis of US studies in the INHANCE consortium.  American Journal of Epidemiology 2017.  https://pubmed.ncbi.nlm.nih.gov/28911014/

Rodu B, Plurphanswat N.  Response to Bhatta and Glantz.  Addiction First published: 13 August 2020. https://pubmed.ncbi.nlm.nih.gov/32794301/ 

Rodu B, Plurphanswat N.  Gaiha et al. disregarded conventional publishing standards (letter).  Journal of Adolescent Health 68;215, January 1, 2021. https://www.jahonline.org/article/S1054-139X(20)30566-8/fulltext 

Plurphanswat N, Rodu B.  “Association between electronic cigarette use and fragility fractures among US adults” contains significant errors.  American Journal of Medicine Open 8: December 2022, https://doi.org/10.1016/j.ajmo.2022.100017 

Rodu B.  Methods questions.  Tobacco Control June 12, 2023. https://tobaccocontrol.bmj.com/content/early/2023/03/20/tc-2022-057717.responses 

 

Rodu B.  The many dangers of e-cigarette misinformation. Oral Surgery Oral Medicine Oral Pathology 2024.  https://www.oooojournal.net/article/S2212-4403(24)00893-9/fulltext  

 

 


Wednesday, April 16, 2025

Gold Rush: Measuring Nicotine Mortality by the Millimeter

 

The New Yorker magazine recently published an article, “Zyn and the New Nicotine Gold Rush,”  that included a remarkable passage from a discussion between the author and Thomas Ericsson, a former Swedish Match employee.  It perfectly describes the risks of using snus and nicotine. 

“I asked Ericsson whether he had any concerns about the possible harms of nicotine itself. ‘Of course you should have concerns,’ he told me. ‘Or you should do risk analysis.’ He walked out of the room and returned with a large ball of string. The string was exactly ninety-five metres long, each millimetre representing one of Sweden’s approximate ninety-five thousand annual deaths. Ericsson slowly unravelled the string until he reached a piece of tape representing the people who die early from smoking each year. He moved his fingers down to another marker, a few meters shorter, which represented the people who die from drinking. He continued shortening the string, indicating the number of deaths by suicide (fifteen hundred), drowning (a hundred and fifty), car accidents (two hundred), and workplace accidents (between fifty and seventy).

“‘You can ask yourself, What are Swedish people most afraid of? They’re afraid to fly. They’re afraid of wolves. They’re afraid of deer and other things,’ he said, holding a short length of string. ‘But what you should be afraid of is the wasp. It kills five to ten people every year.’ Finally, Ericsson reached the very tip of the string. While working on Nicorette, he and his colleagues did a risk-analysis calculation that estimated that fewer than two people per year would die of heart illnesses exacerbated by nicotine use. Compared with other hazards, he said, ‘this is not a big risk.’”

I have recognized the minuscule risks of snus since 1995, when I first described the Swedish experience in a peer-reviewed publication:

“Sweden has been the world's largest per capita consumer of smokeless tobacco (ST) throughout the 20th century, without a resultant oral cancer epidemic.  On the contrary, the age-adjusted mortality rate for oral cancer from 1960 to 1990 in Sweden was low and remarkably stable at 2.3 to 3.6 per 100,000 person-years.  A retrospective study of 200,000 male snuff dippers in Sweden found only one case of oral cancer per year.  This is in marked contrast to most other European countries where ST use is essentially nonexistent and where increases in oral cancer mortality have mirrored earlier increases in cigarette consumption.  The greatest increase in oral cancer mortality has occurred in France (13.4/100,000 person-years in 1955-59 to 32.3/100,000 person-years in 1985-89). 

“It is not surprising to find that Swedish lung cancer mortality rates have been the lowest in Europe over the past 40 years.  These large scale vital statistics from Sweden and France strongly support the suggestion that if tobacco is to be used, it should be in the form of ST and not cigarettes. The population that uses ST in lieu of smoking is, in effect, protected from lung cancer and other major smoking-related diseases and suffers little or no increased risk of oral cancer.” (emphasis added, references removed)

In 2004, following my research sabbatical at Sweden’s Umeå University, I published this:

Rodu B, Cole P.  The burden of mortality from smoking: comparing Sweden with other countries in the European Union.  European Journal of Epidemiology 19: 129-131, 2004. https://www.ncbi.nlm.nih.gov/pubmed/15074568  

In that article, epidemiologist Philip Cole and I described “the mortality currently attributable to smoking in the European Union (EU), and the change that would result if all EU countries had the smoking prevalence of Sweden.  Almost 500,000 smoking-attributable deaths occur annually among men in the EU; about 200,000 would be avoided at Swedish smoking rates.”

More than 20 years after our estimates were published, the Swedish Tobacco Experience has become a Gold Rush, meaning that more people are consuming nicotine and tobacco in a safer fashion.