The following is an important article by Dr. Ronald B Brown’s focussing on coronavirus mortality overestimation.
This scientific contribution provides and understanding of the Covid crisis and the often misleading estimates provided by our health authorities.
Our thanks to Dr. Brown, Guelph U and Cambridge University Press (emphasis added)
Selected quotes
Based on the data available at the time, Congress was informed that the estimated mortality rate for the coronavirus was 10-times higher than for seasonal influenza, which helped launch a campaign of social distancing, organizational and business lockdowns, and shelter-in-place orders.
Sampling bias in coronavirus mortality calculations led to a 10-fold increased mortality overestimation in March 11, 2020, US Congressional testimony. This bias most likely followed from information bias due to misclassifying a seasonal influenza IFR as a CFR, evident in a NEJM.org editorial.
Evidence from the WHO confirmed that the approximate CFR of the coronavirus is generally no higher than that of seasonal influenza. By early May 2020, mortality levels from COVID-19 were considerably below predicted overestimations, a result that the public attributed to successful mitigating measures to contain the spread of the novel coronavirus.
This article presented important public health lessons learned from the COVID-19 pandemic. Reliable safeguards are needed in epidemiological research to prevent seemingly minor miscalculations from developing into disasters.
Published online in the New England Journal of Medicine (NEJM.org), the editorial stated:
“…the overall clinical consequences of Covid-19 may ultimately be more akin to those of a severe seasonal influenza (which has a case fatality rate of approximately 0.1%).”4
****
Abstract
In testimony before US Congress on March 11, 2020, members of the House Oversight and Reform Committee were informed that estimated mortality for the novel coronavirus was 10-times higher than for seasonal influenza. Additional evidence, however, suggests the validity of this estimation could benefit from vetting for biases and miscalculations. The main objective of this article is to critically appraise the coronavirus mortality estimation presented to Congress. Informational texts from the World Health Organization and the Centers for Disease Control and Prevention are compared with coronavirus mortality calculations in Congressional testimony. Results of this critical appraisal reveal information bias and selection bias in coronavirus mortality overestimation, most likely caused by misclassifying an influenza infection fatality rate as a case fatality rate. Public health lessons learned for future infectious disease pandemics include: safeguarding against research biases that may underestimate or overestimate an associated risk of disease and mortality; reassessing the ethics of fear-based public health campaigns; and providing full public disclosure of adverse effects from severe mitigation measures to contain viral transmission.
***
On September 23, 1998, the US National Aeronautics and Space Administration (NASA) permanently lost contact with the $125 million Mars Climate Orbiter.1 A simple miscalculation, failure to convert English measurements to metric measurements, doomed the Mars space mission.2 A later investigation found that backup quality assurance procedures were not in place at NASA to catch and correct this simple miscalculation. Fast forward 22 years to another crisis involving a US government agency: On March 11, 2020, the US Congress House Oversight and Reform Committee received information from the National Institute of Allergy and Infectious Diseases (NIAID) concerning the novel coronavirus, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and coronavirus-disease 2019 (COVID-19).3 Based on the data available at the time, Congress was informed that the estimated mortality rate for the coronavirus was 10-times higher than for seasonal influenza, which helped launch a campaign of social distancing, organizational and business lockdowns, and shelter-in-place orders.
Previous to the Congressional hearing, a less severe estimation of coronavirus mortality appeared in a February 28, 2020 editorial released by NIAID and the Centers for Disease Control and Prevention (CDC). Published online in the New England Journal of Medicine (NEJM.org), the editorial stated:
“…the overall clinical consequences of Covid-19 may ultimately be more akin to those of a severe seasonal influenza (which has a case fatality rate of approximately 0.1%).”4
Almost as a parenthetical afterthought, the NEJM editorial inaccurately stated that 0.1% is the approximate case fatality rate of seasonal influenza. By contrast, the World Health Organization (WHO) reported that 0.1% or lower is the approximate influenza infection fatality rate,5 not the case fatality rate. To fully appreciate the significance of discrepancies in fatality rate usage by NIAID, the CDC, and the WHO, brief definitions of relevant epidemiological terms follow.
Case fatality rates (CFRs), infection fatality rates (IFRs), and mortality rates are used by epidemiologists to describe deaths during and after an infectious disease outbreak. The CDC defined a mortality rate as the frequency of deaths within a time period relative to the size of a well-defined population.6 Patients may be classified as having an influenza-like illness (ILI) such as COVID-19 according to standard criteria in a case definition.7 A CFR is defined as the proportion of deaths among confirmed cases of the disease. CFRs indicate the disease severity, while an IFR is defined as the proportion of deaths relative to the prevalence of infections within a population.8 IFRs are estimated following an outbreak, often based on representative samples of blood tests of the immune system in individuals exposed to a virus. Estimation of the IFR in COVID-19 is urgently needed to assess the scale of the coronavirus pandemic.9
Because different types of fatality rates can vary widely, it is imperative to not confuse fatality rates with one another; else misleading calculations with significant consequences could result. As of late spring 2020, a search of the keyword term “infection fatality rate” on the CDC website returned no matching results or similar terms, nor was the epidemiological term located in the 511-page CDC publication, Principles of Epidemiology in Public Health Practice. (The CDC eventually introduced the Infection Fatality Ratio (IFR) on July 10, 2020 “as a new parameter value for disease severity.”10) This terminology omission, in conjunction with questionable use of fatality rate terminology in the NEJM editorial, raises red flags, warning of possible inaccuracies in the coronavirus mortality estimation presented to Congress. Similar to the need to vet for miscalculations that might have rescued NASA’s 1998 Mars mission, vetting the coronavirus mortality estimation for miscalculations and biases may benefit the validity of mortality conclusions. Therefore, the purpose of this article is to present an ad hoc critical appraisal of the coronavirus mortality estimation presented to US Congress on March 11, 2020.
Findings from a comparative analysis of selected video and texts are used in this article to critically appraise the validity of coronavirus mortality calculations presented in US Congressional testimony. Critical appraisal is a process that judges the validity of scientific research evidence.11 Comparative analysis is a tool used in a grounded theory methodology to investigate an unexplored area through logical induction of coherent themes and explanations that are grounded in empirical evidence.12 Text from the February 2020 NEJM.org editorial and video of Congressional testimony are compared with reliable informational texts from the WHO and CDC. Inconsistencies, inaccuracies, biases, utilization, and consequences of the coronavirus mortality estimation are discussed.
In NIAID testimony before the House Oversight and Reform Committee Hearing on Coronavirus response, Day 1,3 the Committee learned that mortality from seasonal influenza is 0.1%. Additionally, it was reported to Congress that the overall coronavirus mortality of approximately 2-3% had been reduced to 1% to take into account infected people who are asymptomatic or have mild symptoms. The adjusted mortality rate from coronavirus of 1% was then compared with the 0.1% mortality rate from seasonal influenza, and the conclusion was reported to the House Committee that the coronavirus was 10-times more lethal than seasonal influenza.
In a comparative analysis with WHO and CDC documents, the coronavirus mortality rate of 2-3% that was adjusted to 1% in Congressional testimony is consistent with the coronavirus CFR of 1.8-3.4% (median, 2.6%) reported by the CDC.13 Furthermore, the WHO reported that the CFR of the H1N1 influenza virus (1918) is also 2-3%,14 similar to the unadjusted 2-3% CFR of the coronavirus reported in Congressional testimony, with no meaningful difference in mortality. As previously mentioned, the WHO also reported that 0.1% is the IFR of seasonal influenza,5 not the CFR of seasonal influenza as reported in the NEJM editorial.
Discussion
Confusion between CFRs and IFRs may seem trivial, and it is easy to overlook at first, but this confusion may have ultimately led to an unintentional miscalculation in coronavirus mortality estimation. IFRs from samples across the population include undiagnosed, asymptomatic, and mild infections, and are often lower compared with CFRs, which are based exclusively on relatively smaller groups of moderately to severely ill diagnosed cases at the beginning of an outbreak. Due to host defense mechanisms and autoimmunity provided by innate and adaptive immune responses,15 asymptomatic infections are often prevalent in influenza.16 With many asymptomatic infections already identified in COVID-19,17 it appears unlikely that the IFR in an ILI like COVID-19 would approximate the disease’s CFR. Presymptomatic infections can also lower the proportion of asymptomatic infections. For example, a CDC report found that asymptomatic individuals identified through reverse transcriptase-polymerase chain reaction (RT-PCR) testing developed symptoms a week later, and those individuals were re-classified as having been presymptomatic at the time of testing.18
In Figure 1, 4 cases grouped in the dotted-line box are also included among 7 infections, illustrating that all cases are infections but not all infections are cases, a potential point of confusion in media reports of COVID-19. For example, a high number of coronavirus infections were discovered in US meat-packing plants in Iowa,19 but these infections were reported as cases in the media,20potentially causing a type of information bias known as misclassification.21 Misclassification refers to “the erroneous classification of an individual, a value, or an attribute into a category other than that to which it should be assigned.”22 This type of information bias in epidemiological research can lead to underestimates or overestimates of associated disease and mortality risks.21
FIGURE 1 CFR and IFR. 1 fatality / 4 cases = 25% CFR. 1 fatality / 7 infections = 14.28% IFR.
CFRs and IFRs represent different segments of a targeted population and contain widely different proportions of nonfatal infections; therefore, misapplying findings or generalizing inferences between these 2 groups can cause a type of selection bias known as sampling bias23 or ascertainment bias.24 In this type of bias, people do not represent segments of the population to whom findings apply. Furthermore, “…comparisons of the CFR of 1 disease with the IFR of another are mostly useless,”25 and sampling bias can lead to serious inaccuracies, as when Congress was informed that the coronavirus is 10-times more lethal than seasonal influenza.
A comparison of coronavirus and seasonal influenza CFRs may have been intended during Congressional testimony, but due to misclassifying an IFR as a CFR, the comparison turned out to be between an adjusted coronavirus CFR of 1% and an influenza IFR of 0.1%. Had the adjusted coronavirus mortality rate not been lowered from 3% to 1%, fatality comparisons of the coronavirus to the IFR of seasonal influenza would have increased from 10-times higher to 20- to 30-times higher. By then, epidemiologists might have been alerted to the possibility of a miscalculation in such an alarming estimation.
Quality Assurance
Most people rely on trusted public health experts from organizations like the CDC to disseminate vital information on infectious diseases.26 Unfortunately, even experts can make simple miscalculations that can lead to catastrophic results. In the example of NASA’s lost Mars Climate Orbiter, the NASA board investigating the failed mission recognized that mistakes happen on projects, “However, sufficient processes are usually in place on projects to catch these mistakes before they become critical to mission success.”2 The NASA board also recognized the importance of quality assurance procedures to prevent future failures. Of relevance, in 2018, the National Institute of Neurological Disorders and Stroke (NINDS) provided an exemplary definition of quality assurance (QA) in clinical and health sciences:
“The objectives of QA procedures are to assure the accuracy and consistency of study data, from the original observations through the reporting of results and to ensure that study results are considered valid and credible within the scientific and clinical communities.”27
Similar to NASA’s quality assurance problems in 1998, quality assurance procedures at US national public health organizations in 2020 may benefit from review and revision to prevent crucial mortality miscalculations of infectious diseases in the future. As a safeguard against misuse of fatality rates, and protection in the event of nonstandardized or inter-organizational discrepancies in terminology, every fatality rate should clearly define the denominator of the rate as the specific group to whom fatalities apply, either to the total population in mortality rates, confirmed cases of a disease in CFRs, or individuals exposed to a viral infection in IFRs.
Mitigation Measures
As the campaign to mitigate coronavirus transmission was implemented from March into May, 2020, expected coronavirus mortality totals in the United States appeared much lower than the overestimation reported in Congressional testimony on March 11. Compared with the most recent season of severe influenza A (H3N2) in 2017-2018,28 with 80,000 US deaths reported by CDC officials,29 US coronavirus mortality totals had just reached 80,000 on May 9, 2020.30 By then, relative to the 2017-2018 influenza, it was clear that the coronavirus mortality total for the season would be nowhere near 800,000 deaths inferred from the 10-fold mortality overestimation reported to Congress. Even after adjusting for the effect of successful mitigation measures that may have slowed down the rate of coronavirus transmission, it seems unlikely that so many deaths were completely eliminated by a nonpharmaceutical intervention such as social distancing, which was only intended to contain infection transmission, not suppress infections and related fatalities.31Also in early May, 2020, a New York State survey of 1269 COVID-19 patients recently admitted to 113 hospitals found that most of the patients had been following shelter-in-place orders for 6 wk, which raised state officials’ suspicions about social distancing effectiveness.32 Still, polls showed the public credited social distancing and other mitigation measures for reducing predicted COVID-19 deaths, and for keeping people safe from the coronavirus.33,34
Surprisingly, disproportionate mortality increases in Italian and American health-care facilities during the height of the COVID-19 outbreak were not unique; similar health-care facility crises occurred during the 2016-2017 influenza season in Italy,35 and during the 2017-2018 influenza season in the United States.36 Yet, these earlier outbreaks did not appear to receive the same intensive media coverage as COVID-19. Although media reports of new coronavirus infections reinforced the public’s belief that the virus was continuing to spread, greater levels of testing may have increased detection of infections that were already prevalent throughout the population. In addition, the accuracy of coronavirus tests rushed into production during the pandemic were unknown.37 RT-PCR testing has been in use since the detection of the A (H5N1) influenza virus in 2005,38 but a serious limitation of RT-PCR testing is that nucleic acid detection is not capable of determining the difference between infective and noninfective viruses.39 Moreover, the CDC modified criteria to record coronavirus mortality by including “probable” and “likely” deaths in the International Classification of Diseases code (ICD) for COVID-19.40
By June 21, new daily deaths from the coronavirus dropped to 267 in the United States, a 90% decrease from 2693 daily deaths reported on April 21.30 However, confirmed cases in some areas increased as lockdowns lifted,41 and total US infections had reached 1,254,055 by June 21.30 Several reasons in addition to increased viral transmission could account for case increases. For example, ill people may no longer fear going to hospitals as society reopens,42 and coronavirus testing may also result in greater differential diagnosis of SARS-CoV-2 infections from other common respiratory viral infections.43 With more reported cases of COVID-19 in younger people following reopening,44 CFRs could actually decline due to lower associated mortality risk in this age group. Furthermore, country comparisons of coronavirus CFRs are often confounded by numerous factors,45 including health-care differences in case definitions, access to quality treatment and reliable testing, compliance with mitigation measures, and underlying health conditions; demographic differences in age, race, socioeconomic status, and population density; and geo-political differences including climate, seasonality, environmental pollution, social inequities and unrest, personal liberties, public health policies, reliability in reporting valid government statistics of disease, and lifestyle customs that affect physical and mental health, public sanitation, and personal hygiene. Ultimately, with a myriad of uncontrolled confounding factors, a serosurvey of representative samples of a population is a more reliable method to determine the true prevalence of coronavirus infections.
Emerging confounding factors in the United States have also contributed to a rising mortality trend in ILIs such as COVID-19. For example, each year surviving members of the ageing Baby-Boomer cohort of 76 million people born between 1946 and 1964 enter the high-risk category for ILIs, increasing the burden placed on health-care systems.46 Also, research shows that a warming trend in the Artic can lead to more extreme winter weather conditions, especially in the Eastern United States,47 which may play a role in rising mortality rates from ILIs during the influenza season.
As health authorities responded to the COVID-19 pandemic by implementing lockdowns and other mitigation measures with minimal supporting evidence, scientists warned of “a fiasco in the making,”48 Caution was also raised against violations of fundamental principles of science and logic, such as the mistaken assumption that correlation implies causation.45 For example, the public’s belief that mitigation measures were responsible for reducing coronavirus mortality may be a post hoc fallacy if lower mortality was actually due to the overestimation of coronavirus deaths. Furthermore, implementing the unconfirmed hypothesis that mitigation measures save lives in vulnerable populations, and rejecting the null hypothesis that assumes no life-saving effect exists, is a type I error in hypothesis testing.49 The null hypothesis does not assume a priori knowledge. Therefore, before implementing mitigation measures that incur severe costs, the onus is on mitigation proponents to formally reject the null hypothesis by justifying claims of life-saving benefits. Additionally, education in principles of basic research methods is essential for consumers of public health research, and there is a need to increase instruction in the science and logic of research methods in general education curricula.50More research of nondrug mitigation interventions is also urgently needed to prevent COVID-19, especially in vulnerable populations.51
Scientists also warned of public health decisions made without reliable data of infection prevalence within the population.45,48Lacking valid input data due to insufficient testing for disease prevalence, statistical modeling methods often relied on speculative assumptions, producing fearful predictions of increased mortality, which have often proved unreliable.52 A systematic review found that most diagnostic and predictive models for COVID-19 lack rigor, have a high risk of selection bias, and are likely to have lower predictive performance in actual practice compared with optimistic reports published in the research literature.53
A revised version of a non–peer-reviewed study on COVID-19 antibody seroprevalence in Santa Clara County, California, found that infections were many times more prevalent than confirmed cases.54 As more serosurveys are conducted throughout the country, a nationally coordinated COVID-19 serosurvey of a representative sample of the population is urgently needed,55 which can determine if the national IFR is low enough to expedite an across-the-board end to restrictive mitigating measures. Plans for a national US serosurvey were announced in April 2020 by the National Institutes of Health, to be conducted by NIAID and the National Institute of Biomedical Imaging and Bioengineering (NIBIB), with the assistance of the National Center for Advancing Translational Sciences (NCATS) and the National Cancer Institute (NCI).56 Of relevance, nationwide mitigation measures, such as lockdowns, social distancing, and shelter-in-place orders, were not implemented during the 2017-2018 influenza with 45 million US illnesses reported by the CDC.57 Neither were mitigation measures implemented during the 2009 influenza, with reported estimates adjusted for underreported hospitalizations of approximately 60.8 million US cases, ranging between 43.3 million to 89.3 million cases.58
Fear and Collateral Damage
Psychological adverse effects, such as anxiety, anger, and posttraumatic stress, have been linked to restrictive public health mitigation measures due to isolation, frustration, financial loss, and fear of infection.59,60 A June 8, 2020, survey from the Association for Canadian Studies found that fear of contracting the coronavirus affected 51% of the Canadian population, compared with 56% of the US population.61 Venturing out into public during the reopening phase of the lockdown was stressful to 50% of Canadians compared with 56% of Americans. A second wave of the virus was also expected by 76% of Canadians and 64% of Americans. Furthermore, the possibility exists that yet another novel virus could emerge, potentially reigniting a perpetual process of unfounded fear and unnecessary lockdowns if mortality estimations are not properly vetted.
Fear, in contrast to moral civic duty and political orientation, was shown to be a more powerful predictor of compliance with mitigating behavior in response to a viral pandemic, but with decreasing well-being and poorer decision-making.62 Studies have shown that fear impairs performance of cognitive tasks through debilitating anxiety and worry.63 Even if a threat ceases to exist, prolonged fearful avoidance of threats is maladaptive and restricts a return to normal social interaction and productivity.64 For example, after the outbreak of SARS had ended in 2004, avoidance behavior continued to restrict people’s social interactions and prevented people from returning to work.65
Exaggerated levels of fear were driven by sensationalist media coverage during the COVID-19 pandemic.45,66,67 And yet, while the public was ordered to lockdown, overall costs and benefits to society from severe mitigation measures had not been assessed.45Fear of infection also prevented people from seeking needed health-care services in hospitals during the pandemic.68 The ethics of implementing fear-based public health campaigns needs to be reevaluated for the potential harm these strategies can cause.69 Dissemination of vital health information to the public should use emotionally persuasive messaging without exploiting and encouraging overreactions based on fear.
In addition, legal and ethical violations associated with mitigation of pandemic diseases were previously investigated by the Institute of Medicine in 2007.70 People should have the right to full disclosure of all information pertinent to adverse impacts of mitigation measures during a pandemic, including information on legal and constitutional human rights issues,45 and the public should be guaranteed a voice in a transparent process as authorities establish public health policy.
Last, severe mitigating measures during the COVID-19 pandemic caused considerable global social and economic disruption.71Enforced lockdowns increased domestic violence, closed businesses and schools, laid off workers, restricted travel, affected capital markets, threatened the security of low-income families, and saddled governments with massive debt. Between February and April 2020, US unemployment rose from 3.5%, the lowest in 50 years, to 14.7%.72 A recession in the United States was also officially declared in June 2020 by the National Bureau of Economic Research, ending 128 months of historic economic expansion. Of relevance, economic downturns are associated with higher suicide rates compared with times of prosperity, and increased suicide risk may be associated with economic stress as a consequence of severe mitigation measures during a pandemic.73 Relapses and newly diagnosed cases of alcohol use disorder were also predicted to increase due to social isolation, and harmful drinking in China increased 2-fold following the COVID-19 outbreak.74 As a global natural experiment, psychological outcomes from restrictive interventions in the COVID-19 pandemic require further investigations.75
Public health lessons learned during the COVID-19 pandemic contribute knowledge and insights that can be applied to prevent future public health crises.76 Figure 2 shows a flow chart that summarizes biases and potential effects of viral mortality overestimation observed in a pandemic. Failure to intervene at the source of the problem, at the upstream levels of information bias and sampling bias, can allow fear to rapidly escalate and may cause an overactive response that produces severely harmful collateral damage to society.
FIGURE 2 Biases and Potential Related Effects of Virus Mortality Overestimation.
Conclusions
Sampling bias in coronavirus mortality calculations led to a 10-fold increased mortality overestimation in March 11, 2020, US Congressional testimony. This bias most likely followed from information bias due to misclassifying a seasonal influenza IFR as a CFR, evident in a NEJM.org editorial. Evidence from the WHO confirmed that the approximate CFR of the coronavirus is generally no higher than that of seasonal influenza. By early May 2020, mortality levels from COVID-19 were considerably below predicted overestimations, a result that the public attributed to successful mitigating measures to contain the spread of the novel coronavirus.
This article presented important public health lessons learned from the COVID-19 pandemic. Reliable safeguards are needed in epidemiological research to prevent seemingly minor miscalculations from developing into disasters. Sufficient organizational quality assurance procedures should be implemented in public health institutions to check, catch, and correct research biases and mistakes that underestimate or overestimate associated risks of disease and mortality. Particularly, the denominator of fatality rates should clearly define the group to whom fatalities apply. Public health campaigns based on fear can have harmful effects, and the ethics of such campaigns should be reevaluated. People need to have a greater voice in a transparent process that influences public health policy during an outbreak, and educational curricula should include basic research methods to teach people how to be better consumers of public health information. The public should also be fully informed of the adverse impacts on psychological well-being, human rights issues, social disruption, and economic costs associated with restrictive public health interventions during a pandemic.
In closing, nations across the globe may fearfully anticipate future waves of the coronavirus pandemic, and look bleakly toward outbreaks of other novel viral infections with a return to severe mitigation measures. However, well-worn advice from a famous aphorism by the poet philosopher George Santayana should be borne in mind, which is relevant to public health lessons learned in this article: “Those who cannot remember the past are condemned to repeat it.”77
*
Note to readers: please click the share buttons above or below. Forward this article to your email lists. Crosspost on your blog site, internet forums. etc.
Notes
1.NASA. Mars Climate Orbiter. NASA Science Web site. https://solarsystem.nasa.gov/missions/mars-climate-orbiter/in-depth/. Published July 25, 2019. Accessed May 11, 2020.Google Scholar
2.Isbell, D, Savage, D. Mars climate orbiter failure board releases report, numerous NASA actions underway in response. NASA Web site. https://mars.nasa.gov/msp98/news/mco991110.html. Published November 10, 1999. Accessed May 8, 2020.Google Scholar
3.Fifer, J. House Oversight and Reform Committee Hearing on Coronavirus Response, Day 1. C-SPAN Web site. https://www.c-span.org/video/?c4860450/user-clip-dr-anthony-fauci-addresses-covid-19-mortality-rate%20. Published March 11, 2020. Accessed April 30, 2020.Google Scholar
4.Fauci, AS, Lane, HC, Redfield, RR. Covid-19—navigating the uncharted. New England Journal of Medicine Web site. https://www.nejm.org/doi/full/10.1056/nejme2002387. Published February 28, 2020. Accessed May 8, 2020.Google Scholar
5.WHO.int. Coronavirus disease 2019 (COVID-19): situation report, 46. World Health Organization. https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200306-sitrep-46-covid-19.pdf?sfvrsn=96b04adf_4. Published 2020. Accessed April 30, 2020.Google Scholar
6.Dicker, R, Coronado, F, Koo, D, et al.Principles of Epidemiology in Public Health Practice. Atlanta GA: US Department of Health and Human Services. 2006.Google Scholar
7.WHO.int. WHO surveillance case definitions for ILI and SARI. World Health Organization Web site. https://www.who.int/influenza/surveillance_monitoring/ili_sari_surveillance_case_definition/en/. Published January 2014. Accessed April 26, 2020.Google Scholar
8.Bui, Q, Sanger-Katz, M, Kliff, S. How deadly is coronavirus? What we know and what we don’t. The New York Times Web site. https://www.nytimes.com/interactive/2020/03/07/upshot/how-deadly-is-coronavirus-what-we-know.html. Published 2020. Updated March 7. Accessed April 30, 2020.Google Scholar
9.Mallapaty, S. How deadly is the coronavirus? Scientists are close to an answer. Nature Web site. https://www.nature.com/articles/d41586-020-01738-2. Published June 16, 2020. Accessed June 18, 2020.Google Scholar
10.CDC.gov. COVID-19 Pandemic Planning Scenarios. https://www.cdc.gov/coronavirus/2019-ncov/hcp/planning-scenarios.html. Published July 10, 2020. Accessed July 12, 2020.Google Scholar
11.Mhaskar, R, Emmanuel, P, Mishra, S, et al.Critical appraisal skills are essential to informed decision-making. Indian J Sex Transm Dis AIDS.2009;30(2):112–119.Google Scholar | PubMed
12.Chun Tie, Y, Birks, M, Francis, K.Grounded theory research: a design framework for novice researchers. SAGE Open Med.2019;7:2050312118822927.CrossRef | Google Scholar | PubMed
13.CDC.gov. Severe outcomes among patients with coronavirus disease 2019 (COVID-19)—United States, February 12–March 16, 2020. Morbidity and Mortality Weekly Report: Centers for Disease Control and Prevention Web site. https://www.cdc.gov/mmwr/volumes/69/wr/mm6912e2.htm. Published March 27, 2020. Accessed April 30, 2020.Google Scholar
14.apps.WHO.int. Pandemic influenza risk management: a WHO guide to inform and harmonize national and international pandemic preparedness and response. World Health Organization. https://apps.who.int/iris/handle/10665/259893. Published 2017. Accessed April 30, 2020.Google Scholar
15.Aoshi, T, Koyama, S, Kobiyama, K, et al.Innate and adaptive immune responses to viral infection and vaccination. Curr Opin Virol.2011;1(4):226–232.CrossRef | Google Scholar | PubMed
16.Furuya-Kanamori, L, Cox, M, Milinovich, GJ, et al.Heterogeneous and dynamic prevalence of asymptomatic influenza virus infections. Emerg Infect Dis. 2016;22(6):1052–1056.CrossRef | Google Scholar | PubMed
17.Gao, Z, Xu, Y, Sun, C, et al.A systematic review of asymptomatic infections with COVID-19. J Microbiol Immunol Infect. 2020. doi: 10.1016/j.jmii.2020.05.001CrossRef | Google Scholar | PubMed
18.Kimball, A, Hatfield, KM, Arons, M, et al.Asymptomatic and presymptomatic SARS-CoV-2 infections in residents of a long-term care skilled nursing facility – King County, Washington, March 2020. MMWR Morb Mortal Wkly Rep. 2020;69(13):377–381.CrossRef | Google Scholar
19.Leys, T. Coronavirus infects more than 1,600 workers at four Iowa meatpacking plants. Des Moines Register Web site. https://www.desmoinesregister.com/story/news/health/2020/05/05/coronavirus-infects-thousands-iowa-meatpacking-plant-workers-covid-19-waterloo-perry/5170796002/. Published May 5, 2020. Accessed May 5, 2020.Google Scholar
20.Maddow, R. HHS Statement TRANSCRIPT: 5/5/20. The Rachel Maddow Show Web site. http://www.msnbc.com/transcripts/rachel-maddow-show/2020-05-05. Published May 5, 2020. Accessed May 5, 2020.Google Scholar
21.Althubaiti, A.Information bias in health research: definition, pitfalls, and adjustment methods. J Multidisc Healthc. 2016;9:211–217.CrossRef | Google Scholar | PubMed
22.Misclassification. In: Porta, M, ed. A Dictionary of Epidemiology. 5th ed. New York, NY: Oxford University Press; 2008.Google Scholar
23.Johnson, LC, Beaton, R, Murphy, S, et al.Sampling bias and other methodological threats to the validity of health survey research. Int J Stress Manag. 2000;7(4):247–267.CrossRef | Google Scholar
24.Delgado-Rodriguez, M, Llorca, J.Bias. J Epidemiol Community Health. 2004;58(8):635–641.CrossRef | Google Scholar | PubMed
25.Roth, S, Clausen, L, Mueller, S. COVID-19. Scenarios of a superfluous crisis. SSRN Web site. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3564920. Published March 30, 2020. Accessed April 30, 2020.CrossRef | Google Scholar
26.Fingerhut, H. AP-NORC poll: High use, mild trust of news media on COVID-19. AP Web site. https://apnews.com/4e2a20bd01bd2352009c3281b657375d. Published April 30, 2020. Accessed June 9, 2020.Google Scholar
27.NINDS. Quality Assurance Guidelines. National Institute of Neurological Disorders and Stroke Web site. https://www.ninds.nih.gov/Funding/Apply-Funding/Application-Support-Library/Quality-Assurance-Guidelines. Published August 13, 2018. Accessed May 11, 2020.Google Scholar
28.CDC.gov. Summary of the 2017–2018 influenza season. Centers for Disease Control and Prevention Web site. https://www.cdc.gov/flu/about/season/flu-season-2017-2018.htm. Published September 5, 2019. Accessed May 5, 2020.Google Scholar
29.AP. CDC: 80,000 people died of flu last winter in U.S., highest death toll in 40 years. 2018. STAT Web site. https://www.statnews.com/2018/09/26/cdc-us-flu-deaths-winter/. Published September 26, 2018. Accessed May 12, 2020.Google Scholar
30.worldometers.info. United States. Worldometer Web site. https://www.worldometers.info/coronavirus/country/us/. Published June 21, 2020. Accessed June 21, 2020.Google Scholar
31.Ferguson, N, Laydon, D, Nedjati Gilani, G, et al.Report 9: Impact of Non-pharmaceutical Interventions (NPIs) to Reduce COVID19 Mortality and Healthcare Demand. London: Imperial College of London; 2020.Google Scholar
32.Matthews, K, Villeneuve, M, Hill, M. Most new COVID-19 patients in NY not working, older: survey. Associated Press Web site. https://apnews.com/29033e79ac5a3cf66b0c1fd2422e729d. Published May 7, 2020. Accessed May 7, 2020.Google Scholar
33.Benzie, R. Most Canadians support COVID-19 measures, but the pandemic is wearing us down, poll finds. The Star Web site. https://www.thestar.com/politics/provincial/2020/05/05/most-canadians-support-covid-19-measures-but-the-pandemic-is-wearing-us-down-poll-finds.html. Published 2020. Accessed May 6, 2020.Google Scholar
34.Chappell, B. 8 in 10 Americans support COVID-19 shutdown, Kaiser Health Poll finds. NPR Web site. https://www.npr.org/sections/coronavirus-live-updates/2020/04/23/843175656/8-in-10-americans-support-covid-19-shutdown-kaiser-health-poll-finds. Published 2020. Accessed May 6, 2020.Google Scholar
35.Rosano, A, Bella, A, Gesualdo, F, et al.Investigating the impact of influenza on excess mortality in all ages in Italy during recent seasons (2013/14–2016/17 seasons). Int J Infect Dis. 2019;88:127–134.CrossRef | Google Scholar
36.Macmillan, A. Hospitals overwhelmed by flu patients are treating them in tents. TIME Web site. https://time.com/5107984/hospitals-handling-burden-flu-patients/. Published January 8, 2018. Accessed May 7, 2020.Google Scholar
37.Perrone, M. Accuracy still unknown for many coronavirus tests rushed out. AP Web site. https://apnews.com/38967d1644ef374d1bcbc7806b383b8e. Published June 14, 2020. Accessed June 15, 2020.Google Scholar
38.WHO. The use of PCR in the surveillance and diagnosis of influenza. Paper presented at: report of the 4th meeting of the WHO working group on polymerase chain reaction protocols for detecting subtype influenza A viruses. Geneva: WHO; 2011.Google Scholar
39.Joynt, GM, Wu, WK.Understanding COVID-19: what does viral RNA load really mean? Lancet Infect Dis. 2020;20(6):635–636.CrossRef | Google Scholar | PubMed
40.Schwartz, S. COVID-19 Alert No. 2. Centers for Disease Control and Prevention Web site. https://www.cdc.gov/nchs/data/nvss/coronavirus/Alert-2-New-ICD-code-introduced-for-COVID-19-deaths.pdf. Published March 24, 2020. Accessed June 17, 2020.CrossRef | Google Scholar
41.Cohen, H. With 2,581 new coronavirus cases, Florida hits record high for the third day in a row. Miami Herald Web site. https://www.miamiherald.com/news/coronavirus/article243513417.html. Published June 13, 2020. Accessed June 15, 2020.Google Scholar
42.White, E. Patients slowly returning to hospital emergeny rooms in northeastern Ontario. CBC Web site. https://www.cbc.ca/news/canada/sudbury/emergency-room-hospitals-covid-northeastern-ontario-1.5584581. Published May 27, 2020. Accessed June 14, 2020.Google Scholar
43.Singhal, T.A review of coronavirus disease-2019 (COVID-19). Indian J Pediatr. 2020;87(4):281–286.CrossRef | Google Scholar
44.Samore, P. Arizona hospitals getting fuller as COVID-19 patients getting younger. KTAR NEWS Web site. https://ktar.com/story/3291284/arizona-hospitals-getting-fuller-as-covid-19-patients-getting-younger/. Published June 17, 2020. Accessed June 17, 2020.Google Scholar
45.James, JJ.Lockdown or lockup. Disaster Med Public Health Prep. 2020:1–4.Google Scholar | PubMed
46.Henderson, L, Maniam, B, Leavell, H.The silver tsunami: evaluating the impact of population aging in the US. J Bus Behav Sci. 2017;29(2):153–169.Google Scholar
47.Cohen, J, Pfeiffer, K, Francis, JA.Warm Arctic episodes linked with increased frequency of extreme winter weather in the United States. Nat Commun. 2018;9(1):869.CrossRef | Google Scholar | PubMed
48.Ioannidis, JP. A fiasco in the making? As the coronavirus pandemic takes hold, we are making decisions without reliable data. Stat Web site. https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/. Published 2020. Accessed March 17, 2020.Google Scholar
49.Randolph, C.Remember the null hypothesis? J Neurol Neurosurg Psychiatry. 2020;91(9).CrossRef | Google Scholar | PubMed
50.Aguado, NA.Teaching research methods: learning by doing. J Public Aff Educ. 2009;15(2):251–260.CrossRef | Google Scholar
51.Glasziou, PP, Sanders, S, Hoffmann, T.Waste in covid-19 research. BMJ. 2020;369:m1847.Google Scholar | PubMed
52.Begley, S. Influential Covid-19 model uses flawed methods and shouldn’t guide U.S. policies, critics say. Stat Web site. https://www.statnews.com/2020/04/17/influential-covid-19-model-uses-flawed-methods-shouldnt-guide-policies-critics-say/. Published 2020. Accessed May 6, 2020.Google Scholar
53.Wynants, L, Van Calster, B, Bonten, MM, et al.Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;369:m1328.CrossRef | Google Scholar | PubMed
54.Bendavid, E, Mulaney, B, Sood, N, et al.COVID-19 antibody seroprevalence in Santa Clara County, California. medRxiv. 2020. doi: https://doi.org/10.1101/2020.04.14.20062463Google Scholar
55.McClellan, M, Gottlieb, S, Mostashari, F, et al. A national COVID-19 surveillance system: achieving containment. Margolis Center for Health Policy Web site. https://healthpolicy.duke.edu/sites/default/files/atoms/files/a_national_covid_surveillance_system_withcover.pdf. Published April 7, 2020. Accessed May 8, 2020.Google Scholar
56.NIH.gov. NIH begins study to quantify undetected cases of coronavirus infection. National Institutes of Health Web site. https://www.nih.gov/news-events/news-releases/nih-begins-study-quantify-undetected-cases-coronavirus-infection. Published April 10, 2020. Accessed June 10, 2020.Google Scholar
57.CDC.gov. Estimated influenza illnesses, medical visits, hospitalizations, and deaths in the United States—2017–2018 influenza season. Centers for Disease Control and Prevention, Atlanta, GA. Web site. https://www.cdc.gov/flu/about/burden/2017-2018.htm. Published 2018. Accessed May 21, 2020.Google Scholar
58.Shrestha, SS, Swerdlow, DL, Borse, RH, et al.Estimating the burden of 2009 pandemic influenza A (H1N1) in the United States (April 2009–April 2010). Clin Infect Dis. 2011;52(Suppl 1):S75–S82.CrossRef | Google Scholar
59.Brooks, SK, Webster, RK, Smith, LE, et al.The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet.2020;395(10227):912–920.CrossRef | Google Scholar
60.Hoof, EV. COVID-19 lockdown is the world’s biggest psychological experiment – and we will pay the price. World Economic Forum Web site. https://www.weforum.org/agenda/2020/04/this-is-the-psychological-side-of-the-covid-19-pandemic-that-were-ignoring/. Published April 9, 2020. Accessed May 5, 2020.Google Scholar
61.ACS-aec.ca. Leger National Weekly Pandemic Tracker. Association for Canadian Studies Web site. https://acs-aec.ca/wp-content/uploads/2020/06/Leger-National-weekly-pandemic-tracker-june-8th-2020.pdf. Published June 8, 2020. Accessed June 10, 2020.Google Scholar
62.Harper, CA, Satchell, LP, Fido, D, et al. Functional fear predicts public health compliance in the COVID-19 pandemic. International Journal of Mental Health and Addiction Web site. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7185265/. Published April 27, 2020. Accessed May 8, 2020.CrossRef | Google Scholar
63.Zhuang, Q, Wang, L, Tang, Y, et al.Translation of fear reflex into impaired cognitive function mediated by worry. Sci Bull. 2016;61(24):1841–1843.CrossRef | Google Scholar
64.Sangha, S, Diehl, MM, Bergstrom, HC, et al.Know safety, no fear. Neurosci Biobehav Rev. 2020;108:218–230.CrossRef | Google Scholar
65.Usher, K, Bhullar, N, Jackson, D.Life in the pandemic: social isolation and mental health. J Clin Nurs. 2020;29(15-16):2756–2757.CrossRef | Google Scholar | PubMed
66.Oprysko, C. Fauci: Americans should be prepared to ‘hunker down’ even more. POLITICO Web site. https://www.politico.com/news/2020/03/15/coronavirus-fauci-americans-hunker-down-130035. Published March 15, 2020. Accessed May 11, 2020.Google Scholar
67.Budrick, Z. Fauci: ‘If it looks like you’re overreacting, you’re probably doing the right thing’. The Hill Web site. https://thehill.com/homenews/sunday-talk-shows/487639-fauci-if-it-looks-like-youre-overreacting-youre-probably-doing-the. Published March 15, 2020. Accessed April 30, 2020.Google Scholar
68.McFarling, UL. ‘Where are all our patients?’: Covid phobia is keeping people with serious heart symptoms away from ERs. STAT Web site. https://www.statnews.com/2020/04/23/coronavirus-phobia-keeping-heart-patients-away-from-er/. Published April 23, 2020. Accessed May 12, 2020.Google Scholar
69.Bayer, R, Fairchild, AL. Means, ends and the ethics of fear-based public health campaigns. J Med Ethics. 2016;42(6):391–396.CrossRef | Google Scholar | PubMed
70.Gostin, L, Berkman, B. Preparing for the pandemic influenza: legal and ethical challenges. In: Ethical and Legal Considerations in Mitigating Pandemic Diseases: Workshop Summary. Vol 80. Washington, DC: Institute of Medicine; 2007.Google Scholar
71.Nicola, M, Alsafi, Z, Sohrabi, C, et al.The socio-economic implications of the coronavirus and COVID-19 pandemic: a review. Int J Surg.2020;78:185–193.CrossRef | Google Scholar | PubMed
72.Davidson, P. It‘s official: The US is in a recession, ending longest expansion in history. USA Today Web site. https://www.usatoday.com/story/money/2020/06/08/recession-begins-us-ending-longest-expansion-history/5320335002/. Published June 8, 2020. Accessed June 10, 2020.Google Scholar
73.Reger, MA, Stanley, IH, Joiner, TE.Suicide mortality and coronavirus disease 2019—a perfect storm? JAMA Psychiatry. 2020. doi: 10.1001/jamapsychiatry.2020.1060CrossRef | Google Scholar | PubMed
74.Da, BL, Im, GY, Schiano, TD.COVID-19 hangover: a rising tide of alcohol use disorder and alcohol-associated liver disease. Hepatology. 2020. doi: 10.1002/hep.31307CrossRef | Google Scholar | PubMed
75.Patrick, SL, Cormier, HC.Are our lives the experiment? COVID-19 lessons during a chaotic natural experiment–a commentary. Health Behav Policy Rev. 2020;7(2):165–169.Google Scholar
76.Secchi, P, Ciaschi, R, Spence, D. A concept for an ESA lessons learned system. Paper presented at: Proceedings of Alerts and Lessons Learned: An Effective way to prevent failures and problems 1999.Google Scholar
77.Santayana, G.The Life of Reason: Vol 1: Reason in Common Sense. Mineola NY: Dover Publications Incorporated; 1905.Google Scholar
Featured image is from Xinhua
