Surveillance for Adverse Events After COVID-19 mRNA Vaccination

Key Points

Question  Are mRNA COVID-19 vaccines associated with increased risk for serious health outcomes during days 1 to 21 after vaccination?

Findings  In this interim analysis of surveillance data from 6.2 million persons who received 11.8 million doses of an mRNA vaccine, event rates for 23 serious health outcomes were not significantly higher for individuals 1 to 21 days after vaccination compared with similar individuals at 22 to 42 days after vaccination.

Meaning  This analysis found no significant associations between vaccination with mRNA COVID-19 vaccines and selected serious health outcomes 1 to 21 days after vaccination, although CIs were wide for some rate ratio estimates and additional follow-up is ongoing.

Importance  Safety surveillance of vaccines against COVID-19 is critical to ensure safety, maintain trust, and inform policy.

Objectives  To monitor 23 serious outcomes weekly, using comprehensive health records on a diverse population.

Design, Setting, and Participants  This study represents an interim analysis of safety surveillance data from Vaccine Safety Datalink. The 10 162 227 vaccine-eligible members of 8 participating US health plans were monitored with administrative data updated weekly and supplemented with medical record review for selected outcomes from December 14, 2020, through June 26, 2021.

Exposures  Receipt of BNT162b2 (Pfizer-BioNTech) or mRNA-1273 (Moderna) COVID-19 vaccination, with a risk interval of 21 days for individuals after vaccine dose 1 or 2 compared with an interval of 22 to 42 days for similar individuals after vaccine dose 1 or 2.

Main Outcomes and Measures  Incidence of serious outcomes, including acute myocardial infarction, Bell palsy, cerebral venous sinus thrombosis, Guillain-Barré syndrome, myocarditis/pericarditis, pulmonary embolism, stroke, and thrombosis with thrombocytopenia syndrome. Incidence of events that occurred among vaccine recipients 1 to 21 days after either dose 1 or 2 of a messenger RNA (mRNA) vaccine was compared with that of vaccinated concurrent comparators who, on the same calendar day, had received their most recent dose 22 to 42 days earlier. Rate ratios (RRs) were estimated by Poisson regression, adjusted for age, sex, race and ethnicity, health plan, and calendar day. For a signal, a 1-sided P < .0048 was required to keep type I error below .05 during 2 years of weekly analyses. For 4 additional outcomes, including anaphylaxis, only descriptive analyses were conducted.

Results  A total of 11 845 128 doses of mRNA vaccines (57% BNT162b2; 6 175 813 first doses and 5 669 315 second doses) were administered to 6.2 million individuals (mean age, 49 years; 54% female individuals). The incidence of events per 1 000 000 person-years during the risk vs comparison intervals for ischemic stroke was 1612 vs 1781 (RR, 0.97; 95% CI, 0.87-1.08); for appendicitis, 1179 vs 1345 (RR, 0.82; 95% CI, 0.73-0.93); and for acute myocardial infarction, 935 vs 1030 (RR, 1.02; 95% CI, 0.89-1.18). No vaccine-outcome association met the prespecified requirement for a signal. Incidence of confirmed anaphylaxis was 4.8 (95% CI, 3.2-6.9) per million doses of BNT162b2 and 5.1 (95% CI, 3.3-7.6) per million doses of mRNA-1273.

Conclusions and Relevance  In interim analyses of surveillance of mRNA COVID-19 vaccines, incidence of selected serious outcomes was not significantly higher 1 to 21 days postvaccination compared with 22 to 42 days postvaccination. While CIs were wide for many outcomes, surveillance is ongoing.

Safe and effective vaccines against SARS-CoV-2 are critical to ending the pandemic. Two messenger RNA (mRNA) vaccines (BNT162b2, Pfizer-BioNTech; and mRNA-1273, Moderna) were the first SARS-CoV-2 vaccines authorized in the US.^1,2 Large phase 3 trials for BNT162b2 and mRNA-1273 demonstrated that both vaccines were more than 94% effective against symptomatic SARS-CoV-2 infection.^3,4 Neither trial reported serious safety findings, and both observed low incidence of serious adverse events.

The BNT162b2 vaccine received an Emergency Use Authorization on December 11, 2020¹; mRNA-1273, on December 18, 2020.² Vaccinations began in mid-December.⁵

Rare or serious outcomes associated with a vaccine may not be identified in phase 3 trials because of limited sample size, restrictive inclusion criteria, limited duration of follow-up, and trial participants who may differ from the population ultimately receiving the vaccine. Furthermore, there is limited experience with mRNA platforms.⁶ Surveillance is critical to ensure safety, maintain trust, and inform policy.

Since 2006, the Vaccine Safety Datalink,⁷ a collaboration between US health plans and the Centers for Disease Control and Prevention (CDC), has conducted weekly vaccine surveillance known as rapid cycle analysis.^8-11 When the first COVID-19 vaccine was administered in December 2020, weekly monitoring started immediately. This report includes interim findings on risk of adverse events after receipt of mRNA COVID-19 vaccines through June 2021.

This study was approved by the institutional review boards of all participating health plan sites, with a waiver of informed consent, and was conducted consistent with federal law and CDC policy.

The population covered by the 8 data-contributing health plans comprises 12 506 658 people, representing 3.6% of the US population, and includes all ages, with approximately 16% aged 65 years or older and 20% younger than 18 years. Participating sites (Kaiser Permanente: Colorado, Northern California, Northwest, Southern California, and Washington; Marshfield Clinic; HealthPartners; and Denver Health) have comprehensive medical records for their members.

Participating sites routinely create dynamic files that are updated weekly and contain information on demographics (including race and ethnicity in fixed categories based on self-reported data from the participating health plans), immunizations, and diagnosis codes associated with all outpatient, emergency, and hospital encounters. Sites included race and ethnicity to identify disparities regarding vaccination rates.^12,13 In response to the pandemic, we created additional weekly files, including COVID-19 diagnoses and laboratory results. Surveillance included the 10 162 227 members of participating health plans aged 12 years or older.

Vaccination date, manufacturer, and dose number for each COVID-19 vaccine were recorded at the participating sites for the doses they delivered. All sites also capture COVID-19 vaccines administered outside of their health care system, including those administered in nursing homes, retail pharmacies, and government-run vaccination clinics; self-reported vaccinations; and those recorded in state immunization registries. This report includes only mRNA vaccines.

Each week since December 14, 2020, when vaccinations against COVID-19 began, we updated and analyzed all vaccinations and outcomes in the surveillance population. We analyzed the accumulating data to regularly update the Advisory Committee on Immunization Practices and address emerging vaccine safety concerns that arose elsewhere. The primary analyses compared outcome rates during risk intervals for individuals recently vaccinated with rates during comparison intervals for those less recently vaccinated. The surveillance protocol, including planned analyses not presented here, is available at https://www.cdc.gov/vaccinesafety/ensuringsafety/monitoring/emergencypreparedness/index.html.

Our COVID-19 vaccine surveillance is anticipated to continue for a minimum of 2 years. This interim report includes mRNA vaccinations and outcome events from December 14, 2020, through June 26, 2021.

We targeted 23 serious outcomes after consultation with CDC and study investigators in coordination with partners from the Food and Drug Administration, Department of Defense, and Department of Veterans Affairs (Table 1). We selected outcomes based on (1) inclusion in prior vaccine safety studies (acute disseminated encephalomyelitis, anaphylaxis, encephalitis/myelitis, Guillain-Barré syndrome, immune thrombocytopenia, Kawasaki disease, narcolepsy, seizures, and transverse myelitis); (2) imbalances in phase 3 COVID-19 vaccine clinical trials (appendicitis, Bell palsy); (3) hypothetical concerns regarding an association with COVID-19 disease (acute myocardial infarction, acute respiratory distress syndrome, disseminated intravascular coagulation, multisystem inflammatory syndrome in children and adults, myocarditis/pericarditis, pulmonary embolism, stroke [hemorrhagic and ischemic], thrombotic thrombocytopenic purpura, and venous thromboembolism); or (4) emerging concerns that have arisen during the course of surveillance (cerebral venous sinus thrombosis,¹⁴ thrombosis with thrombocytopenia syndrome,¹⁵ and a younger subgroup of the myocarditis/pericarditis outcome¹⁶). We limited most outcomes to the emergency department and inpatient settings; however, we included immune thrombocytopenia, Bell palsy, narcolepsy, and venous thromboembolism diagnosed in the outpatient setting (Table 1). We used International Statistical Classification of Diseases and Related Health Problems, 10th Revision codes to identify outcomes and developed algorithms to ascertain incident cases based on prior studies, published literature, or expert opinion (eTables 1 and 2 in the Supplement). Where available, we also used an internal diagnostic code, “anaphylaxis due to COVID-19 vaccine” (all settings, including outpatient), to supplement case identification; these patients were required to have also sought care in the emergency department or inpatient setting on days 0 to 1. Clinical subject matter experts consulted on case ascertainment criteria for all outcomes.

Surveillance activities included medical record reviews as needed to investigate potential signals or emerging concerns.

We prespecified that within 84 days after vaccination, all cases of Guillain-Barré syndrome, acute disseminated encephalomyelitis, transverse myelitis, cerebral venous sinus thrombosis, and myocarditis/pericarditis (among individuals aged 12-39 years) were to be reviewed and included in analyses only if confirmed. Medical record reviews were designed to ascertain both the diagnosis and the time of onset. We used the onset dates from these medical record reviews for the primary analysis.

All potential cases of anaphylaxis in vaccinated individuals during days 0 to 1 after vaccination also underwent a limited medical record review soon after identification to confirm diagnosis and exclude those with exposure to other known triggers (eg, peanut). This was followed by complete review 30 days later to include records from subsequent allergy and external health care encounters and adjudicated with the Brighton Collaboration criteria.¹⁷ Brighton criteria require sudden onset after vaccination, rapid progression of signs and symptoms, involvement of 2 or more organ systems, and no clear alternative etiology for anaphylaxis. To allow 30 days for a complete review, we included cases identified through May 29, 2021.

We compared outcome incidence during a risk interval of days 1 to 21 after vaccination with outcome incidence in vaccinated concurrent comparators (eFigure 1 in the Supplement). These comparators were vaccinees who were concurrently—on the same calendar day—in a comparison interval that was 22 to 42 days after their most recent COVID-19 vaccination. For example, on March 1 individuals who were in their risk interval (eg, vaccinated from February 8-28) were compared with vaccinees who on March 1 had had their most recent dose 22 to 42 days earlier (eg, vaccinated January 18 to February 7). Vaccinees contributed to the primary analyses as exposed when in a 21-day risk interval after dose 1 or 2; they contributed as unexposed when in the comparison interval 22 to 42 days after their most recent dose. A similar comparison interval has been used in other vaccine safety studies.¹⁸ This interval is valuable to prioritize timely detection of an early elevated risk; a substantial delay before comparator follow-up was observable would delay timely detection. In addition, a longer delay postvaccination could increase the potential for bias arising from unmeasured factors associated with receiving vaccination earlier vs later.

To reduce the possibility of confounding by demographic factors and factors associated with calendar time, we conducted analyses within strata defined by 5-year age group, sex, 8 race and ethnicity groups (those missing race or ethnicity were categorized as unknown), site, and calendar day. Race and ethnicity was used to adjust for confounding that may have arisen if the factor was associated with vaccination dates and outcome events.

We used Poisson regression to estimate an adjusted rate ratio (RR) and corresponding 95% CI, estimating the incidence in the risk interval compared with incidence in the comparison interval, averaged over the strata and calendar days. We reported nominal 95% CIs rather than CIs widened to correspond with the sequential tests that are described later because nominal CIs are more interpretable in this surveillance. The study protocol specified that nominal CIs continue to be updated and reported regardless of whether any sequential test yielded a signal.

Each Poisson regression model was fitted to aggregated count data: on each calendar day in each age-sex-race-site stratum, we counted the numbers of vaccinees and outcomes in the risk and comparison intervals. The dependent variable was the number of outcomes in the interval, the primary independent variable was whether the interval was a risk interval vs a comparison interval, and the offset term was the natural logarithm of the number of vaccinees in the interval. A stratum was informative only on a day when there was at least 1 person in the risk interval, at least 1 person in the comparison interval, and at least 1 outcome in either the risk interval or the comparison interval.

To estimate excess risk per million doses, we divided the risk interval’s crude incidence rate by the adjusted RR, and then subtracted the result from the risk interval’s crude incidence rate.

In this report, we feature analyses that combine follow-up after receipt of the BNT162b2 and mRNA-1273 vaccines and combine follow-up in the 21-day risk interval after dose 1 with follow-up in the 21-day risk interval after dose 2. Separate analyses were also conducted for each vaccine type and dose.

We conducted supplemental analyses to address emerging concerns about myocarditis/pericarditis, which included shorter risk intervals and examined temporal clustering of outcome events after vaccination, using the Kulldorff scan statistic.¹⁹

We also conducted supplemental analyses with unvaccinated concurrent comparators, using methods similar to those of the analyses with vaccinated concurrent comparators (eFigure 1 in the Supplement). For each calendar day, we compared the vaccinees in each age-sex-race-site stratum who were in the risk interval with all individuals in the same age-sex-race-site stratum who were unvaccinated on that calendar day. Analyses with unvaccinated comparators were considered supplemental—whereas vaccinated comparators were primary—under the assumption that vaccinees in the risk interval tended to be more similar to those in the comparison interval than to unvaccinated individuals (some of whom are unlikely ever to be vaccinated).

Supplemental analyses were intended to provide context for interpreting primary analyses and emerging concerns; they did not have a prespecified threshold for a statistical signal.

Sequential tests were conducted weekly. For all outcomes except anaphylaxis, acute respiratory distress syndrome, multisystem inflammatory syndrome, and narcolepsy (discussed later), we conducted 1-sided sequential tests of the null hypothesis that the vaccine did not affect risk during the risk interval. The threshold for a signal was 1-sided P < .0048 to keep the overall chance of making a type I error below .05 during 2 years of weekly analyses (according to a Pocock-style alpha-spending plan,²⁰ designed by simulation). A signal would end formal sequential testing but would not end surveillance activities for that outcome. Rather, surveillance would continue to help interpret the signal. The sequential test threshold was designed to account for the number of weekly tests of the same hypothesis, but not for the multiplicity of hypotheses across different outcomes. The multiplicity of different hypotheses tested would be considered informally in the context of investigating signals. If there were a signal, it would be interpreted as exploratory insofar as the large number of hypotheses tested increases the possibility of a false-positive signal.

We conducted only descriptive monitoring for anaphylaxis, acute respiratory distress syndrome, multisystem inflammatory syndrome, and narcolepsy (ie, no RR estimates or hypothesis tests), given the lack of appropriate comparators. For these outcomes, we tabulated all observed cases that occurred within 84 days postvaccination.

For anaphylaxis, we also estimated the rate of confirmed anaphylaxis per million doses.

We used SAS version 9.4 (SAS Institute) for all analyses.

From December 14, 2020, through June 26, 2021, 11 845 128 total doses of mRNA vaccines were administered to 6.2 million individuals (mean age, 49 years; 54% female). Of these, 6 754 348 were BNT162b2 and 5 090 780 were mRNA-1273 vaccines. There were 6 175 813 first doses and 5 669 315 second doses (Table 2). Overall, vaccinees aged 18 to 49 years received the largest number of doses (5 124 940); however, vaccination coverage was highest among members aged 75 years or older (82.4% with 1 dose; 79.2% with 2). Coverage was also higher among White and Asian persons compared with other racial and ethnic groups, including among the 11.7% of the surveillance population categorized as unknown race.

The number of outcome events during the 21-day risk interval ranged from 0 for Kawasaki disease to 1059 (1612 per 1 000 000 person-years) for ischemic stroke (Table 3). In weekly analyses, none of the outcomes met the signaling criteria of 1-sided P < .0048 (Table 3). In analyses through June 26, 2021, the incidence per 1 000 000 person-years during the risk and comparison intervals and adjusted RR ranged from 45 vs 69 (RR, 0.70; 95% CI, 0.39-1.28) for disseminated intravascular coagulation to 9 vs 6 (RR, 2.60; 95% CI, 0.47-20.66) for thrombotic thrombocytopenic purpura. For the most frequent outcomes, the incidence per 1 000 000 person-years during the risk vs comparison intervals and adjusted RR for ischemic stroke were 1612 vs 1781 (RR, 0.97; 95% CI, 0.87-1.08); for appendicitis, 1179 vs 1345 (RR, 0.82; 95% CI, 0.73-0.93); for acute myocardial infarction, 935 vs 1030 (RR, 1.02; 95% CI, 0.89-1.18); for venous thromboembolism, 952 vs 896 (RR, 1.16; 95% CI, 1.00-1.34); and for Bell palsy, 822 vs 825 (RR, 1.00; 95% CI, 0.86-1.17). The highest estimates of excess cases per million doses were 7.5 (95% CI, –0.1 to 14.0) for venous thromboembolism and 1.2 (95% CI, –6.9 to 8.3) for acute myocardial infarction (Table 3).

None of the 10 cerebral venous sinus thrombosis cases were associated with thrombocytopenia.

None of the dose 1, dose 2, and vaccine product analyses met the signaling criteria of a 1-sided P < .0048 (eTable 3 in the Supplement).

During days 0 to 21 postvaccination, there were a total of 34 cases of confirmed myocarditis/pericarditis among individuals aged 12 to 39 years, of whom 53% were aged 12 to 24 years, 85% were male, 82% were hospitalized (median length of stay, 1 day), and nearly all were recovered at record review (eTable 4 in the Supplement). Cases were significantly clustered within the 0 to 5 days after vaccination (P < .001) (eFigure 2 in the Supplement). In supplemental analyses using vaccinated concurrent comparators, incidence per 1 000 000 person-years during the risk vs comparison intervals and adjusted RR were 321 vs 35 (RR, 9.83; 95% CI, 3.35-35.77) during days 0 to 7 after vaccination, corresponding to 6.3 additional cases per million doses (95% CI, 4.9-6.8) (Table 4). After dose 2, RR estimates were higher for both BNT162b2 and mRNA-1273 vaccines (eTable 5 in the Supplement).

Supplemental analyses among all ages, using unvaccinated comparators, were mostly consistent with the primary vaccinated comparator analyses; however, for myocarditis/pericarditis, incidence per 1 000 000 person-years during the risk vs comparison intervals and adjusted RR were 132 vs 83 (RR, 1.39; 95% CI, 1.05-1.82) (eTable 6 in the Supplement).

There were 183 potential anaphylaxis cases during days 0 to 1 after vaccination; 171 (93%) underwent full review and 55 (32%) were confirmed and adjudicated at Brighton level 1 to 3 (Table 5). Nearly all confirmed anaphylaxis cases were in female individuals (95%), occurred on the day of vaccination (98%), and occurred after dose 1 (82%); most individuals had a history of allergies (78%) and had symptom onset within 30 minutes (87%). The estimated incidence rate of confirmed anaphylaxis was 4.8 (95% CI, 3.2-6.9) per million BNT162b2 doses and 5.1 (95% CI, 3.3-7.6) per million mRNA-1273 doses.

During the 21 days after vaccination, 12 individuals received a diagnosis of acute respiratory distress syndrome, 6 of multisystem inflammatory syndrome, and 29 of narcolepsy; follow-up will continue through 84 days after vaccination.

In this interim analysis of surveillance monitoring of more than 11.8 million doses of 2 mRNA vaccines in a diverse population and weekly analyses from December 14, 2020, to June 26, 2021, no vaccine-outcome association met the prespecified threshold for a signal. Incidence of selected serious outcomes was not significantly higher 1 to 21 days postvaccination compared with 22 to 42 days postvaccination for any of the outcomes. For the less frequent outcomes, CIs were wide and did not necessarily exclude clinically relevant increases associated with vaccination, and surveillance is ongoing.

This current surveillance complements other vaccine safety monitoring systems in the US, including the Vaccine Adverse Event Reporting System (VAERS) and v-safe.²¹ Key strengths of this surveillance are that it is population based, geographically diverse, and updated weekly. Outcome incidence among vaccinees in a risk interval was compared with outcome incidence among similar vaccinees who were in their comparison interval on the same calendar date. Thus, the comparison group for each outcome event was similar in demographic characteristics to the case and was in follow-up on the same day at the same site, avoiding biases that can arise from variations in health care use during the pandemic, as well as day-to-day variations (eg, Sunday to Monday). In addition, the primary analyses focused on vaccinated rather than unvaccinated comparators. Every vaccinee contributed to the primary analyses by first contributing to the risk interval and then to the comparison interval. Individuals with recent vaccination were expected to be more similar to those with more remote vaccination than they were to unvaccinated individuals, which, over time, was expected to yield comparisons that were better balanced than were comparisons of vaccinees with unvaccinated comparators. Furthermore, access to comprehensive medical records permitted rapid case confirmation when appropriate.

In response to concerns regarding an association between thromboembolic outcomes with thrombocytopenia and ChAdOx1 nCoV-19 (AstraZeneca)^22,23 and Ad26.COV.2.S (Janssen) vaccines,^14,15 surveillance for additional outcomes (cerebral venous sinus thrombosis and thrombosis with thrombocytopenia syndrome) was initiated. There has been no evidence that these outcomes are associated with mRNA vaccines. Close monitoring will continue for thromboembolic outcomes with thrombocytopenia after vaccination with all COVID-19 vaccines, including the Ad26.COV.2.S vaccine.

Analyses of all ages combined did not detect a significant association between myocarditis/pericarditis and mRNA vaccines. However, consistent with case reports,^16,24 supplemental analyses of confirmed cases among individuals aged 12 to 39 years yielded an elevated RR estimate. Significant clustering within the first week after vaccination, especially after dose 2, provides additional evidence of an association between mRNA vaccines and myocarditis/pericarditis in younger individuals.

Anaphylaxis after COVID-19 mRNA vaccination has been observed more commonly than the estimated 1 to 2 cases per million doses reported after receipt of influenza vaccine and some other vaccines.²⁵ Estimated anaphylaxis incidence rates after receipt of both BNT162b2 and mRNA-1273 vaccines in this study were similar to rates after receipt of mRNA vaccines in other reports,^21,26 although somewhat higher than VAERS estimated reporting rates.²⁷ In contrast, estimated anaphylaxis incidence rates were much lower than the 24.7 cases of confirmed anaphylaxis per 100 000 vaccinees estimated through prospective surveillance of health care workers.²⁸ Consistent with reports from the European Union and Japan,²⁹ nearly all anaphylaxis after receipt of mRNA vaccines occurred among female recipients. Although the biological mechanism for the higher incidence among female vaccinees is not clear, it may be related to genes, hormones, and environmental and immunologic factors.³⁰

The phase 3 trials for both the BNT162b2 and mRNA-1273 vaccines noted that the incidence of Bell palsy was higher in the vaccine group than in the placebo group.^3,4 Among nearly 40 000 vaccinees in both trials combined, there were 7 cases of Bell palsy vs 1 in the placebo group, corresponding to an RR of 7 (P = .07).³¹ In this current surveillance, neither the primary analyses nor those with unvaccinated comparators found evidence of an association between Bell palsy and mRNA vaccines, a finding that is consistent with a recent analysis of cases reported to the World Health Organization database.³²

This study has several limitations. First, the statistical power of these early analyses was limited, especially for the less frequent outcomes. The 95% CIs around some of the RR estimates were wide and included clinically relevant risks. Six outcomes in the primary analyses yielded CIs that included RR estimates greater than 2.0, levels that may be clinically important even if outweighed by the COVID-19 outcomes prevented. During the next few months, the precision of the RR estimates will improve as follow-up accumulates. Second, vaccinees contributed follow-up in the risk interval before they contributed it in the comparison interval, and bias might arise if unmeasured variables associated with earlier vaccination were also associated with having an outcome. Third, there may be interest in specific outcomes that were not initially included or were included within a much broader category. However, additional outcomes were added in response to emerging concerns. Fourth, risk may be underestimated or missed if the real risk interval was modestly longer (ie, 1 week) beyond 21 days after exposure to a first or second dose or perhaps several weeks longer. Fifth, although vaccinees were followed for several months after vaccination, possible longer-term risks of vaccination were not being monitored. Sixth, only medically attended outcomes were included; thus, analyses could have underestimated risk if health care was not sought. Although the outcomes monitored are serious and usually associated with seeking care, anaphylaxis incidence may have been underestimated if individuals either received care in alternate settings or self-treated at the event.

In interim analyses of surveillance of mRNA COVID-19 vaccines, incidence of selected serious outcomes was not significantly higher 1 to 21 days postvaccination compared with 22 to 42 days postvaccination. While CIs were wide for many outcomes, surveillance is ongoing.

Corresponding Author: Nicola P. Klein, MD, PhD, Kaiser Permanente Vaccine Study Center, 1 Kaiser Plaza, 16th Floor, Oakland, CA 94612 (nicola.klein@kp.org).

Accepted for Publication: August 18, 2021.

Published Online: September 3, 2021. doi:10.1001/jama.2021.15072

Author Contributions: Dr Klein had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Klein, Lewis, Goddard, Fireman, Zerbo, Naleway, Nelson, Shimabukuro, DeStefano, Weintraub.

Acquisition, analysis, or interpretation of data: Lewis, Goddard, Fireman, Zerbo, Hanson, Donahue, Kharbanda, Naleway, Nelson, Xu, Yih, Glanz, Williams, Hambidge, Lewin, Shimabukuro, DeStefano, Weintraub.

Drafting of the manuscript: Klein, Lewis, Goddard, Fireman, Weintraub.

Critical revision of the manuscript for important intellectual content: Lewis, Goddard, Fireman, Zerbo, Hanson, Donahue, Kharbanda, Naleway, Nelson, Xu, Yih, Glanz, Williams, Hambidge, Lewin, Shimabukuro, DeStefano, Weintraub.

Statistical analysis: Lewis, Fireman, Nelson, Xu, Glanz, Lewin, Weintraub.

Obtained funding: Klein, Goddard, Zerbo, Hanson, Donahue, Weintraub.

Administrative, technical, or material support: Goddard, Hanson, Donahue, Yih, Hambidge, Shimabukuro, Weintraub.

Supervision: Klein, Hambidge, Shimabukuro, DeStefano, Weintraub.

Case review and adjudication, vaccine capture in the health record: Lewin.

Conflict of Interest Disclosures: Dr Klein reported receiving grants from the Centers for Disease Control and Prevention (CDC) during the conduct of the study, and grants from Pfizer, Merck, GSK, Sanofi Pasteur, and Protein Science (now SP) outside the submitted work. Ms Hanson reported receiving grants from CDC during the conduct of the study. Dr Donahue reported receiving grants from CDC during the conduct of the study and from Janssen Vaccines & Prevention for a study unrelated to COVID-19 vaccines. Dr Kharbanda reported receiving other from CDC (contract 200-2012-53526) during the conduct of the study. Dr Naleway reported receiving grants from CDC during the conduct of the study and grants from Pfizer outside the submitted work. Dr Nelson reported receiving grants from Moderna outside the submitted work. Dr Yih reported receiving grants from Pfizer outside the submitted work. Dr Williams reported receiving grants from CDC Vaccine Safety Datalink COVID-19 Infrastructure Funding during the conduct of the study. Dr Lewin reported receiving grants from CDC Vaccine Safety Datalink during the conduct of the study. No other disclosures were reported.

Funding/Support: This study was supported by grant funding from the CDC, contract 200-2012-53581/0001.

Role of the Funder/Sponsor: The study sponsor, CDC, participated as a coinvestigator and contributed to protocol development, conduct of the study, interpretation of the data, review and revision of the manuscript, approval of the manuscript through official CDC scientific clearance processes, and the decision to submit the manuscript for publication. CDC authors must receive approval through the CDC scientific clearance process to submit an article for publication. Final decision to submit rested with the first author. The study sponsor did not have the right to direct the submission to a particular journal.

Disclaimer: The findings and conclusions in this article are those of the authors and do not necessarily represent the official position of the CDC. Mention of a product or company name is for identification purposes only and does not constitute endorsement by CDC.

Additional Contributions: We thank Ed Belongia, MD (Marshfield Clinic Research Institute) for providing clinical expertise for this manuscript. We thank Rachael Burganowski, MS (Kaiser Permanente Washington Health Research Institute), Bradley Crane, MS (Center for Health Research, Kaiser Permanente Northwest), Sungching Glenn, MS (Research and Evaluation, Kaiser Permanente Southern California), Tat’Yana Kenigsberg, MPH (Immunization Safety Office, Centers for Disease Control and Prevention), Erica Scotty, MS (Marshfield Clinic Research Institute), Gabriela Vazquez Benitez, PhD (HealthPartners Institute), Arnold Yee, BS (Kaiser Permanente Vaccine Study Center, Kaiser Permanente Northern California), and Jingyi Zhu, PhD (HealthPartners Institute), for their contributions to data collection and preparation. We thank Nandini Bakshi, MD (The Permanente Medical Group), Tom Boyce, MD (Marshfield Clinic Research Institute), Jennifer Covey, BS (Kaiser Permanente Washington Health Research Institute), Jonathan Duffy, MD (Immunization Safety Office, Centers for Disease Control and Prevention), Stacy Harsh, BSN, RN (Center for Health Research, Kaiser Permanente Northwest), Linda Heeren, BS (Marshfield Clinic Research Institute), Juraj Kavecansky, MD (Kaiser Permanente Northern California, Antioch Medical Center), Mike M. McNeil, MD (Immunization Safety Office, Centers for Disease Control and Prevention), Tanya Myers, PhD (Immunization Safety Office, Centers for Disease Control and Prevention), Matthew E. Oster, MD, MPH (Centers for Disease Control and Prevention, COVID-19 Response), Ashok Pai, MD (Kaiser Permanente Northern California, Oakland Medical Center), and Pat Ross, BA (Kaiser Permanente Vaccine Study Center, Kaiser Permanente Northern California), for their contributions to medical record review and adjudication. We thank Laurie Aukes, RN (Kaiser Permanente Vaccine Study Center, Kaiser Permanente Northern California), Cheryl Carlson, MPH (Research and Evaluation, Kaiser Permanente Southern California), Stephanie Irving, MHS (Center for Health Research, Kaiser Permanente Northwest), Mara Kalter, MA (Center for Health Research, Kaiser Permanente Northwest), Tia Kauffman, MPH (Center for Health Research, Kaiser Permanente Northwest), Erika Kiniry, MPH (Kaiser Permanente Washington Health Research Institute), Leslie Kuckler, MPH (HealthPartners Institute), Denison Ryan, MPH (Research and Evaluation, Kaiser Permanente Southern California), and Lina Sy, MPH (Research and Evaluation, Kaiser Permanente Southern California), for their contributions to overall project management. All non-CDC personnel received financial compensation through CDC Vaccine Safety Datalink grant funding for their work on this project. CDC personnel were not compensated for their role in the study.