Article Text

Download PDFPDF

Original research article
Differences in relative and absolute effectiveness of oral P2Y 12 inhibition in men and women: a meta-analysis and modelling study
  1. Kuan Ken Lee1,
  2. Nicky Welton2,
  3. Anoop S Shah1,
  4. Philip D Adamson1,
  5. Sofia Dias2,
  6. Atul Anand1,
  7. David E Newby1,
  8. Nicholas L Mills1,
  9. David A McAllister3
  1. 1 BHF Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK
  2. 2 School of Social and Community Medicine, University of Bristol, Bristol, UK
  3. 3 Institute for Health and Wellbeing, University of Glasgow, Glasgow, UK
  1. Correspondence to Dr David A McAllister, Institute of Health and Wellbeing, University of Glasgow, Glasgow G12 8RZ, UK; david.mcallister{at}glasgow.ac.uk

Abstract

Objective To estimate the absolute treatment effects of newer P2Y12 inhibitors (ticagrelor and prasugrel) compared with clopidogrel in men and women with acute coronary syndrome (ACS).

Methods We searched Ovid MEDLINE, Embase and the Cochrane Central Register of Controlled Trials for randomised controlled trials of oral P2Y12 inhibitors for acute stroke or ACS. Age-specific and sex-specific mortality was obtained for all patients admitted to hospital with myocardial infarction in Scotland from 2006 to 2010 (prior to introduction of prasugrel or ticagrelor).

Results From 9277 articles, nine fulfilled our inclusion criteria. Three trials compared newer P2Y12 inhibitors to clopidogrel in ACS, in which the treatment rate ratio (RR) for major adverse cardiovascular events in men was 0.80 (95% CI 0.69 to 0.93). For the same outcome, across all nine trials, the sex–treatment interaction RR was 1.08 (95% CI 0.98 to 1.19). Combining these estimates yielded a treatment RR in women of 0.86 (95% CI 0.72 to 1.04).

17 842 women and 27 818 men were admitted to hospital with myocardial infarction. Mortality was higher for women than men for all-cause (5708, 32.0% vs 5891, 21.2%), cardiovascular (4032, 22.6% vs 4117, 14.8%) and bleeding (193, 1.1% vs 228, 0.8%) deaths.

On applying the sex-specific RRs to this population, the absolute risk reduction for mortality at 1 year was similar for women and men for all-cause (2.30% (95% CI −0.92% to 5.22%) vs 2.47% (95% CI 0.62% to 4.10%)), cardiovascular (2.70% (95% CI −0.63% to 5.74%)) vs 2.72% (95% CI 0.92% to 4.35%)) and bleeding (−0.27% (95% CI −1.06% to 0.30%) vs −0.18% (95% CI −0.71% to 0.24%)) deaths.

Conclusion Newer P2Y12 inhibitors may be slightly less efficacious in women than men, but the absolute risk reduction is similar in both sexes.

  • acute coronary syndromes
  • acute myocardial infarction
  • epidemiology and meta-analysis

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Background

Despite large falls in cardiovascular mortality over the past two decades, overall annual cardiovascular mortality rates remain higher for women than for men.1 There are important sex differences in the pathophysiology, clinical presentation and clinical outcomes of women with cardiovascular disease compared with men; women with cardiovascular disease remain an understudied, underdiagnosed and undertreated group.2–4

Oral P2Y12 inhibitors are a mainstay of treatment for acute coronary syndrome (ACS). They have been evaluated across a broad spectrum of cardiovascular disease in several randomised controlled trials. Consequently, most clinical guidelines recommend P2Y12 inhibitors for ACS.5–8

A recent individual-level patient data (IPD) meta-analysis compared efficacy of novel P2Y12 inhibitors for women and men with stable and acute coronary artery disease, finding very similar relative treatment effects (HRs) for major adverse cardiovascular events, bleeding and all-cause mortality.9 Importantly, the study also presented absolute differences in treatment effects in women and men; since women experienced a higher baseline risk of subsequent cardiovascular events, this meant they also received greater overall treatment benefits than men.

However, the absolute treatment effects were also obtained using the trial data, and people with myocardial infarction enrolled in clinical trials are on average younger, less frequently hospitalised, at lower risk of adverse events and less likely to have comorbid disease than people with myocardial infarction identified in disease registers.10 11 Moreover, the previous review included patients treated with intravenous P2Y12 inhibitors during elective percutaneous coronary intervention as well as patients with stable coronary disease. Consequently, it is not known whether men and women experience similar benefits from P2Y12 inhibitors following acute hospitalisations for myocardial infarction.

The objective of this study is therefore to (1) identify whether there exist sex–treatment interactions in the relative efficacy of P2Y12 inhibitors and (2) to estimate the effect, in patients typically seen in clinical practice, of any such differences on the absolute treatment benefits obtained from prasugrel or ticagrelor versus clopidogrel.

Methods

We conducted a systematic review of trials of P2Y12 inhibitors in men and women and meta-analysed these data to produce sex-specific estimates of relative treatment efficacy for novel P2Y12 inhibitors (prasugrel and ticagrelor) in ACS and acute cerebrovascular disease. We subsequently combined these estimates with data on event rates in a target population that was not exposed to novel P2Y12 inhibitors in order to estimate the absolute treatment effect in a real-world population.

Ethical approval was not sought as data were either published or were aggregated at country level by the national organisation responsible for publishing health outcome data.

Systematic review

Search strategy

We searched, without language restriction, using Ovid MEDLINE and Embase (from 1946 to 16 July 2017) and the Cochrane Central Register of Controlled Trials for: ‘ischaemic heart disease’, ‘acute coronary syndrome’, ‘myocardial infarction’, ‘angina’, ‘stroke’, ‘cerebrovascular disease’, ‘P2Y12 inhibitor’, ‘clopidogrel’, ‘prasugrel’, ‘ticagrelor’ and ‘randomised controlled trials’ (detailed search strategy in online supplementary appendix). We also hand-searched the bibliography of included studies and relevant review articles.

Supplementary appendix

Selection of articles and extraction of data

Studies were included if they met the following inclusion criteria: (1) randomised controlled trials of oral P2Y12 inhibitors in ACS or stroke and (2) trials providing data on major adverse cardiovascular events stratified by sex. We excluded randomised controlled trials (RCTs) of intravenous P2Y12 inhibitors and RCTs that evaluated different durations of P2Y12 therapy. One investigator (KKL) performed initial screening of titles and abstracts. A random sample of 200 titles and abstracts were assessed during the initial screening process by a second investigator (AS) without disagreements. Two investigators examined the full-text reports for eligibility according to our prespecified review protocol. Data extraction was carried out independently by KKL and AS and adjudicated by AA.

Definition of outcomes

The clinical outcome examined in this review was the composite endpoint ‘major adverse cardiovascular events’ (MACE) reported as the primary efficacy endpoint in each individual trial (table 1). Outcomes include elements of cardiovascular mortality, all-cause mortality, myocardial infarction, stroke (ischaemic or haemorrhagic) and occluded infarct-related coronary artery. We also examined the safety outcome of bleeding as defined by the individual studies that used either standardised Thrombolysis in Myocardial Infarction (TIMI) or Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries definitions, or trial specific criteria (table 1).

Table 1

Design of trials included in meta-analysis

Target population

NHS National Services Scotland provided data on deaths at 1 year following a hospital admission with myocardial infarction from the national linked hospitalisation and death database. Myocardial infarction admissions were those assigned a WHO 10th International Classification of Diseases 10 code (ICD-10) of I21 or I22.12 All people in Scotland aged 30–99 years who had such an admission during the 5-year time period from 2006 to 2010 were included. This period was chosen as neither prasugrel nor ticagrelor was available at that time, such that aspirin and clopidogrel was the standard treatment for non-ST elevation myocardial infarction. Where patients had multiple admissions during this period, only the first episode was included.

Deaths were defined as cardiovascular (I00–I99), bleeding (see online supplementary appendix) or non-bleeding, non-cardiovascular deaths. Bleeding codes were selected based on those used to identify Bleeding Academic Research Consortium13 bleeding by the Clinical research using LInked Bespoke studies and Electronic health Records group for use in the MINAP database .14 Deaths for which both bleeding and cardiovascular codes had been recorded were defined as bleeding deaths for the purpose of this analyses.

Statistical analysis

Trials were categorised by indication (ACS or stroke) with ACS trials being further split by treatment (newer P2Y12 inhibitors vs clopidogrel or clopidogrel vs placebo). We extracted number of events and total number randomised for each treatment broken down by sex for each trial, fitting a hierarchical generalised linear model with a binomial likelihood and a cumulative log–log link. The model estimates relative treatment effects, directly comparing greater versus weaker/absent P2Y12 inhibition (ticagrelor/prasugrel>clopidogrel>placebo), with terms for the intercept, sex and treatment, as well as a sex–treatment interaction term to allow for sex-specific treatment effects. We explored three different models for the interaction: an identical interaction for all trials within the drug class, shared interactions between trials within the drug class (using the assumption of exchangeability of covariate–treatment interactions within drug class15) and shared interactions between trials having stratified by indication/treatment. We used the posterior mean deviance and deviance information criteria (DIC) to choose between models, preferring models with lower values of dbar and DIC.

The analysis was run separately for MACE and bleeding outcomes. For the MACE outcome, minimally informative priors were used. Due to small amounts of data for the bleeding outcome, we specified an informative prior to constrain the magnitude of the estimated sex–treatment interaction (normal distribution, mean=0, SD=0.114), and only ran the shared interaction model.

For both MACE and bleeding, sex-specific relative treatment effect estimates for prasugrel or ticagrelor versus clopidogrel were obtained by combining the overall sex–treatment interaction derived from all included trials with the treatment effect in men for trials of prasugrel or ticagrelor versus clopidogrel (figure 1A).

Figure 1

Overview of data sources used in modelling. Panel A shows the data sources used to estimate the relative treatment efficacy of newer P2Y12 inhibitors in women and men and panel B shows the data sources used to estimate the absolute treatment effect. PLATO, Platelet Inhibition and Patient Outcomes Trial; TRILOGY ACS, Targeted Platelet Inhibition to Clarify the Optimal Strategy to Medically Manage Acute Coronary Syndromes; TRITON-TIMI 38, Trial to Assess Improvement in Therapeutic Outcomes by Optimising Platelet Inhibition with Prasugrel-Thrombolysis in Myocardial Infarction 38.

The absolute risk reduction (ARR) for women and men was obtained by combining these sex-specific relative treatment efficacy estimates with baseline risk data for the Scottish population (figure 1B). We estimated the baseline rates according to age and sex for bleeding deaths, cardiovascular deaths and non-bleeding, non-cardiovascular deaths from the Scottish data using a generalised linear model with a log-link and multinomial distribution to simultaneously estimate the multiple outcomes accounting for competing risks. The treatment efficacy rate ratios (RRs) from the synthesis of the trial data were used to modify the parameters of the baseline risk model to obtain ARR estimates. In extensive sensitivity analyses, we varied the baseline rates and sex–treatment interactions for MACE and bleeding.

All analyses were carried out within a Bayesian framework, which meant that combining the estimates from the trial and observational data was straightforward.16 Model chains were examined graphically to investigate mixing and convergence. All analyses were conducted in R (V.3.3.1) and JAGS (V.4.2.0). All data and analysis codes are available at (https://github.com/dmcalli2/gender_dapt_manuscript) with selected code and model descriptions provided in the online supplementary material.

Results

Systematic review

We assessed the abstracts of 9277 articles identified through database searching (online supplement). Forty-one potentially relevant articles were reviewed in detail. Of these, we identified nine articles that fulfilled our inclusion criteria.17–25

All nine studies were double-blind, randomised-controlled trials. CURE, COMMIT and CLARITY-TIMI 28 compared clopidogrel with placebo in ACS, CHANCE and SPS3 compared clopidogrel with placebo in stroke, SOCRATES compared ticagrelor with aspirin in stroke and TRITON-TIMI 38, PLATO and TRILOGY ACS compared the novel P2Y12 antagonists with clopidogrel in ACS. The duration of follow-up ranged from 2 weeks (COMMIT) to 3 years (SPS3) (table 1).

The average age of patients enrolled was similar across all trials (online supplementary appendix). However, women were under-represented. In the Scottish population, 39.0% (17 842/45 660) of people admitted with myocardial infarction were women, whereas only 29.7% (32 561/109 570) of participants enrolled overall were women (for each trial, the proportion of women was 19.7%, 26.0%, 27.8%, 28.4%, 33.8%, 35.9%, and 37.0%, respectively).

Meta-analysis

Sex–treatment interaction

On comparing the three models of sex–treatment interactions across all nine trials of P2Y12 inhibitors (figure 2), the model assuming a shared sex–treatment interaction for the whole drug class had both a lower deviance and DIC than the other models (the deviance was 273, 261 and 259 and the DIC was 291, 289 and 286 for the identical, stratified and shared models, respectively), indicating better fit. Consequently, this model was preferred.

Figure 2

Relative treatment efficacy for cardiovascular events stratified by sex. Rate ratios and 95% credible intervals estimates of sex-specific treatment effects for each trial. Estimates for each trial were estimated independently in generalised linear models. Points represent the point estimates, and bars represent the 95% credible intervals. ACS, acute coronary syndrome.

For this shared-effects model, the RR for the sex–treatment interaction was 1.08 (95% credible interval (CI) 0.98 to 1.19, figure 3). Similar estimates for the sex–treatment interactions were found for the identical (RR 1.09; 95% CI 1.01 to 1.17) and stratified (RR for prasugrel/ticagrelor vs clopidogrel comparison 1.11; 95% CI 0.93 to 1.32) models.

Figure 3

Relative treatment efficacy for cardiovascular events. Meta-estimates and 95% credible intervals estimates of sex–treatment interactions for each trial as well as the overall sex–treatment interaction for P2Y12 inhibitors. All estimates were obtained from generalised linear models. The overall sex–treatment interaction was estimated in a hierarchical model. Points represent the point estimates, and bars represent the 95% credible intervals. The point-size for each trial is proportional to the inverse of the SE squared for each interaction estimate . The vertices of the diamond indicate the 95% credible intervals for the meta-estimate, which was obtained from the ‘shared’ model. ACS, acute coronary syndrome.

The treatment effect RR in men for the three trials comparing prasugrel or ticagrelor to clopidogrel in ACS was 0.80 (95% CI 0.69 to 0.93). Combining this estimate with the sex–treatment interaction estimate from the shared model yielded an RR in women of 0.86 (95% CI 0.72 to 1.04). This meant the relative risk reduction was approximately 30% lower in women than in men.

For bleeding, the sex–treatment interaction RR was 1.04 (95% CI 0.88 to 1.21). This estimate did not change importantly from the moderately informative prior we used in the modelling for this outcome (prior for sex–treatment interaction on RR scale 1.00; 95% CI 0.80 to 1.25). In men, the treatment effect on bleeding was RR 1.13 (95% CI 0.75 to 1.98). As such, the modelled treatment effect on bleeding in women was RR 1.18 (95% CI 0.76 to 2.08).

Sex-specific absolute treatment effects in the Scottish population

A total of 17 842 women and 27 818 men were admitted to hospital with myocardial infarction. Mortality was higher for women than men for all-cause mortality (5708, 32.0% vs 5891, 21.2%) and cardiovascular mortality (4032, 22.6% vs 4117, 14.8%). Mortality related to bleeding was also commoner in women (193, 1.1% vs 228, 0.8%) deaths. The sex differences in cardiovascular mortality differed by age with younger women having higher mortality than men and older women having lower mortality than men (table 2, figure 4).

Figure 4

Baseline risk of death and estimates of the absolute treatment effects of oral P2Y12 inhibition in women and men with myocardial infarction in Scotland. Panel A shows estimated risks of deaths obtained from a regression model run on the national Scottish data. A generalised linear model with a log-link and multinomial distribution was fitted to all three outcomes (cardiovascular death, bleeding death and non-cardiovascular, non-bleeding death), which included parameters for age and sex as well as age–sex interactions. Panel B shows the modelled absolute risk reduction in this population, obtained from applying to this model the relative treatment efficacy for cardiovascular events and bleeding events in men and women. Most patients in the clinical trial data were aged less than 75 years, and we were unable to examine whether treatment effects showed heterogeneity by age. As such, estimates for older patients should be treated with caution.

Table 2

Scotland, mortality at 1 year following hospitalisation for myocardial infarction from 2006 to 2010

Based on our model, the ARR in all-cause mortality at 1 year was similar in both sexes. For the 27 818 men admitted to hospital with myocardial infarction, the modelled ARR was 2.72% (95% CI 0.92 to 4.35) for cardiovascular, −0.18% (95% CI −0.71 to 0.24) for bleeding and 2.47% (95% CI 0.62 to 4.10) for all-cause mortality. For the 17 842 women, the ARRs were similar, 2.70% (95% CI −0.63 to 5.74) for cardiovascular, −0.27% (95% CI −1.06 to 0.30) for bleeding and 2.30% (95% CI −0.92 to 5.22) for all-cause mortality. In contrast with the 0.93 probability that relative treatment efficacy is lower in women than men, the probability that the ARR for all-cause mortality was lower in women than men was only 0.53.

In a subsequent analysis, we modelled the absolute treatment effect assuming that the relative treatment effect was the same in both sexes. Under this alternative model, a larger benefit was seen in women (3.23%; 95% CI 0.84 to 5.41) than in men (2.21%; 95% CI 0.56 to 3.72).

Age-specific and sex-specific absolute treatment effects

The same pattern was evident when the absolute treatment effects were modelled within each age group (figure 4). Assuming no age–treatment interaction, much larger ARRs were seen in older people than in younger people. For example, the ARR was 0.20% (95% CI 0.07 to 0.32) and 3.32% (95% CI 1.12 to 5.32) in men aged 30–39 and 70–79 years, respectively.

Sensitivity analyses

We modelled the absolute treatment effect for a range of different event rates for bleeding deaths in women and men, allowing for bleeding rates up to 10-fold higher in men than observed and up to twofold higher in women than in men. The point estimate for the overall absolute treatment effect in women remained consistently around 2% (range 1.92% to 2.16%).

Discussion

In a meta-analysis and modelling study using data from 100 000 participants randomised to P2Y12 inhibitors and over 45 000 patients from the Scottish population hospitalised with myocardial infarction, we examined relative and absolute treatment effects for newer P2Y12 inhibitors.

For relative treatment effects, the results were equivocal, although more supportive of P2Y12 inhibitors being less effective in women than men. Importantly, however, the baseline risk of subsequent cardiovascular death following myocardial infarction was higher in women. Therefore, in absolute terms, women and men had a similar benefit from treatment. Indeed, while there was a 93% probability that the relative treatment effect was lower in women, the probability for the absolute treatment effect being lower was only 53%. This suggests that women are likely to experience similar benefits to men when treated with newer P2Y12 inhibitors.

There has been considerable interest in differences in treatment effects from P2Y12 inhibitors in women and men, which could arise from a range of causes. The spectrum of disease may be different; women with myocardial infarction present later than men and with different clinical and diagnostic features.4 Underlying differences in cardiovascular biology have also been implicated.26 Women have smaller coronary arteries and different carotid anatomy compared with their male counterparts.27 Women are also less likely to display thrombogenic tendencies, and platelet–subendothelial interactions are markedly reduced following antiplatelet therapy in men compared with women.28 Some of these differences are likely to be related to the hormonal milieu.26

Nonetheless, previous studies examining variation in relative treatment effects for antiplatelet agents have yielded either null or small sex–treatment interactions. A previous IPD meta-analysis of five studies examining the effect of clopidogrel in the secondary prevention of cardiovascular disease (including three of the studies in our meta-analysis) found that clopidogrel was around 1.1-fold less efficacious in women for both cardiovascular events and mortality.29 A more recent IPD meta-analysis examining the efficacy of ticagrelor, prasugrel or cangrelor in men and women with coronary artery disease (three of the six trials were included in our meta-analysis) found no statistically significant difference in major adverse cardiovascular events.9 The report did not include the estimate and CIs for the sex–treatment interaction. However, we calculated these using the published data (see online supplementary material), finding a relative difference in HR of 1.00 (95% CI 0.86 to 1.14),9 a range which includes our own estimate of 1.08.

One strength of our study over previous meta-analyses is that we included additional trials from within the drug class (ie, stroke trials and trials comparing clopidogrel with placebo), allowing us to more precisely estimate the sex–treatment interactions while still allowing for differences by indication and treatment in the modelling. However, this approach is unlikely to account for the different findings as on restricting the efficacy estimates to trials of ticagrelor versus clopidogrel for ACS; we also found a 1.1-fold difference between men and women. Consequently, the most plausible reason for the variation across meta-analyses is the difference in included trials.

Nonetheless, in neither our study nor any meta-analysis of randomised controlled trials of which we are aware was there a difference large enough to outweigh the greater baseline risk in women. In the Scottish population, a sex–treatment interaction of around 1.2-fold lower efficacy in women would be needed for women to have a substantially lower ARR than men. Since the treatment effect in men is around 0.80, this amounts to a qualitative interaction, that is, an interaction that changes the direction of effect not just the magnitude. The risk of cardiovascular mortality following myocardial infarction has been found to be higher in woman than men in other settings,1 2 30 to which this finding is likely to be applicable.

The assumptions we employed in this modelling study are provided in detail in the online supplementary appendix. We discuss three important assumptions here. First, we assumed that the included trials were sufficiently similar so as to be exchangeable in terms of sex–treatment interactions. This assumption is, we would argue, considerably weaker than the assumption that the main effect is consistent across trials. Second, some patients admitted to hospital in Scotland with myocardial infarction during the 5-year period will not have received dual antiplatelet therapy. Nonetheless, in an all-comers trial of diagnostic practice in patients with ACS in 2012 in a large region of Scotland, we found that 76% of patients received dual antiplatelet therapy.31 More importantly, as we did not have access to IPD, we could not examine heterogeneity in treatment effect by age or by age and sex in combination. As such, considerable caution is needed in applying these results to older people.

Conclusion

In a meta-analysis and modelling study using data from 100 000 participants randomised to P2Y12 inhibitors and over 45 000 patients from the Scottish population hospitalised with myocardial infarction, we have identified that newer P2Y12 inhibitors may be slightly less efficacious in women than men but that the ARR is similar in both sexes.

Key messages

What is already known on this subject?

Women with myocardial infarction present later than men and with different clinical and diagnostic features. Meta-analyses comparing the effect of clopidogrel and novel P2Y12 inhibitors have not estimated the absolute treatment effects for women and men in typical real-world populations.

What might this study add?

This study uses a combination of clinical trial and routine healthcare data to show that while P2Y12 inhibitors may be slightly less efficacious in women than men, the absolute treatment benefit (in terms of the absolute risk reduction) is similar in both sexes.

How might this impact on clinical practice?

This study provides reassurance that mere quantitative sex–treatment interactions (ie, where the magnitude only and not the direction of the effect differs between men and women) are unlikely to result in women experiencing less benefits from secondary prevention than men following myocardial infarction.

Acknowledgments

DM is supported via an intermediate clinical fellowship from the Wellcome Trust (201492-Z-16-Z). NLM and DEN are supported by the Butler Senior Research Fellowship (FS/16/14/32023) and Chair (CH/09/002) awards from the British Heart Foundation. DEN is the recipient of a Wellcome Trust Senior Investigator Award (WT103782AIA). NHS Information Services Division provided data on the Scottish population. Staff from the Clinical research using LInked Bespoke studies and Electronic health Records (CALIBER) project provided a list of diagnostic and procedure codes for defining bleeding.

References

Footnotes

  • Contributors KKL, AS, NLM and DM conceived and designed the study. DM conducted the statistical analysis and interpreted the results. SD and NW advised on the design and conduct of the statistical analysis and the interpretation of the results. KKL, AS and PDA conducted the systematic review. KKL and DM initially drafted the manuscript. All authors interpreted the findings, made critical revisions of the manuscript for intellectual content and had final approval of the version published.

  • Funding This work was supported by the Wellcome Trust (201492-Z-16-Z and WT103782AIA) and British Heart Foundation (FS/16/14/32023 and CH/09/002).

  • Competing interests AA and AS have received honoraria from Abbott Diagnostics. NLM has acted as a consultant for Abbott Diagnostics, Beckman-Coulter, Roche and Singulex. All other authors have nothing to declare.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement All data from the study are available from GitHub in comma separated value format.

Linked Articles