Clinical trials and drug discovery

Risk of adverse events from different drugs for SLE: a systematic review and network meta-analysis

Abstract

Objective The comparative safety of immunosuppressive drugs, biologicals and glucocorticoids (GC) for patients with SLE remains controversial. We aimed to investigate the specific side effects of the available SLE drugs in this population of patients.

Methods Electronic databases were systematically searched through September 2017 for randomised trials in patients with SLE. The primary outcomes were all-cause mortality and withdrawal related to adverse events (AEs). We performed a random-effects network meta-analysis to obtain estimates for primary and secondary outcomes and presented these estimates as ORs with 95% CIs.

Results Forty-four studies comprising 9898 participants were included in the network meta-analysis. No drug regimen was considered to be safer for reducing all-cause mortality. However, compared with cyclophosphamide, azathioprine (OR 3.04, 95% CI (1.44 to 6.42)) and cyclosporine (OR 3.28, 95% CI (1.04 to 10.35)) were significantly less safety in AE-related withdrawals, and GC was ranked lowest and led to higher withdrawal rates. Tacrolimus (TAC) was ranked high and showed a benefit in many outcomes. Biologicals and chloroquine also showed good safety in all of the available outcomes, while the beneficial effects of other immunosuppressive drugs were not substantial in different types of serious adverse events.

Conclusions TAC is the safest strategy for patients with SLE. Biologicals and chloroquine are also fairly safe for patients with SLE. The use of other immunosuppressive drugs and GC needs to be balanced against the potential harms of different types of AEs, and the practical safety of drug combinations still requires further trials to evaluate.

Introduction

SLE is known as an autoimmune disease with complex pathogenic mechanisms that always lead to multisystem damage; the long duration of use of immunosuppressive drugs and glucocorticoids (GCs) increases the risk of premature death.1–3

During the treatment, nearly all patients report one or more adverse events (AEs), and these AEs shape doctors’ preferences, especially when two drugs are considered to be equivalent. Serious AEs (SAEs) refer to events that result in death, are life threatening, require inpatient hospitalisation or cause prolongation of existing hospitalisation, result in persistent or significant disability/incapacity, lead to a congenital anomaly/birth defect or that require intervention to prevent permanent impairment or damage; these effects can directly demonstrate the safety of available drugs in different aspects, eliminating the interference of more mild AEs. However, mainly because of an absence of head-to-head trials and SAE data, the comparative safety is largely unknown.

In a network meta-analysis published in 2017, researchers found that, in patients with proliferative lupus nephritis, mycophenolate mofetil (MMF) combined with calcineurin inhibitor therapy was less likely to cause ovarian failure, while the regimens generally had similar odds of major infection.4 Another network meta-analysis published in 2016 showed that tacrolimus (TAC) compared with other agents can reduce the risk of serious infection in lupus nephritis.5 Limited by the differing inclusion criteria, the divergence between these two studies cannot be ignored. To obtain an impartial comparison of the important AEs among the available drugs for all patients with SLE, the aim of our study was to assess the comparative effects of all available effective agents in patients with SLE using network meta-analysis.

Materials and methods

Search strategy

A systematic search of the scientific literature was performed according to the Preferred Reporting Items for Systematic Review and Meta-Analysis. The searches included PubMed, the Cochrane Central Register of Controlled Trials (CENTRAL) and Embase (from their inception to September 2017) using a combination of keywords and search strategies with Medical Subject Headings (online supplementary appendix 1). The search included only randomised controlled trials (RCTs) that reported the outcomes of interest. Additionally, reference lists from trials, review articles and reports were manually scanned to identify any other eligible studies.

Study selection

To make a comprehensive evaluation of the risk of AEs with agents used to treat SLE, our exposure of interest was treatment with immunosuppressants or biologicals (we only included rituximab (RTX) and belimumab due to their validated efficacy) or GC. Patients who met the 1987 American College of Rheumatology Classification criteria for SLE were included. Our primary outcomes were all-cause mortality and AE-related withdrawals. Secondary outcomes included AEs, SAEs, cardiovascular events (CVEs) (acute coronary syndrome, chronic ischaemic heart disease, coronary revascularisation, cardiovascular disease (CVD) death, cerebrovascular events or peripheral vascular events), serious infections (serious infection, major infection, severe infection, sepsis, cardiovascular infection or bacterial pneumonia), bone toxicity (avascular necrosis or fracture), malignant transformation, serious gastrointestinal events (leading to dose reduction or withdrawal), ovarian failure (sustained amenorrhea), menstrual disorder, new-onset hypertension, serious leucopenia (white cell count <2×109 L leading to dose reduction or withdrawal), leucopenia and hyperglycaemia (hyperglycaemia or new-onset diabetes).

Duplicate reports, studies that did not report on the outcomes of interest or in which all arms had 0 events, studies that lasted 24 weeks or less, studies that included children younger than 10 years old or women during pregnancy or lactation and studies that included fewer than 20 patients. All lupus nephritis diagnoses should have been confirmed by biopsy. We also excluded scientific reports that presented pooled trial data for which the individual trials could not be identified to prevent double counting.

Screening and data extraction

Standardised data forms and data extraction training exercises were developed to achieve a high level of consensus between reviewers. Two reviewers independently assessed the full text of the articles to confirm their eligibility. Any disagreement was resolved by consensus discussion.6 7 All studies included were listed in online supplementary appendix 2.

Assessment of methodology quality

Two authors evaluated the eligible studies from seven domains in accordance with the recommendations of the Cochrane Handbook for Systematic Reviews (online supplementary appendix 3).

Statistical analysis

First, we conducted pairwise meta-analyses using the random-effects model.8 All results are expressed as ORs with 95% CIs. The heterogeneity of the data was assessed using the I2 test, with a p<0.05 indicating significant heterogeneity.

We then performed network meta-analyses to obtain estimates for primary and secondary outcomes and presented these estimates as ORs with 95% CIs.9 Network meta-analyses assumes transitivity, which means one can learn about treatment A versus treatment B via treatment C (eg, learning about cyclophosphamide (CYC) vs TAC) via MMF). We implemented network meta-regression within the frequentist framework for outcomes to evaluate the assumptions in the studies and provide graphical representation of the results.

We investigated the extent of heterogeneity in every network by comparing the magnitude of τ for the network with an empirical distribution of heterogeneity variances specific to the types of outcomes and treatments being compared.10 Values lower than 0.1 were considered low, outcomes from 0.1 to 1.0 were considered moderate and outcomes higher than 1.0 represented high heterogeneity.

Disagreement between direct and indirect evidence can suggest that the transitivity assumption might not hold. We used a loop-specific approach to investigate the consistency within every closed triangular or quadratic loop in every network as the difference between direct and indirect estimates for a specific treatment comparison (RoR - ratio of odds ratio) in the loop.11 12 We identified inconsistent loops as those yielding a 95% CI excluding 1. This approach can be easily applied and indicate loops with large inconsistency but cannot infer consistency of the entire network or identify the particular comparison that is problematic. To check the assumption of consistency in the entire network, we then used the design-by-treatment interaction model that provides a single inference, and the χ² tests were adopted.13 For the generalisability of the findings, sensitivity analyses were then assessed by restricting analyses to studies with the following design characteristics: patients with lupus nephritis, follow-up longer than 24 months and without the use of biological agents.

To rank the treatments for an outcome, we calculated different ranks possibility of each agent, and then reported probabilities for all ranks and created a line graph showing cumulative ranks. In the line graph, each column represented a treatment, and different safety ranks were represented by different colours; the percentage of a colour was corresponding to the possibility of certain rank. The default was set to report only the probabilities of being the treatment with minimum frequency in the outcome, so the treatment that had the largest proportion of first rank colour in the graph indicated the safest treatment for the outcome. We also used forest plots to obtain an intuitive and full comparison of the safety of these agents.14 15

Results

A total of 2377 relevant articles were searched, and 44 studies with 9898 patients were finally identified and included.16–59 Of the RCTs included in the systematic review, nine were three-arm trials, one was a four-arm trial and one was a five-arm trial. The selection process, reasons for exclusion and information for interventions are detailed in figure 1. Networks of eligible comparisons for the primary outcomes are presented in figure 2.

Figure 1
Figure 1

Summary of evidence search and selection. A total of 19 immunosuppressants or biologicals alone or in combination were involved in our analyses: intravenous CYC (0.5–1 g/m2 body surface area monthly) (21 trials), AZA (1–4 mg/kg/day) (12 trials), MMF (500–3000 mg/day) (12 trials), TAC (0.05–0.1 mg/kg/day) (four trials), oral CYC (1–4 mg/kg/day) (two trials), CSA (1–5 mg/kg/day) (five trials), MTX (7.5–20 mg/week) (three trials), RTX (1 g/day) (two trials), LD belimumab (1 mg/kg) (four trials), MD belimumab (4 mg/kg) (one trial), HD belimumab (10 mg/kg) (five trials), SC belimumab (200 mg/week) (one trial), LEF (1 mg/kg/day) (one trial), chloroquine (150 mg/day) (one trial), AZA+GC (one trial), MMF+TAC (two trials), intravenous CYC+MMF (one trial), CYC-AZA (two trials) and AZA+CYC (one trial). AZA,  azathioprine; CSA, cyclosporine; CYC-AZA, CYC followed by AZA; CYC,  cyclophosphamide; GC, glucocorticoid; HD, high dose; LD, low dose; LEF, leflunomide; MD, moderate dose; MMF, mycophenolate mofetil; MTX,  methotrexate; RCT, randomised controlled trial; RTX, rituximab; SC, subcutaneous; TAC, tacrolimus, NM, neurological manifestations;  LN, lupus nephritis

Figure 2
Figure 2

Networks of treatment comparisons for primary outcomes of SLE agents in patients with SLE. The size of the nodes (blue circles) corresponds to the number of trials of the treatments. Comparisons are linked with a line, the thickness of which corresponds to the number of trials that assessed the comparison. +, combined with; AZA, azathioprine; Beli, belimumab; CSA, cyclosporine; CYC-AZA, CYC followed by AZA; CYC, cyclophosphamide; GC, glucocorticoid; HD, high dose; LD, low dose; LEF, leflunomide; MD, moderate dose; MMF, mycophenolate mofetil; MTX, methotrexate; RTX, rituximab; SC, subcutaneous; TAC, tacrolimus.

Risk of bias

The risk of bias in studies contributing to the primary outcomes was generally low, suggesting no evidence of small-study effects in the network. Moreover, in the risk of bias summary graph, the risk of bias was determined to be low for most criteria and unclear for some criteria (online supplementary appendix 3).

Heterogeneity and inconsistency

In pairwise comparisons of the primary outcomes, no evidence of statistical heterogeneity was seen in general (online supplementary appendix 5). In the network meta-analyses, statistical heterogeneity was low in most networks, moderate in networks for serious gastrointestinal events and ovarian failure and substantial in networks for AEs and new-onset hypertension. Treatment estimates from direct and indirect evidence in general did not show evidence of statistical inconsistency except for one loop of evidence for AEs (CYC–MMF–TAC). Global inconsistency was not noted within any network except for AEs (online supplementary appendix 6).

Outcomes

Data for direct comparisons and network estimates for statistically significant outcomes are shown in table 1, and complete outcomes are listed in online supplementary appendix 5 and 7.

Table 1
|
Results from pairwise meta-analysis and network meta-analysis ORs (and 95% CI) for statistically significant outcomes

Primary outcomes

For primary outcomes, all-cause mortality was reported in 29 studies (8762 participants), but because data were scant for some treatments, the results of both the pairwise and network estimates were not significant. Compared with CYC alone (the most commonly used drug), the ORs ranged from 0.44 (95% CI 0.84 to 2.31) for the highest ranked treatment strategy (TAC) to 5.76 (95% CI 0.24 to 137.52) for the lowest ranked agent (CYC followed by azathioprine (AZA)). AE-related withdrawal was reported in 29 studies (8371 participants). AZA was significantly less safe compared with CYC, TAC and MMF (ORs 3.04, 95% CI (1.44 to 6.42), 3.63 (1.05 to 12.61) and 2.08 (1.29 to 3.36), respectively), and CSA was also significantly less secure compared with CYC (3.28 (1.04 to 10.35)). AZA combined with GC, CYC combined with MMF and moderate dose (MD) belimumab were also ranked highly, indicating high safety, while GC with the lowest rank was considered to lead to a higher withdrawal rate (online supplementary appendix 7).

Secondary outcomes

Adverse events

Chloroquine ranked highest in all treatments for the risk of AEs and was significantly safer than methotrexate (MTX), placebo, RTX, low dose (LD) belimumab, MD belimumab and high dose  belimumab (OR 0.09, 95% CI (0.02 to 0.44), 0.16 (0.03 to 0.96), 0.10 (0.02 to 0.68), 0.15 (0.02 to 0.92), 0.08 (0.01 to 0.62), 0.16 (0.03 to 0.98), respectively). TAC was safer compared with CYC (0.03 (0.00 to 0.56)), and AZA was safer compared with GC (0.06 (0.01 to 0.61)). CYC followed by AZA ranked the lowest and increased the risk of AEs (online supplementary appendix 7).

SAEs

For SAEs, subcutaneous (SC) belimumab was significantly better than placebo and LD belimumab (0.65 (0.43 to 0.99) and 0.57 (0.36 to 0.91), respectively). MD belimumab ranked the lowest and increased the risk of SAEs (online supplementary appendix 7).

Serious infection

TAC was superior to CYC, AZA, MMF combined with TAC and CYC followed by AZA for prevention of serious infection (0.32 (0.12 to 0.83), 0.34 (0.12 to 0.96), 0.16 (0.04 to 0.62), and 0.22 (0.05 to 0.95), respectively), whereas the effects of other drugs were not significant or were very imprecise. Additionally, CYC combined with AZA, CYC combined with MMF, and TAC alone ranked highest and indicated a lower possibility of suffering serious infection, while MMF combined with TAC ranked lowest (online supplementary appendix 7).

Serious gastrointestinal events

RTX and placebo ranked high in all treatments and both had significant reductions in serious gastrointestinal events compared with AZA (0.04 (0.00 to 0.49) and 0.07 (0.01 to 0.60), respectively), MMF (0.09 (0.01 to 0.70) and 0.15 (0.03 to 0.80), respectively), and CSA (0.02 (0.00 to 0.26) and 0.03 (0.00 to 0.33), respectively). TAC alone also showed great benefit of serious gastrointestinal events. Compared with CSA alone, the combination with AZA could reduce the risk of serious gastrointestinal events (online supplementary appendix 7).

Serious leucopenia

TAC and MMF showed significantly rates of serious leucopenia compared with CYC (0.12 (0.03 to 0.49) and 0.06 (0.01 to 0.29), respectively) and AZA (0.22 (0.05 to 0.91) and 0.11 (0.03 to 0.39), respectively). Belimumab also had beneficial effects, while CYC alone, CYC followed by AZA and AZA alone demonstrated a higher possibility of suffering serious leucopenia (online supplementary appendix 7).

Leucopenia

Similar to the result of serious leucopenia, CYC and AZA increased the risk of suffering leucopenia compared with MMF, TAC, GC, CSA and MMF combined with TAC (table 1), and AZA was considered the worst (compared with CYC: 3.20 (1.13 to 9.06)). The combination of AZA and CYC also ranked low, as did LEF. GC and MMF combined with TAC, on the contrary, played an important role in reducing leucopenia events (online supplementary appendix 7).

Ovarian failure

TAC, AZA and GC ranked high in ovarian failure, and GC showed significant reductions compared with CYC, CYC combined with GC and CYC followed by AZA (0.13 (0.02 to 0.71), 0.11 (0.01 to 0.95) and 0.07 (0.01 to 0.92), respectively). CYC alone and in combination increased the risk of ovarian failure (online supplementary appendix 7).

Menstrual disorder

Similar to the result of ovarian failure, TAC and AZA ranked high and reduced the risk of menstrual disorders. CYC ranked the lowest, and CSA also showed an increased tendency to cause menstrual disorders (online supplementary appendix 7).

New-onset hypertension

Different from pairwise analyses, the network results of new-onset hypertension were not significant. However, CSA was ranked lowest, which was also confirmed by direct comparison (compared with GC 84.14 (3.90 to 1814.89), while AZA compared with GC 0.10 (0.01 to 0.93)) indicated an increased risk of hypertension (online supplementary appendix 7).

Outcomes with no statistically significant

There was no evidence that any of these drugs had significantly different odds of CVEs, bone toxicity, malignant transformation and hyperglycaemia related to the limited data and follow-up duration. The rank results required cautious interpretation for the conflicting sort of these drugs alone or in combination (online supplementary appendix 7).

Sensitivity analyses

Results for serious infection were generally robust in sensitivity analyses restricted to lupus nephritis patients only and excluding biological agents, but it was imprecise when restricted to trials with follow-up of longer than 24 months (online supplementary appendix 8).

Discussion

Our network meta-analysis provides unified hierarchies of evidence for all available effective agents in patients who have SLE, overcoming the absence of comparative data in head-to head trials. Overall, no significant difference was observed in all cause mortality. However, GC ranked the lowest as the least effective agent for prevention of AE-related withdrawal, and AZA and CSA, which also ranked low, were significantly less secure compared with CYC. As for the result of all AEs, chloroquine ranked highest in all treatments and was significantly less safe than MTX and most biologicals; TAC compared with CYC and AZA compared with GC also had better safety. For SAEs, SC belimumab was significantly better than placebo and LD belimumab. These results provide us a comprehensive understanding of the agents’ safety and, compared with CYC, TAC and chloroquine, may have better safety, while GC is believed to be less safe.

Compared with the general population, patients with SLE have more than a sixfold higher risk of developing atherosclerotic lesions and much a higher risk of cardiovascular morbidity and mortality,60 61 and the multiple SLE therapies play important roles in the disease progression.62 63 Subsequent studies have confirmed it and have indicated that corticosteroids were linked to increased CVE risk, whereas antimalarial medications were protective.64 65 Moreover, a similar study found that corticosteroids and non-steroidal anti-inflammatory drugs were associated with an increased risk of CVEs in rheumatoid arthritis.66 However, limited to the simple size, we did not find significant results, and to exclude the effects of other factors, long-term follow-up is also required.

Serious infection is always a key concern for patients with SLE, since immunosuppressive drugs and GCs both suppress the immune system.67 68 Similar to Singh et al’s study,5 TAC was found to have a large advantage compared with several other agents for the prevention of serious infection. It also appears that the benefit of TAC was evident in lupus nephritis patients and in patients with SLE.

Bone toxicity, especially avascular necrosis, is a serious comorbidity in SLE patients, and strategies to minimise GC use are necessary to prevent this serious complication.69 70 Recent research has found that the use of immunosuppressive agents is also a significant risk factor, while antimalarial treatments played a protective role.71 However, since the incidence of bone toxicity in patients with SLE was affected by disease activity, a higher disease activity score is significantly associated with an accelerated incidence of bone toxicity; the influence of immunosuppressive agents should be cautiously estimated, since compared with the patients who do not use immunosuppressive agents, user conditions can be much worse and they are likely to have higher disease activity scores.

In the previous study, researchers found that compared with CYC, MMF incurred lower risks of nausea and vomiting, but it was more likely to cause diarrhoea.4 Although gastrointestinal events are quite common in treatments for SLE, few studies focus on it. Our results indicated that RTX, TAC and placebo, as well as CSA combined with AZA could reduce the risk of serious gastrointestinal events, while CSA was associated with a higher risk of suffering serious gastrointestinal events. The combination of these agents may indicate lower levels of gastrointestinal toxicity, an effect similar to those shown in the previous outcomes. The combination of two low-rank agents became safer, and whether it is just a coincidence or a feasible process for toxicity reduction, more studies will be needed to draw a conclusion.

GC, MMF, TAC and their combinations showed benefits in the reduction of all leucopenia events. AZA and CYC, on the contrary, increased the risk of all leucopenia events. The result from both serious leucopenia and leucopenia were consistent, similar to the results for ovarian failure and menstrual disorders. Previous studies have already confirmed that patients who used CYC had a higher occurrence of transient amenorrhea and premature menopause.72–74 Apart from these findings, our results found that TAC, GC and AZA had low ovarian toxicity and may be good alternative therapies for women of childbearing age, while the risk of ovarian toxicity with CSA use should be considered.

Our study has potential limitations. First, because of scant primary data, the effects of agents on CVEs, bone toxicity, malignant transformation, new-onset hypertension and hyperglycaemia were very uncertain, leading to a pivotal weakness in our understanding of these drugs. The present debate about optimum treatments in SLE would be assisted greatly by the collection of robust data for these outcomes in future trials. Second, data for the outcome of SAEs were only reported in some of the studies, and most of them used biologicals; thus, we cannot directly determine the incidence rate of SAEs for all these agents. Third, haemorrhagic cystitis was poorly defined, and scant evidence relating to this outcome does not allow us to make proper estimates of the risk benefit ratio of agents in SLE. Fourth, we did not restrict patients to only adults, as if we had done so, the studies included would have been insufficient to run the analyses. Fifth, due to lack of original data, we are not sure whether the influence of other factors, including the organs involved, underlying disease and demographics, affect the outcomes.

In summary, our analysis showed that TAC is the safest strategy and has benefits for nearly all the SAEs, while the benefits of other agents are not very substantial in different types of SAEs. Therefore, we must consider the potential harms of these treatments in individual patients and even in one patient in different conditions. So that, the status of specific AEs can be evaluated, and appropriate treatments with improved safety should be adopted. Surveillance for treatment-related AEs is important, as is better recording these different types of SAEs and an improved understanding of their outcomes, particularly in the context of future trials.