Article Text
Abstract
Objectives To evaluate the performance of Systemic Lupus Erythematosus Risk Probability Index (SLERPI) in patients with SLE using a Chinese cohort.
Methods The Chinese cohort included 352 patients with and 385 without SLE (control group). The clinical data of patients, including demographic data, clinical findings and serological profiles, were collected. Patients with an SLERPI score >7 were classified as SLE. The performance of the American College of Rheumatology (ACR)-1997, Systemic Lupus International Collaborating Clinics (SLICC)-2012 and European League Against Rheumatism (EULAR)/ACR-2019 criteria were used as references.
Results Of these four classification criteria, SLERPI has the highest sensitivity (98.3% (95% CI 96.3% to 99.4%)), but lowest specificity (89.4% (95% CI 85.8% to 92.2%)). In the control group, patients eligible for the classification criteria for SLE were mainly those with primary Sjogren’s syndrome (pSS) and undifferentiated connective tissue disease (UCTD), which adversely affected the specificity of the classification criteria. Moreover, significantly more patients with pSS and UCTD met SLERPI than those who met other classification criteria. After excluding patients with pSS and UCTD from the control group, the specificity and accuracy of SLERPI improved to 94.3% (95% CI 91.0% to 96.6%) and 96.5% (95% CI 95.0% to 97.9%), respectively, and both outperformed the EULAR/ACR-2019 criteria. The time to SLERPI classification was the same as their clinical time to diagnosis in 261 patients, earlier than the clinical diagnosis in 23 patients and later than the clinical diagnosis in 9 patients. A total of 280 patients had the same time to SLERPI classification as EULAR/ACR-2019, 8 patients had earlier than EULAR/ACR-2019 and 1 patient had later than EULAR/ACR-2019.
Conclusion SLERPI performed well in patients with SLE, particularly for the earlier diagnosis of SLE.
- Lupus Erythematosus, Systemic
- Autoimmune Diseases
- Autoimmunity
Data availability statement
Data are available upon reasonable request. The datasets used and/or analysed during this study are available from the corresponding author on reasonable request.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
WHAT IS ALREADY KNOWN ON THIS TOPIC
In managing patients with SLE, the diagnosis has always been a great challenge, and there is still no diagnostic standard.
Although there are classification criteria for SLE that aimed at identifying relatively homogeneous groups of patients for inclusion in clinical trials, their use for diagnostic purposes is common in clinical practice.
WHAT THIS STUDY ADDS
The present study evaluated the performance of Systemic Lupus Erythematosus Risk Probability Index (SLERPI) in a Chinese cohort and revealed that SLERPI has good diagnostic efficacy, particularly for the earlier identification of SLE.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
The use of SLERPI in clinical practice may lead to more timely interventions for patients with SLE and contribute to improved patient prognosis.
Therefore, SLERPI deserves to be promoted in clinical practice.
Introduction
SLE is a common connective tissue disease (CTD) characterised by high clinical heterogeneity and unpredictable flares.1 In managing patients with SLE, the diagnosis has always been a great challenge, and there is still no diagnostic standard.2 Therefore, SLE is mainly diagnosed based on the experience of rheumatologists.3
Although there are classification criteria that aimed at identifying relatively homogeneous groups of patients for inclusion in clinical trials, their use for diagnostic purposes is common in clinical practice. In the past few decades, several versions of the classification criteria for SLE have been proposed by different international organisations, including the American College of Rheumatology (ACR)-1997 classification criteria, Systemic Lupus International Collaborating Clinics (SLICC)-2012 classification criteria and European League Against Rheumatism (EULAR)/ACR-2019 classification criteria.4–7 Meta-analysis results showed that the sensitivity of SLICC-2012 (0.96 (95% CI (CI) 0.93 to 0.97)) and EULAR/ACR-2019 (0.95 (95% CI 0.92 to 0.97)) were higher than that of ACR-1997 (0.86 (95% CI 0.82 to 0.89)), and SLICC-2012 and EULAR/ACR-2019 are more conducive to identifying patients with early disease course.8
Based on common clinical and serological features, Adamichou et al recently developed a new, simple and interpretable model, the Systemic Lupus Erythematosus Risk Probability Index (SLERPI), to help diagnose SLE early.9 This model includes 14 variably weighted items, with >7 patients being classified as SLE. In the European population, the sensitivity, specificity and accuracy of this model were estimated at 94.2%, 94.4% and 94.2%, respectively.9 Another study from Australia suggested that this model has high sensitivity (98.5%) but low specificity (84.6%).10 Due to differences in diagnostic performance with the existing classification criteria to diagnose patients with SLE in different races,11 12 the performance of SLERPI should be further validated in other races. We have previously established a Chinese cohort that included patients with and without SLE and examined the performance of ACR-1997, SLICC-2012 and EULAR/ACR-2019.13 Therefore, this study aimed to further evaluate the performance of SLERPI in patients with SLE using the cohort.
Methods
Study design and participants
The Chinese cohort comprised 352 patients with and 385 without SLE (control group) who were recruited from the Department of Rheumatology and Immunology at the Second Affiliated Hospital of Soochow University between January 2016 and December 2020. The SLE diagnosis was established by rheumatologists with ≥8 years of clinical practice. Patients with other CTD, infections, cirrhosis, malignant solid tumours or haematological tumours or who were pregnant were excluded from the SLE group. The control group included patients with primary Sjogren’s syndrome (pSS) (n=56), undifferentiated CTD (UCTD) (n=32), rheumatoid arthritis (n=85), idiopathic inflammatory myopathies (n=24), systemic sclerosis (n=24), mixed CTD (n=14), primary systemic vasculitis (n=25), Behcet’s disease (n=12), rheumatoid polymyalgia (n=25), spondyloarthritis (n=18), lymphoma (n=10), immune thrombocytopenic purpura (n=3), Crohn’s disease (n=8), ulcerative colitis (n=7), liver cancer (n=5), lung cancer (n=16), pneumonia (n=11) and urinary tract infection (n=10).
Data collection
Demographic, clinical and laboratory data associated with the classification criteria were extracted from electronic medical records. The ANA titre was measured using an immunofluorescence antibody assay in the immune laboratory of the Second Affiliated Hospital of Soochow University, and positive ANA was set at a serum dilution of ≥1:100.
During the project establishment and training of data collectors, this study emphasised that care should be taken to identify similar disorders when collecting clinical data such as signs and symptoms.13 If more alternative explanations were available, they would not be considered as positive items for the classification criteria. Arrangements were made for another staff member to review the clinical data after collection and before starting the study analysis. If there was any doubt, it would be reconfirmed by the two clinical experts to avoid attribution errors where possible.
Statistical analysis
Categorical variables were reported as absolute frequencies and percentages, and the χ2 test or Fisher’s exact test was used to assess between-group differences. The Mann-Whitney U test was used to analyse skewed continuous variables. The time to classification was defined as the duration from the first occurrence of SLE-related any clinical manifestation or abnormal laboratory test result to meeting the threshold specified in the classification criteria, and the time to diagnosis as the duration from the first occurrence of an item to a clinical diagnosis.13 All statistical analyses were performed using IBM SPSS Statistics for Windows, V.21.0 (IBM, Armonk, New York, USA). The significance level was set at p<0.05.
Results
Sample description
Compared with the control group, the SLE group consisted of younger patients and a higher proportion of women (online supplemental table 1). In the SLE group, the proportion of patients with a disease course of ≤1, 1–3, 3–5 and >5 years was 23.9%, 6.3%, 10.8% and 59.1%, respectively. Of the 14 SLERPI items, differences in the clinical variables were significant between the SLE and control groups, except for the second item (subacute cutaneous lupus erythematosus or discoid lupus erythematosus) (table 1). As a score reduction item, the SLE group had fewer interstitial lung disease than the control group. The remaining 12 items are indeed more common in the SLE group.
Supplemental material
The overall performance of SLERPI in the diagnosis of SLE
The accuracy of SLERPI was 93.6% (95% CI 91.9% to 95.4%), with a specificity of 89.4% (95% CI 85.8% to 92.2%) and sensitivity of 98.3% (95% CI 96.3% to 99.4%) (table 2). To clarify the performance of SLERPI in the diagnosis of SLE, we included the results of our previous studies on the ACR-1997, the SLICC-2012 and the EULAR/ACR-2019 criteria in the same cohort.13 The results showed that SLERPI had the highest sensitivity, but lowest specificity.
The clinical characteristics and disease composition of patients in the control group meeting SLERPI
In order to elucidate the reasons for the low specificity of SLERPI, we further investigated the clinical characteristics and disease composition of patients in the control group meeting SLERPI (total score >7). Among the 385 patients in the control group, 41 were eligible for the SLERPI. We first compared the SLERPI items for patients with SLERPI >7 and ≤7 (online supplemental table 2). Malar rash or maculopapular rash, alopecia, serositis, leucopenia, thrombocytopenia or autoimmune haemolytic anaemia, proteinuria, ANA positivity, low C3 and C4, and immunological disorder were all significantly more common in the SLERPI group with >7. No significant differences were found in patients with subacute cutaneous lupus erythematosus or discoid lupus erythematosus, mucosal ulcers, arthritis, neurological disorder and interstitial lung disease.
We next investigated the disease composition of these 41 patients in the control group, including 15 patients with pSS, 9 with UCTD, 5 with rheumatoid arthritis, 4 with idiopathic inflammatory myopathies, 3 with systemic sclerosis, 2 with mixed CTD and 2 with pneumonia, and 1 with primary systemic vasculitis (table 3). pSS and UCTD accounted for >50% of patients eligible for SLERPI in the present study; however, their total proportion was only 23% of the control group. Similar findings were confirmed by the analysis of other classification criteria, namely, that control patients meeting the classification criteria for SLE were predominantly those with pSS and UCTD.
Significantly more patients with pSS and UCTD met SLERPI (n=24) than those meeting other classification criteria (n=8 for ACR-1997, 16 for SLICC-2012, 15 for EULAR/ACR-2019), while the number of patients with other diseases meeting SLERPI in the control group (n=17) was similar to the number of those meeting SLICC-2012 (n=14) and EULAR/ACR-2019 (n=18) criteria (table 3). Numerous studies have shown that patients with pSS and UCTD may progress to SLE in the future.14–17 Therefore, the inclusion of patients with pSS and UCTD in the control group in this study reduced the specificity of each classification criterion, especially for SLERPI.
The performance of SLERPI improved after excluding patients with pSS and UCTD from the control group
After excluding patients with pSS and UCTD from the control group, we further tested the performance of these classification criteria (table 4). The results showed that the specificity improved for all four classification criteria, with SLERPI presenting the most significant improvement at 94.3% (95% CI 91.0% to 96.6%), between that of SLICC-2012 criteria (95.3% (95% CI 92.2% to 97.4%)) and EULAR/ACR-2019 criteria (93.9% (95% CI 90.6% to 96.4%)). In addition, the accuracy of SLERPI significantly increased (96.5% (95% CI 95.0% to 97.9%)), approaching that of the highest SLICC-2012 criteria (96.8% (95% CI 95.4% to 98.1%)).
SLERPI facilitates earlier diagnosis of SLE
To clarify the early diagnostic ability of SLERPI, the classification time of SLERPI was compared with the time of clinical diagnosis (table 5). The time to SLERPI classification was the same as their clinical time to diagnosis in 261 patients, earlier than the clinical diagnosis in 23 patients, and later than the clinical diagnosis in 9 patients. Subsequently, a subgroup analysis was performed based on the involvement system, indicating that the SLERPI classification was earlier than the clinical diagnosis in 15 patients with cutaneous mucosal lesions, 15 with arthritis, 5 with serositis, 20 with haematological involvement and 12 with lupus nephritis, whereas only 5, 2, 3, 6 and 4 patients had a later SLERPI classification, respectively.
Our previous study found that the EULAR/ACR-2019 criteria showed the best early diagnostic performance compared with the ACR-1997 and SLICC-2012 criteria;13 therefore, we further compared the classification time of SLERPI with that of EULAR/ACR-2019 criteria (table 5). The time to SLERPI classification was the same as the EULAR/ACR-2019 criteria in 280 patients, earlier in 8 patients and later in only 1 patient. SLERPI also had better early diagnostic performance in skin mucosal lesions, arthritis, haematological involvement and lupus nephritis, with 6, 4, 7 and 5 patients diagnosed earlier than the EULAR/ACR-2019 criteria, respectively.
Discussion
The new classification criteria are developed to improve the sensitivity and specificity, and the early discrimination of the classification criteria is also particularly important for SLE.3 The present study evaluated the performance of SLERPI in a Chinese cohort and revealed that SLERPI has good diagnostic efficacy, particularly for the earlier identification of SLE.
Previously, this cohort was used to investigate the performance of ACR-1997, SLICC-2012 and EULAR/ACR-2019 criteria.13 Combining the results of the present study, the ACR-1997 criteria had the highest specificity at 96.4% (95% CI 94.0% to 98.0%), the accuracy was highest using SLICC-2012 criteria at 95.0% (95% CI 93.1% to 96.4%), and SLERPI showed the highest sensitivity at 98.3% (95% CI 96.3% to 99.4%) and the lowest specificity at 89.4% (95% CI 85.8% to 92.2%). An Australian study showed that the specificity was highest with ACR-1997 criteria at 95.9% (95% CI 90.8% to 98.7%) and lowest with SLERPI at 84.6% (95% CI 76.9% to 90.4%), the overall accuracy was highest with the SLICC-2012 criteria at 94.4% (95% CI 91.7%, 97.1%), and the sensitivity was similarly excellent with SLICC 2012 criteria and SLERPI at 98.5% (95% CI 96.7% to 99.4%).10 These two studies showed similar results, that is, SLERPI has the highest sensitivity, but lowest specificity.
The present study found that 10.6% of 385 patients in the control group with SLERPI score of >7 could be diagnosed with SLE, and patients in the SLERPI of >7 group presented with more malar rash or maculopapular rash, alopecia, serositis, leucopenia, thrombocytopenia or autoimmune haemolytic anaemia, proteinuria, ANA positivity, low C3 and C4, and immunological disorder. Therefore, the above items facilitate the identification of SLE, which may conversely lead to a decreased specificity of SLERPI.
Interestingly, pSS and UCTD accounted for >50% of patients eligible for SLERPI in the present study; however, their total proportion was only 23% of the control group. SS can occur as a distinct entity (pSS) and can also precede other CTDs, including SLE. Zufferey et al observed that 4 of 55 patients with SS developed SLE within 1–10 years after the initial diagnosis of SS, with pleuropericarditis, glomerulonephritis and focal central nervous system disease being the main clinical events predicting the development of SLE.14 A recent study suggested that the presence of albuminuria, haematuria, hypoproteinaemia, anti-dsDNA positivity and anti-Sm positivity in patients with SS may indicate the presence of SLE.15
Patients with UCTD may also develop SLE.16–18 A study of a cohort with early UCTD found that 18 of 213 patients progressed to SLE after a 5-year follow-up.19 The presence of anti-DNA, anti-Sm, anti-phospholipid or multiple-specific antibodies in patients with UCTD, as well as clinical manifestations such as serositis, alopecia, photosensitivity and discoid rash, suggest the possibility of SLE occurrence.20 Another study found that 39 of 422 patients with UCTD had an SLERPI score of >7 and could be diagnosed as SLE.21 When the SLERPI score of >7 and ≤7 groups were compared based on the SLERPI criteria, malar rash or maculopapular rash, alopecia, mucosal ulcer, arthritis, thrombocytopenia/autoimmune haemolytic anaemia, proteinuria, ANA positivity, hypocomplementemia and immunological disorders were all significantly more common in the SLERPI score with >7 group, which was similar to our study. The SLERPI may be useful for the early identification of SLE among patients with signs of CTD without fulfilling any definite set of criteria. Therefore, patients with pSS and UCTD with SLERPI of >7 in the present study may develop SLE in the future, and the number of patients with pSS and UCTD eligible for SLERPI was significantly greater than the number of those eligible for the currently widely used classification criteria for SLE, which was consistent with the original intention of developing SLERPI.
Based on the above statements, the inclusion of patients with pSS and UCTD in the control group of this study adversely affected the specificity of classification criteria, especially for SLERPI. The exclusion of these patients resulted in a significant improvement in performance for all classification criteria, most notably for SLERPI, which improved to 94.3% (95% CI 91.0% to 96.6%) and 96.5% (95% CI 95.0% to 97.9%) in specificity and accuracy, respectively, and both outperformed the EULAR/ACR-2019 criteria. Therefore, SLERPI has good diagnostic efficacy for SLE.
Early intervention in SLE is essential to improve short-term and long-term outcomes, and prompt recognition of SLE, especially in hospitalised patients presenting with severe disease, is a prerequisite for initiating treatment.22 An observational cohort study found that among the 191 hospitalised patients due to manifestations eventually attributed to SLE, although 79.5% of them were diagnosed within 3 months from hospitalisation, the diagnosis was delayed in 39 patients, particularly those with haematological manifestations.3 Our data revealed that SLERPI enabled earlier diagnosis in some patients compared with the clinical diagnosis and EULAR/ACR-2019 criteria, especially in patients with important organ involvement, such as the kidney and haematological system. Therefore, the use of SLERPI in clinical practice may lead to more timely interventions for patients with SLE and contribute to improved patient prognosis.
Certain limitations of this study must be acknowledged. First, this is a single-centre retrospective study with inherent flaws, including selection bias. Second, this study focused on a Chinese population; thus, the results may not be appropriate for all patients with SLE.
In conclusion, SLERPI performed well in patients with SLE, particularly for the earlier diagnosis of SLE. In addition, compared with SLICC-2012 and EULAR/ACR-2019 criteria, SLERPI, like the ACR-1997 criteria, has fewer items and is easier to implement. Therefore, SLERPI deserves to be promoted in clinical practice. However, future studies with larger samples and different ethnicities are still needed to validate the performance of SLERPI in detecting SLE.
Data availability statement
Data are available upon reasonable request. The datasets used and/or analysed during this study are available from the corresponding author on reasonable request.
Ethics statements
Patient consent for publication
Ethics approval
This study complied with the principles of the World Medical Association Declaration of Helsinki and the study protocol was approved by the Ethics Committee of the Second Affiliated Hospital of Soochow University (Approval No. JD-HG-2021-19). Participants gave informed consent to participate in the study before taking part.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Contributors All authors took part in revising the article and approved the final version to be published. LX and ZL contributed to the conception and design, and were guarantors of the study. LZ, WL and DY were responsible for collecting the data. LZ, WL and LX performed the analysis and drafted the article.
Funding This study was funded by the Suzhou Science and Technology Project (SKJY2021098) and the Suzhou Gusu health talent plan (2022194).
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.