Article Text

Download PDFPDF

1301 Effect of attribution on external validation of the EULAR/ACR SLE classification criteria
  1. Nicolai Leuchten1,
  2. Karen Costenbader2,
  3. Thomas Dörner3,
  4. Sindhu R Johnson4 and
  5. Martin Aringer1
  1. 1University Medical Center and Faculty of Medicine TU Dresden, Dresden, Germany
  2. 2Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
  3. 3Charité – Universitätsmedizin Berlin, Berlin, Germany
  4. 4University of Toronto, Toronto, ON, Canada

Abstract

Background With their new structure of ever positive anti-nuclear antibodies (ANA) as an obligatory entry criterion and weighted specific criteria with a cut-off of ≥ 10, the European League Against Rheumatism/American College of Rheumatology (EULAR/ACR) 2019 classification criteria for systemic lupus erythematosus (SLE) has a sensitivity of 96.1% and a specificity of 93.4% in the validation cohort.1,2 An analysis of the performance of the individual criteria items found that the specificity of joint involvement was 90.9%, but would drop to 57.6% if the attribution rule was not applied.3 The attribution rule states that only those items should be counted towards classification that have no alternative explanation more likely than SLE. The new criteria have been externally validated in a number of studies. From many of the external validation studies, it is not clear whether this attribution rule was followed

Methods A literature search was performed for „lupus criteria‘. Titles and abstracts were screened for studies that (i) referred to the EULAR/ACR criteria (even if using different terms) and (ii) indicated sensitivity and/or specificity estimates. The association between criteria specificity and frequency of joint involvement in the non-SLE control group and association between ANA positivity and criteria sensitivity were evaluated.

Results Operating characteristics of the SLE classification criteria have been evaluated in 19 studies. The external validation studies reported a sensitivity range of 84.8-97.6% and specificity range of (58.4-97.3%) (table 1).

Abstract 1301 Table 1

Specificity was evaluated in 14 studies. In 3 of the studies appropriate use of the attribution rule was apparent. One study was excluded for focusing on neuropsychiatric manifestations. For the remaining 10 populations, there was a significant negative correlation between specificity and joint disease in the non-SLE control population. (r=−0.73, p=0.016), as depicted in figure 1 (left panel). Sensitivity estimates are reported in 19 studies, and the percentage of ANA positive SLE patients was reported for 17 of these. There was a positive correlation between ANA positivity and criteria sensitivity (r=0.50, p=0.043). (figure 1, right panel)

Conclusions Specificity of the EULAR/ACR criteria is dependent on the correct use of the attribution rule. Higher percentages of patients with joint involvement in the non-SLE control populations is associated with a lower EULAR/ACR criteria specificity. Since joint involvement is particularly vulnerable to not using attribution, this suggests that the lower specificity in some external validation studies in part is due to not fully applying the attribution rule. Sensitivity was high throughout the analyzed studies. It is therefore crucial to differentiate between classification and diagnosis and keep in mind that not fulfilling SLE classification criteria is no valid argument against diagnosing SLE in an individual patient.

References

  1. Aringer M, Costenbader K, Daikh D, et al. Ann Rheum Dis 2019; 78: 1151-1159.

  2. Aringer M, Costenbader K, Daikh D, et al. Arthritis Rheumatol 2019; 71: 1400-1412.

  3. Aringer M, Brinks R, Dörner T, et al. Ann Rheum Dis 2021; 80: 775-781

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.