Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)

Pernille Kølbæk; Anne B Blicher; Chanette W Buus; Sandra G Feller; Tine Holm; David Dines; Kathrine M O'Leary; Rune S Sørensen; Mark Opler; Christoph U Correll; Ole Mors; Per Bech; Søren D Østergaard

doi:10.1080/08039488.2018.1492014

Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)

Pernille Kølbæk, Anne B Blicher, Chanette W Buus, Sandra G Feller, Tine Holm, David Dines, Kathrine M O'Leary, Rune S Sørensen, Mark Opler, Christoph U Correll, Ole Mors, Per Bech, Søren D Østergaard

Research output: Contribution to journal/Conference contribution in journal/Contribution to newspaper › Journal article › Research › peer-review

22 Citations (Scopus)

Abstract

PURPOSE: The six-item version of the Positive And Negative Syndrome Scale (PANSS-6) is a brief rating scale focusing on core symptoms of schizophrenia. In order to facilitate rating of PANSS-6 and selected items from other common psychiatric rating scales, we recently developed the Simplified Negative and Positive Symptoms Interview (SNAPSI). The objective of the present study was to test the inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI.

MATERIALS AND METHODS: Using the SNAPSI, seven raters (psychiatrists, first-year psychiatry residents and psychologists) performed a total of 56 PANSS-6 ratings of 12 in- or outpatients with schizophrenia. As a measure of inter-rater reliability, we calculated the intra-class correlation coefficient (ICC, ≥0.75 = excellent, 0.40-0.74 = fair to good, <0.40 = poor) for the PANSS-6 total score and individual item scores. Furthermore, for the PANSS-6 total scores obtained by the six noncertified PANSS raters, we calculated the median deviation from the PANSS-6 total scores obtained by the only certified PANSS rater.

RESULTS: The ICC for the PANSS-6 total score was 0.74 (F = 2.84, p = .03). The ICCs for the six individual PANSS-6 items ranged from 0.45 (N6 - Lack of spontaneity & flow of conversation) to 0.76 (P3 - Hallucinatory behavior). The PANSS-6 total scores obtained by the six noncertified PANSS raters deviated by a median of 12.7% (interquartile range: 6.2-20.0) from the PANSS-6 total scores obtained by the certified PANSS rater.

CONCLUSIONS: We found a good level of inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI for seven raters with varying levels of clinical and research experience.

Original language	English
Journal	Nordic Journal of Psychiatry
Volume	72
Issue	6
Pages (from-to)	431-436
Number of pages	6
ISSN	0803-9488
DOIs	https://doi.org/10.1080/08039488.2018.1492014
Publication status	Published - 2018

Keywords

Schizophrenia
psychiatric status rating scales
psychometrics
psychopathology
Reproducibility of Results
Schizophrenia/diagnosis
Humans
Middle Aged
Male
Psychometrics/methods
Psychiatric Status Rating Scales/standards
Young Adult
Adult
Female
Aged
Observer Variation

Access to Document

10.1080/08039488.2018.1492014

Cite this

Kølbæk, P., Blicher, A. B., Buus, C. W., Feller, S. G., Holm, T., Dines, D., O'Leary, K. M., Sørensen, R. S., Opler, M., Correll, C. U., Mors, O., Bech, P., & Østergaard, S. D. (2018). Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI). Nordic Journal of Psychiatry, 72(6), 431-436. https://doi.org/10.1080/08039488.2018.1492014

@article{0275c6bd7f934a5eb117a7ab0e880ff0,

title = "Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)",

abstract = "PURPOSE: The six-item version of the Positive And Negative Syndrome Scale (PANSS-6) is a brief rating scale focusing on core symptoms of schizophrenia. In order to facilitate rating of PANSS-6 and selected items from other common psychiatric rating scales, we recently developed the Simplified Negative and Positive Symptoms Interview (SNAPSI). The objective of the present study was to test the inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI.MATERIALS AND METHODS: Using the SNAPSI, seven raters (psychiatrists, first-year psychiatry residents and psychologists) performed a total of 56 PANSS-6 ratings of 12 in- or outpatients with schizophrenia. As a measure of inter-rater reliability, we calculated the intra-class correlation coefficient (ICC, ≥0.75 = excellent, 0.40-0.74 = fair to good, <0.40 = poor) for the PANSS-6 total score and individual item scores. Furthermore, for the PANSS-6 total scores obtained by the six noncertified PANSS raters, we calculated the median deviation from the PANSS-6 total scores obtained by the only certified PANSS rater.RESULTS: The ICC for the PANSS-6 total score was 0.74 (F = 2.84, p = .03). The ICCs for the six individual PANSS-6 items ranged from 0.45 (N6 - Lack of spontaneity & flow of conversation) to 0.76 (P3 - Hallucinatory behavior). The PANSS-6 total scores obtained by the six noncertified PANSS raters deviated by a median of 12.7% (interquartile range: 6.2-20.0) from the PANSS-6 total scores obtained by the certified PANSS rater.CONCLUSIONS: We found a good level of inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI for seven raters with varying levels of clinical and research experience.",

keywords = "Schizophrenia, psychiatric status rating scales, psychometrics, psychopathology, Reproducibility of Results, Schizophrenia/diagnosis, Humans, Middle Aged, Male, Psychometrics/methods, Psychiatric Status Rating Scales/standards, Young Adult, Adult, Female, Aged, Observer Variation",

author = "Pernille K{\o}lb{\ae}k and Blicher, {Anne B} and Buus, {Chanette W} and Feller, {Sandra G} and Tine Holm and David Dines and O'Leary, {Kathrine M} and S{\o}rensen, {Rune S} and Mark Opler and Correll, {Christoph U} and Ole Mors and Per Bech and {\O}stergaard, {S{\o}ren D}",

year = "2018",

doi = "10.1080/08039488.2018.1492014",

language = "English",

volume = "72",

pages = "431--436",

journal = "Nordic Journal of Psychiatry",

issn = "0803-9488",

publisher = "Informa Healthcare",

number = "6",

}

Kølbæk, P, Blicher, AB, Buus, CW, Feller, SG, Holm, T, Dines, D, O'Leary, KM, Sørensen, RS, Opler, M, Correll, CU, Mors, O, Bech, P & Østergaard, SD 2018, 'Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)', Nordic Journal of Psychiatry, vol. 72, no. 6, pp. 431-436. https://doi.org/10.1080/08039488.2018.1492014

Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI). / Kølbæk, Pernille; Blicher, Anne B; Buus, Chanette W et al.
In: Nordic Journal of Psychiatry, Vol. 72, No. 6, 2018, p. 431-436.

Research output: Contribution to journal/Conference contribution in journal/Contribution to newspaper › Journal article › Research › peer-review

TY - JOUR

T1 - Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)

AU - Kølbæk, Pernille

AU - Blicher, Anne B

AU - Buus, Chanette W

AU - Feller, Sandra G

AU - Holm, Tine

AU - Dines, David

AU - O'Leary, Kathrine M

AU - Sørensen, Rune S

AU - Opler, Mark

AU - Correll, Christoph U

AU - Mors, Ole

AU - Bech, Per

AU - Østergaard, Søren D

PY - 2018

Y1 - 2018

N2 - PURPOSE: The six-item version of the Positive And Negative Syndrome Scale (PANSS-6) is a brief rating scale focusing on core symptoms of schizophrenia. In order to facilitate rating of PANSS-6 and selected items from other common psychiatric rating scales, we recently developed the Simplified Negative and Positive Symptoms Interview (SNAPSI). The objective of the present study was to test the inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI.MATERIALS AND METHODS: Using the SNAPSI, seven raters (psychiatrists, first-year psychiatry residents and psychologists) performed a total of 56 PANSS-6 ratings of 12 in- or outpatients with schizophrenia. As a measure of inter-rater reliability, we calculated the intra-class correlation coefficient (ICC, ≥0.75 = excellent, 0.40-0.74 = fair to good, <0.40 = poor) for the PANSS-6 total score and individual item scores. Furthermore, for the PANSS-6 total scores obtained by the six noncertified PANSS raters, we calculated the median deviation from the PANSS-6 total scores obtained by the only certified PANSS rater.RESULTS: The ICC for the PANSS-6 total score was 0.74 (F = 2.84, p = .03). The ICCs for the six individual PANSS-6 items ranged from 0.45 (N6 - Lack of spontaneity & flow of conversation) to 0.76 (P3 - Hallucinatory behavior). The PANSS-6 total scores obtained by the six noncertified PANSS raters deviated by a median of 12.7% (interquartile range: 6.2-20.0) from the PANSS-6 total scores obtained by the certified PANSS rater.CONCLUSIONS: We found a good level of inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI for seven raters with varying levels of clinical and research experience.

AB - PURPOSE: The six-item version of the Positive And Negative Syndrome Scale (PANSS-6) is a brief rating scale focusing on core symptoms of schizophrenia. In order to facilitate rating of PANSS-6 and selected items from other common psychiatric rating scales, we recently developed the Simplified Negative and Positive Symptoms Interview (SNAPSI). The objective of the present study was to test the inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI.MATERIALS AND METHODS: Using the SNAPSI, seven raters (psychiatrists, first-year psychiatry residents and psychologists) performed a total of 56 PANSS-6 ratings of 12 in- or outpatients with schizophrenia. As a measure of inter-rater reliability, we calculated the intra-class correlation coefficient (ICC, ≥0.75 = excellent, 0.40-0.74 = fair to good, <0.40 = poor) for the PANSS-6 total score and individual item scores. Furthermore, for the PANSS-6 total scores obtained by the six noncertified PANSS raters, we calculated the median deviation from the PANSS-6 total scores obtained by the only certified PANSS rater.RESULTS: The ICC for the PANSS-6 total score was 0.74 (F = 2.84, p = .03). The ICCs for the six individual PANSS-6 items ranged from 0.45 (N6 - Lack of spontaneity & flow of conversation) to 0.76 (P3 - Hallucinatory behavior). The PANSS-6 total scores obtained by the six noncertified PANSS raters deviated by a median of 12.7% (interquartile range: 6.2-20.0) from the PANSS-6 total scores obtained by the certified PANSS rater.CONCLUSIONS: We found a good level of inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI for seven raters with varying levels of clinical and research experience.

KW - Schizophrenia

KW - psychiatric status rating scales

KW - psychometrics

KW - psychopathology

KW - Reproducibility of Results

KW - Schizophrenia/diagnosis

KW - Humans

KW - Middle Aged

KW - Male

KW - Psychometrics/methods

KW - Psychiatric Status Rating Scales/standards

KW - Young Adult

KW - Adult

KW - Female

KW - Aged

KW - Observer Variation

UR - http://www.scopus.com/inward/record.url?scp=85050515907&partnerID=8YFLogxK

U2 - 10.1080/08039488.2018.1492014

DO - 10.1080/08039488.2018.1492014

M3 - Journal article

C2 - 30037286

SN - 0803-9488

VL - 72

SP - 431

EP - 436

JO - Nordic Journal of Psychiatry

JF - Nordic Journal of Psychiatry

IS - 6

ER -

Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this