Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer

The real-world experience

A. Paradiso, E. Marubini, Paolo Verderio, M. E. Cortese, F. De Paola, R. Silvestrini, G. Simone, F. Marzullo, S. Menard, E. Tagliabue, G. Tomasich, M. Mottolese, P. Querzoli, G. Bevilacqua, D. Campani, A. Granato, E. Marinaro, S. Folicaldi, N. Naldi, V. Ludovini & 2 others P. Maioli, L. Bernardi

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

In spite of the large number of studies on technical problems affecting the interlaboratory reproducibility of IHC HER-2/neu determination, only little is known about factors limiting the intra- and interobserver reproducibility in the actual practice of HER-2/neu expression analysis. The aim of the present INQAT study was to evaluate the intra- and inter- observer reproducibility of IHC HER-2 analysis among pathologists routinely working in Italian laboratories. Twenty immunostained slides were distributed to 12 pathologists who had to report, for each slide, the semiquantitative analysis of the percentage of immunopositive cells and the qualitative evaluation of the intensity of membrane staining. The intra- and interobserver reproducibility as well as the reproducibility between each laboratory and the reference values were quantified adopting an approach based on computation of the weighted kappa statistic (KW). Additionally, in order to evaluate the contribution of each category to the overall agreement, the kappa category-specific statistics (KCS) were estimated for both classification criteria by jointly considering all the participating laboratories. The intraobserver analyses showed a satisfactory level of reproducibility for both the percentage of positive cells (median KW, 0.94; range: 0.80-0.96) and membrane staining (median KW, 0.86; range: 0.78-0.96). Similarly, a fairly good level of reproducibility for the percentage of cells (median KW, 0.89; range, 0.73-0.96) and the intensity of membrane staining (median KW, 0.84; range, 0.72-0.92) were observed from comparisons with reference values. When all possible pairwise comparisons were performed, a satisfactory level of interobserver reproducibility was found for most laboratories. KW values varied between 0.51 and 0.98 (median KW, 0.80) and between 0.61 and 0.94 (median KW, 0.81) for semiquantitative and qualitative measurements, respectively. Analysis of the contribution of the extreme categories to the overall agreement showed a substantial or almost perfect agreement for both classification criteria. Conversely, the contribution of intermediate categories appeared to be scarce or slight for the percentage of immunostained cells and slight or fair for the intensity of membrane staining. We conclude that, overall, the interobserver reproducibility in IHC analysis of HER-2/neu expression is satisfactory, although classification of the intermediate categories is problematic, both with regard to the percentage of immunostained cells and the intensity of membrane staining.

Original languageEnglish
Pages (from-to)147-154
Number of pages8
JournalInternational Journal of Biological Markers
Volume19
Issue number2
Publication statusPublished - Apr 2004

Fingerprint

Staining and Labeling
Breast Neoplasms
Membranes
Reference Values
Statistics
Cells
Cell Membrane
Pathologists

Keywords

  • Breast cancer
  • Immunohistochemical HER-2/neu
  • Intra/interobserver reproducibility
  • Quality control

ASJC Scopus subject areas

  • Immunology
  • Biochemistry

Cite this

Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer : The real-world experience. / Paradiso, A.; Marubini, E.; Verderio, Paolo; Cortese, M. E.; De Paola, F.; Silvestrini, R.; Simone, G.; Marzullo, F.; Menard, S.; Tagliabue, E.; Tomasich, G.; Mottolese, M.; Querzoli, P.; Bevilacqua, G.; Campani, D.; Granato, A.; Marinaro, E.; Folicaldi, S.; Naldi, N.; Ludovini, V.; Maioli, P.; Bernardi, L.

In: International Journal of Biological Markers, Vol. 19, No. 2, 04.2004, p. 147-154.

Research output: Contribution to journalArticle

Paradiso, A, Marubini, E, Verderio, P, Cortese, ME, De Paola, F, Silvestrini, R, Simone, G, Marzullo, F, Menard, S, Tagliabue, E, Tomasich, G, Mottolese, M, Querzoli, P, Bevilacqua, G, Campani, D, Granato, A, Marinaro, E, Folicaldi, S, Naldi, N, Ludovini, V, Maioli, P & Bernardi, L 2004, 'Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer: The real-world experience', International Journal of Biological Markers, vol. 19, no. 2, pp. 147-154.
Paradiso, A. ; Marubini, E. ; Verderio, Paolo ; Cortese, M. E. ; De Paola, F. ; Silvestrini, R. ; Simone, G. ; Marzullo, F. ; Menard, S. ; Tagliabue, E. ; Tomasich, G. ; Mottolese, M. ; Querzoli, P. ; Bevilacqua, G. ; Campani, D. ; Granato, A. ; Marinaro, E. ; Folicaldi, S. ; Naldi, N. ; Ludovini, V. ; Maioli, P. ; Bernardi, L. / Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer : The real-world experience. In: International Journal of Biological Markers. 2004 ; Vol. 19, No. 2. pp. 147-154.
@article{170ea219eb184bd885a3a671dfe1ca91,
title = "Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer: The real-world experience",
abstract = "In spite of the large number of studies on technical problems affecting the interlaboratory reproducibility of IHC HER-2/neu determination, only little is known about factors limiting the intra- and interobserver reproducibility in the actual practice of HER-2/neu expression analysis. The aim of the present INQAT study was to evaluate the intra- and inter- observer reproducibility of IHC HER-2 analysis among pathologists routinely working in Italian laboratories. Twenty immunostained slides were distributed to 12 pathologists who had to report, for each slide, the semiquantitative analysis of the percentage of immunopositive cells and the qualitative evaluation of the intensity of membrane staining. The intra- and interobserver reproducibility as well as the reproducibility between each laboratory and the reference values were quantified adopting an approach based on computation of the weighted kappa statistic (KW). Additionally, in order to evaluate the contribution of each category to the overall agreement, the kappa category-specific statistics (KCS) were estimated for both classification criteria by jointly considering all the participating laboratories. The intraobserver analyses showed a satisfactory level of reproducibility for both the percentage of positive cells (median KW, 0.94; range: 0.80-0.96) and membrane staining (median KW, 0.86; range: 0.78-0.96). Similarly, a fairly good level of reproducibility for the percentage of cells (median KW, 0.89; range, 0.73-0.96) and the intensity of membrane staining (median KW, 0.84; range, 0.72-0.92) were observed from comparisons with reference values. When all possible pairwise comparisons were performed, a satisfactory level of interobserver reproducibility was found for most laboratories. KW values varied between 0.51 and 0.98 (median KW, 0.80) and between 0.61 and 0.94 (median KW, 0.81) for semiquantitative and qualitative measurements, respectively. Analysis of the contribution of the extreme categories to the overall agreement showed a substantial or almost perfect agreement for both classification criteria. Conversely, the contribution of intermediate categories appeared to be scarce or slight for the percentage of immunostained cells and slight or fair for the intensity of membrane staining. We conclude that, overall, the interobserver reproducibility in IHC analysis of HER-2/neu expression is satisfactory, although classification of the intermediate categories is problematic, both with regard to the percentage of immunostained cells and the intensity of membrane staining.",
keywords = "Breast cancer, Immunohistochemical HER-2/neu, Intra/interobserver reproducibility, Quality control",
author = "A. Paradiso and E. Marubini and Paolo Verderio and Cortese, {M. E.} and {De Paola}, F. and R. Silvestrini and G. Simone and F. Marzullo and S. Menard and E. Tagliabue and G. Tomasich and M. Mottolese and P. Querzoli and G. Bevilacqua and D. Campani and A. Granato and E. Marinaro and S. Folicaldi and N. Naldi and V. Ludovini and P. Maioli and L. Bernardi",
year = "2004",
month = "4",
language = "English",
volume = "19",
pages = "147--154",
journal = "International Journal of Biological Markers",
issn = "0393-6155",
publisher = "Wichtig Publishing Srl",
number = "2",

}

TY - JOUR

T1 - Interobserver reproducibility of immunohistochemical HER-2/neu evaluation in human breast cancer

T2 - The real-world experience

AU - Paradiso, A.

AU - Marubini, E.

AU - Verderio, Paolo

AU - Cortese, M. E.

AU - De Paola, F.

AU - Silvestrini, R.

AU - Simone, G.

AU - Marzullo, F.

AU - Menard, S.

AU - Tagliabue, E.

AU - Tomasich, G.

AU - Mottolese, M.

AU - Querzoli, P.

AU - Bevilacqua, G.

AU - Campani, D.

AU - Granato, A.

AU - Marinaro, E.

AU - Folicaldi, S.

AU - Naldi, N.

AU - Ludovini, V.

AU - Maioli, P.

AU - Bernardi, L.

PY - 2004/4

Y1 - 2004/4

N2 - In spite of the large number of studies on technical problems affecting the interlaboratory reproducibility of IHC HER-2/neu determination, only little is known about factors limiting the intra- and interobserver reproducibility in the actual practice of HER-2/neu expression analysis. The aim of the present INQAT study was to evaluate the intra- and inter- observer reproducibility of IHC HER-2 analysis among pathologists routinely working in Italian laboratories. Twenty immunostained slides were distributed to 12 pathologists who had to report, for each slide, the semiquantitative analysis of the percentage of immunopositive cells and the qualitative evaluation of the intensity of membrane staining. The intra- and interobserver reproducibility as well as the reproducibility between each laboratory and the reference values were quantified adopting an approach based on computation of the weighted kappa statistic (KW). Additionally, in order to evaluate the contribution of each category to the overall agreement, the kappa category-specific statistics (KCS) were estimated for both classification criteria by jointly considering all the participating laboratories. The intraobserver analyses showed a satisfactory level of reproducibility for both the percentage of positive cells (median KW, 0.94; range: 0.80-0.96) and membrane staining (median KW, 0.86; range: 0.78-0.96). Similarly, a fairly good level of reproducibility for the percentage of cells (median KW, 0.89; range, 0.73-0.96) and the intensity of membrane staining (median KW, 0.84; range, 0.72-0.92) were observed from comparisons with reference values. When all possible pairwise comparisons were performed, a satisfactory level of interobserver reproducibility was found for most laboratories. KW values varied between 0.51 and 0.98 (median KW, 0.80) and between 0.61 and 0.94 (median KW, 0.81) for semiquantitative and qualitative measurements, respectively. Analysis of the contribution of the extreme categories to the overall agreement showed a substantial or almost perfect agreement for both classification criteria. Conversely, the contribution of intermediate categories appeared to be scarce or slight for the percentage of immunostained cells and slight or fair for the intensity of membrane staining. We conclude that, overall, the interobserver reproducibility in IHC analysis of HER-2/neu expression is satisfactory, although classification of the intermediate categories is problematic, both with regard to the percentage of immunostained cells and the intensity of membrane staining.

AB - In spite of the large number of studies on technical problems affecting the interlaboratory reproducibility of IHC HER-2/neu determination, only little is known about factors limiting the intra- and interobserver reproducibility in the actual practice of HER-2/neu expression analysis. The aim of the present INQAT study was to evaluate the intra- and inter- observer reproducibility of IHC HER-2 analysis among pathologists routinely working in Italian laboratories. Twenty immunostained slides were distributed to 12 pathologists who had to report, for each slide, the semiquantitative analysis of the percentage of immunopositive cells and the qualitative evaluation of the intensity of membrane staining. The intra- and interobserver reproducibility as well as the reproducibility between each laboratory and the reference values were quantified adopting an approach based on computation of the weighted kappa statistic (KW). Additionally, in order to evaluate the contribution of each category to the overall agreement, the kappa category-specific statistics (KCS) were estimated for both classification criteria by jointly considering all the participating laboratories. The intraobserver analyses showed a satisfactory level of reproducibility for both the percentage of positive cells (median KW, 0.94; range: 0.80-0.96) and membrane staining (median KW, 0.86; range: 0.78-0.96). Similarly, a fairly good level of reproducibility for the percentage of cells (median KW, 0.89; range, 0.73-0.96) and the intensity of membrane staining (median KW, 0.84; range, 0.72-0.92) were observed from comparisons with reference values. When all possible pairwise comparisons were performed, a satisfactory level of interobserver reproducibility was found for most laboratories. KW values varied between 0.51 and 0.98 (median KW, 0.80) and between 0.61 and 0.94 (median KW, 0.81) for semiquantitative and qualitative measurements, respectively. Analysis of the contribution of the extreme categories to the overall agreement showed a substantial or almost perfect agreement for both classification criteria. Conversely, the contribution of intermediate categories appeared to be scarce or slight for the percentage of immunostained cells and slight or fair for the intensity of membrane staining. We conclude that, overall, the interobserver reproducibility in IHC analysis of HER-2/neu expression is satisfactory, although classification of the intermediate categories is problematic, both with regard to the percentage of immunostained cells and the intensity of membrane staining.

KW - Breast cancer

KW - Immunohistochemical HER-2/neu

KW - Intra/interobserver reproducibility

KW - Quality control

UR - http://www.scopus.com/inward/record.url?scp=4243180460&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=4243180460&partnerID=8YFLogxK

M3 - Article

VL - 19

SP - 147

EP - 154

JO - International Journal of Biological Markers

JF - International Journal of Biological Markers

SN - 0393-6155

IS - 2

ER -