Multispectral imaging and artificial neural network

Mimicking the management decision of the clinician facing pigmented skin lesions

M. Carrara, A. Bono, C. Bartoli, A. Colombo, M. Lualdi, D. Moglia, N. Santoro, E. Tolomio, S. Tomatis, G. Tragni, M. Santinami, R. Marchesini

Research output: Contribution to journalArticle

36 Citations (Scopus)

Abstract

Various instruments based on acquisition and elaboration of images of pigmented skin lesions have been developed in an attempt to in vivo establish whether a lesion is a melanoma or not. Although encouraging, the response of these instruments, e.g. epiluminescence microscopy, reflectance spectrophotometry and fluorescence imaging, cannot currently replace the well-established diagnostic procedures. However, in place of the approach to instrumentally assess the diagnosis of the lesion, recent studies suggest that instruments should rather reproduce the assessment by an expert clinician of whether a lesion has to be excised or not. The aim of this study was to evaluate the performance of a spectrophotometric system to mimic such a decision. The study involved 1794 consecutively recruited patients with 1966 doubtful cutaneous pigmented lesions excised for histopathological diagnosis and 348 patients with 1940 non-excised lesions because clinically reassuring. Images of all these lesions were acquired in vivo with a multispectral imaging system. The data set was randomly divided into a train (802 reassuring and 1003 excision-needing lesions, including 139 melanomas), a verify (464 reassuring and 439 excision-needing lesions, including 72 melanomas) and a test set (674 reassuring and 524 excision-needing lesions, including 76 melanomas). An artificial neural network (ANN1) was set up to perform the classification of the lesions as excision-needing or reassuring, according to the expert clinicians' decision on how to manage each examined lesion. In the independent test set, the system was able to emulate the clinicians with a sensitivity of 88% and a specificity of 80%. Of the 462 correctly classified as excision-needing lesions, 72 (95%) were melanomas. No major variations in receiver operating characteristic curves were found between the test and the train/verify sets. On the same data set, a further artificial neural network (ANN2) was then architected to perform classification of the lesions as melanoma or non-melanoma, according to the histological diagnosis. Having set the sensitivity in recognizing melanoma to 95%, ANN1 resulted to be significantly better in the classification of reassuring lesions than ANN 2. This study suggests that multispectral image analysis and artificial neural networks could be used to support primary care physicians or general practitioners in identifying pigmented skin lesions that require further investigations.

Original languageEnglish
Article number018
Pages (from-to)2599-2613
Number of pages15
JournalPhysics in Medicine and Biology
Volume52
Issue number9
DOIs
Publication statusPublished - May 7 2007

Fingerprint

lesions
Melanoma
Skin
Neural networks
Imaging techniques
Spectrophotometry
Imaging systems
Image analysis
Microscopic examination
Fluorescence
Dermoscopy
Optical Imaging
Primary Care Physicians
ROC Curve
General Practitioners
physicians
sensitivity
spectrophotometry
image analysis
acquisition

ASJC Scopus subject areas

  • Biomedical Engineering
  • Physics and Astronomy (miscellaneous)
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology

Cite this

Multispectral imaging and artificial neural network : Mimicking the management decision of the clinician facing pigmented skin lesions. / Carrara, M.; Bono, A.; Bartoli, C.; Colombo, A.; Lualdi, M.; Moglia, D.; Santoro, N.; Tolomio, E.; Tomatis, S.; Tragni, G.; Santinami, M.; Marchesini, R.

In: Physics in Medicine and Biology, Vol. 52, No. 9, 018, 07.05.2007, p. 2599-2613.

Research output: Contribution to journalArticle

@article{8828843c6b0849258227cc1aafa5a125,
title = "Multispectral imaging and artificial neural network: Mimicking the management decision of the clinician facing pigmented skin lesions",
abstract = "Various instruments based on acquisition and elaboration of images of pigmented skin lesions have been developed in an attempt to in vivo establish whether a lesion is a melanoma or not. Although encouraging, the response of these instruments, e.g. epiluminescence microscopy, reflectance spectrophotometry and fluorescence imaging, cannot currently replace the well-established diagnostic procedures. However, in place of the approach to instrumentally assess the diagnosis of the lesion, recent studies suggest that instruments should rather reproduce the assessment by an expert clinician of whether a lesion has to be excised or not. The aim of this study was to evaluate the performance of a spectrophotometric system to mimic such a decision. The study involved 1794 consecutively recruited patients with 1966 doubtful cutaneous pigmented lesions excised for histopathological diagnosis and 348 patients with 1940 non-excised lesions because clinically reassuring. Images of all these lesions were acquired in vivo with a multispectral imaging system. The data set was randomly divided into a train (802 reassuring and 1003 excision-needing lesions, including 139 melanomas), a verify (464 reassuring and 439 excision-needing lesions, including 72 melanomas) and a test set (674 reassuring and 524 excision-needing lesions, including 76 melanomas). An artificial neural network (ANN1) was set up to perform the classification of the lesions as excision-needing or reassuring, according to the expert clinicians' decision on how to manage each examined lesion. In the independent test set, the system was able to emulate the clinicians with a sensitivity of 88{\%} and a specificity of 80{\%}. Of the 462 correctly classified as excision-needing lesions, 72 (95{\%}) were melanomas. No major variations in receiver operating characteristic curves were found between the test and the train/verify sets. On the same data set, a further artificial neural network (ANN2) was then architected to perform classification of the lesions as melanoma or non-melanoma, according to the histological diagnosis. Having set the sensitivity in recognizing melanoma to 95{\%}, ANN1 resulted to be significantly better in the classification of reassuring lesions than ANN 2. This study suggests that multispectral image analysis and artificial neural networks could be used to support primary care physicians or general practitioners in identifying pigmented skin lesions that require further investigations.",
author = "M. Carrara and A. Bono and C. Bartoli and A. Colombo and M. Lualdi and D. Moglia and N. Santoro and E. Tolomio and S. Tomatis and G. Tragni and M. Santinami and R. Marchesini",
year = "2007",
month = "5",
day = "7",
doi = "10.1088/0031-9155/52/9/018",
language = "English",
volume = "52",
pages = "2599--2613",
journal = "Physics in Medicine and Biology",
issn = "0031-9155",
publisher = "IOP Publishing Ltd.",
number = "9",

}

TY - JOUR

T1 - Multispectral imaging and artificial neural network

T2 - Mimicking the management decision of the clinician facing pigmented skin lesions

AU - Carrara, M.

AU - Bono, A.

AU - Bartoli, C.

AU - Colombo, A.

AU - Lualdi, M.

AU - Moglia, D.

AU - Santoro, N.

AU - Tolomio, E.

AU - Tomatis, S.

AU - Tragni, G.

AU - Santinami, M.

AU - Marchesini, R.

PY - 2007/5/7

Y1 - 2007/5/7

N2 - Various instruments based on acquisition and elaboration of images of pigmented skin lesions have been developed in an attempt to in vivo establish whether a lesion is a melanoma or not. Although encouraging, the response of these instruments, e.g. epiluminescence microscopy, reflectance spectrophotometry and fluorescence imaging, cannot currently replace the well-established diagnostic procedures. However, in place of the approach to instrumentally assess the diagnosis of the lesion, recent studies suggest that instruments should rather reproduce the assessment by an expert clinician of whether a lesion has to be excised or not. The aim of this study was to evaluate the performance of a spectrophotometric system to mimic such a decision. The study involved 1794 consecutively recruited patients with 1966 doubtful cutaneous pigmented lesions excised for histopathological diagnosis and 348 patients with 1940 non-excised lesions because clinically reassuring. Images of all these lesions were acquired in vivo with a multispectral imaging system. The data set was randomly divided into a train (802 reassuring and 1003 excision-needing lesions, including 139 melanomas), a verify (464 reassuring and 439 excision-needing lesions, including 72 melanomas) and a test set (674 reassuring and 524 excision-needing lesions, including 76 melanomas). An artificial neural network (ANN1) was set up to perform the classification of the lesions as excision-needing or reassuring, according to the expert clinicians' decision on how to manage each examined lesion. In the independent test set, the system was able to emulate the clinicians with a sensitivity of 88% and a specificity of 80%. Of the 462 correctly classified as excision-needing lesions, 72 (95%) were melanomas. No major variations in receiver operating characteristic curves were found between the test and the train/verify sets. On the same data set, a further artificial neural network (ANN2) was then architected to perform classification of the lesions as melanoma or non-melanoma, according to the histological diagnosis. Having set the sensitivity in recognizing melanoma to 95%, ANN1 resulted to be significantly better in the classification of reassuring lesions than ANN 2. This study suggests that multispectral image analysis and artificial neural networks could be used to support primary care physicians or general practitioners in identifying pigmented skin lesions that require further investigations.

AB - Various instruments based on acquisition and elaboration of images of pigmented skin lesions have been developed in an attempt to in vivo establish whether a lesion is a melanoma or not. Although encouraging, the response of these instruments, e.g. epiluminescence microscopy, reflectance spectrophotometry and fluorescence imaging, cannot currently replace the well-established diagnostic procedures. However, in place of the approach to instrumentally assess the diagnosis of the lesion, recent studies suggest that instruments should rather reproduce the assessment by an expert clinician of whether a lesion has to be excised or not. The aim of this study was to evaluate the performance of a spectrophotometric system to mimic such a decision. The study involved 1794 consecutively recruited patients with 1966 doubtful cutaneous pigmented lesions excised for histopathological diagnosis and 348 patients with 1940 non-excised lesions because clinically reassuring. Images of all these lesions were acquired in vivo with a multispectral imaging system. The data set was randomly divided into a train (802 reassuring and 1003 excision-needing lesions, including 139 melanomas), a verify (464 reassuring and 439 excision-needing lesions, including 72 melanomas) and a test set (674 reassuring and 524 excision-needing lesions, including 76 melanomas). An artificial neural network (ANN1) was set up to perform the classification of the lesions as excision-needing or reassuring, according to the expert clinicians' decision on how to manage each examined lesion. In the independent test set, the system was able to emulate the clinicians with a sensitivity of 88% and a specificity of 80%. Of the 462 correctly classified as excision-needing lesions, 72 (95%) were melanomas. No major variations in receiver operating characteristic curves were found between the test and the train/verify sets. On the same data set, a further artificial neural network (ANN2) was then architected to perform classification of the lesions as melanoma or non-melanoma, according to the histological diagnosis. Having set the sensitivity in recognizing melanoma to 95%, ANN1 resulted to be significantly better in the classification of reassuring lesions than ANN 2. This study suggests that multispectral image analysis and artificial neural networks could be used to support primary care physicians or general practitioners in identifying pigmented skin lesions that require further investigations.

UR - http://www.scopus.com/inward/record.url?scp=34249066775&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34249066775&partnerID=8YFLogxK

U2 - 10.1088/0031-9155/52/9/018

DO - 10.1088/0031-9155/52/9/018

M3 - Article

VL - 52

SP - 2599

EP - 2613

JO - Physics in Medicine and Biology

JF - Physics in Medicine and Biology

SN - 0031-9155

IS - 9

M1 - 018

ER -