An alternative approach to mapping pigments in paintings with hyperspectral reflectance image cubes using artificial intelligence

• Main Authors: Tania Kleynhans, Catherine M. Schmidt Patterson, Kathryn A. Dooley, David W. Messinger, John K. Delaney
• Format: Article
• Language: English
• Published: SpringerOpen 2020-08-01
• Series: Heritage Science
• Subjects: Reflectance imaging spectroscopy; Hyperspectral imaging; Convolutional neural network; Pigment mapping; Illuminated manuscripts
• Online Access: http://link.springer.com/article/10.1186/s40494-020-00427-7

Abstract Spectral imaging modalities, including reflectance and X-ray fluorescence, play an important role in conservation science. In reflectance hyperspectral imaging, the data are classified into areas having similar spectra and turned into labeled pigment maps using spectral features and fusing with other information. Direct classification and labeling remain challenging because many paints are intimate pigment mixtures that require a non-linear unmixing model for a robust solution. Neural networks have been successful in modeling non-linear mixtures in remote sensing with large training datasets. For paintings, however, existing spectral databases are small and do not encompass the diversity encountered. Given that painting practices are relatively consistent within schools of artistic practices, we tested the suitability of using reflectance spectra from a subgroup of well-characterized paintings to build a large database to train a one-dimensional (spectral) convolutional neural network. The labeled pigment maps produced were found to be robust within similar styles of paintings.