Assessing stains on historical documents using hyperspectral imaging

Hyperspectral imaging can be an important tool for the assessment and documentation of the state of preservation of an object. Over time, documents that have experienced heavy usage will inevitably show evidence of handling, which can include staining. In this paper, the use of hyperspectral imaging is described for enhancing the assessment of the visual properties of stains. The use of imaging software (ENVI) is also described for quantitatively assessing the extent of staining in two different documents. Single 10 nm bandpass images can be useful assessing darker stains with well defined boundaries. In one document (a treaty), the faint discolouration on one page made the extent of staining difficult to assess visually. A false colour density slice (450 nm) provided a topographical image which was useful for enhancing the contrast between stained and unstained paper. In this type of image, the degree of discolouration could be correlated to optical density and the amount of staining on a page could then be related to the number of pixels for a given absorbance range. In a second document (a prayer book), the staining was more extensive and some of the stains were dark in appearance. This document also contained a lot of text that was written using a dark irongall ink, which limited the use of a density slice at a single bandpass. In this document, pixel unmixing was successfully used to quantitatively determine the extent of staining. The measurement tool provided with the Nuance? Imaging System made it possible to quantitatively describe the size of the stain in terms of the number of pixels as well as its appearance in terms of average optical density.     

Enhancing the examination workflow for Byzantine icons: Implementation of information technology tools in a traditional context

In the interdisciplinary domain of conservation science, a critical and selective eye is required in order to allow researchers to choose the most effective combination of analytical techniques for each project and, more importantly, to process and analyze the resulting volume of diverse data. The current essay attempts to combine a more traditional workflow for the examination of painted objects with techniques borrowed from the domain of computer science in order to yield the maximum amount of information and make that added knowledge more accessible to the researcher. The project was approached as a case study, regarding a post-Byzantine icon. Three-dimensional digitization with a laser scanning system, X-ray radiography and optical microscopy were applied for the determination of several structural characteristics of the painted surface and the icon's state of preservation. Multispectral imaging was used for the collection of surface spectral data, which were subsequently processed by means of cluster analysis in a novel approach to map the composition of the painted surface. Finally, micro-X-Ray Fluorescence (μ-XRF) was chosen as the primary source for surface pointwise elemental composition data while Fourier Transform Infrared Spectroscopy (FTIR) and Gas Chromatography coupled with Mass Spectroscopy (GC-MS) provided additional assistance in the characterization of materials based on their molecular structure. A custom platform was developed to address the issue of multilevel visualization and assessment of the data, designed to act as a tool for viewing and combining the acquired information. Via this integrated approach valuable information regarding the icon was revealed, including the verification of a prior conservation attempt and partial overpainting, the recording and quantification of the warping of the wooden panel and, finally, the identification of the constituent materials and their spatial distribution.     

Automatic registration of large range datasets with spin-images

Terrestrial laser scanning technique has represented one of the more advances occurred in the last years in the field of data acquisition. Time-of-Flight (TOF) systems provide a fast and reliable tool to measure millions of 3D points allowing a very effective and dense measurement of the surface geometry. Nowadays, the generation of high quality 3D models is a practice applied to different kind of objects: small or medium size artworks, parts of human body, cars, buildings, civil infrastructures (like dams, bridges, plants, etc.) and whole archaeological sites as well. In most cases, in order to capture the whole object geometry a number of single scans need to be acquired from different positions and then stitched together (i.e. registered each other) to generate the full 3D model. The automatization of the registration of multiple scans acquired from a terrestrial laser scanner (TLS) still represents a very attractive research field. The chance to automatically align several point clouds would reduce processing costs in terms of time and human resources. In addition it would allow even non-specialist users to produce 3D models with good quality. This paper contributes to this research area by presenting a method for the automatic registration of very dense point clouds acquired by TLS systems. The proposed solution is an extension to large datasets of an automatic range data registration procedure we developed a few years ago for the modelling of point clouds acquired with close-range laser scanners. Such procedure, based on the spin-images (SIs) algorithm, has been then improved with the introduction of a multi-resolution method that generates a pyramid of spin-images in order to speed up the matching between adjacent scans. The results we present show that this method can be successfully applied for the automatic registration of high density laser scans of complex and large structures of Cultural Heritage.     

An integrated and automated segmentation approach to deteriorated regions recognition on 3D reality-based models of cultural heritage artifacts

In the field of Cultural Heritage, image analysis represents an indispensable practice for restorers to collect information about the state of preservation of monuments and artifacts and plan restoration interventions. In addition, during the last two decades, the wide spread of remote sensing technologies and the possibility to build 3D reality-based models of artifacts allow the extension of image analysis to 3D environments. In this context, the purpose of this contribution is to show the results of investigations held in order to provide a methodology for the automatic detection of deteriorated areas within architectures and artifacts using colour images as a field of examination. Using both 2D and 3D segmentation approaches, our methodology aims at speeding and efficiently performing the automatic detection of deteriorated zones within Cultural Heritage and therefore segment 3D digital models acquired using different survey technologies. Within our investigations, we selected case studies concerning recurrent deteriorations, such as, for example, detachments, cracks and chromatic alterations; we run them both to manual and to automatic recognition and selection tests, in order to compare the results obtained using these approaches and evaluate the reliability of the automatic one. Results comparison included computational and user time, quantification of the deteriorated area error between manual and automatically detected zones. Additional parameters characterizing the specific type of deteriorations were also computed for each case study. Comparison between the automatic and the manual procedure showed that the automatic detection is faster and reliable in all our selected case studies, with evident improvements in the efficient evaluation of the entity and extension of deteriorated areas on 3D geometry.     

Automated camera network design for 3D modeling of cultural heritage objects

Image-based modeling is an appropriate technique to create 3D models of cultural heritage objects, which starts with the basic task of designing the camera network. This task is, however, quite crucial in practical applications because it needs a thorough planning and a certain level of experience. The optimal camera network is designed when certain accuracy demands are fulfilled with a reasonable effort, namely keeping the number of camera shots at a minimum. In this study, we report on the development of an automated method for designing the optimal camera network for a given cultural heritage building or statue. Starting from a rough point cloud derived from a video image stream, the initial configuration of the camera network is designed, assuming a high-resolution HR state-of-the-art non-metric camera. To improve the image coverage and accuracy, we use a mathematical non-linear optimization with constraints. Furthermore, synthetic images are created to guide the camera operator to the designed images. From the first experimental test, we found that a target accuracy of 10 mm could be maintained although the initial number of more than 300 high-resolution images got reduced to less than 90 for the final, optimized network.     

Remote hyperspectral imagery as a support to archaeological prospection

Hyperspectral data were exploited to test their effectiveness as a tool for archaeological prospection, envisaging their potential for detecting spectral anomalies related to buried archaeological structures. For this purpose the airborne Multispectral Infrared and Visible Imaging Spectrometer images were analysed. Each single band of the entire data set and different processing technique products were interpreted to identify any tonal anomalies. Since every analysed image exhibited marks different in terms of size and intensity, two indexes were defined for assessing the potential of anomalies detection of each image. Such parameters were: the Detection Index, used for counting the number of pixels related in each image to marks, and the Separability Index, applied for measuring the tonal difference of the marks with respect to the background. These indexes were tested on two areas within the Selinunte Archaeological Park where the presence of remains, not yet excavated, was supposed by archaeologists. For the test sites any extracted anomalies were evaluated by an expert in order to determine their archaeological relevance. The comparison among the index values, derived from each single band of the spectrometer and from different image processing by-products, allowed to determine which spectral range and which processing method are the most valuable to quickly highlight the anomalies. The analysis pointed out that, where vegetation cover is dominant, the Visible near infrared is the spectral region more sensitive to variations of spectral properties related to buried structures, while, where soil cover becomes relevant, the Short-wave infrared and the Thermal-infrared regions resulted more sensitive. As far as the applied processing methods are concerned, the Spectral Angle Mapper classifier and, secondly, the Minimum Distance algorithm stressed the highest archaeological information content. The results of this work showed that the archaeological information content derived by analysing the outputs of the applied image processing techniques is more significant than the information obtained by interpreting each single band and the available historical aerial photos. As a final remark, the data processing flow chart, applied to the entire remote hyperspectral data set over Selinunte Archaeological Park, appeared encouraging for detection of anomalies related to the presence of the buried archaeological structures.     

A color image segmentation method as used in the study of ancient monument decay

In the cultural heritage area, it is of fundamental importance to characterize and classify the conservation state of the materials constituting ancient monuments, in order to study and monitor their decay. Generally, the decay diagnosis is provided by “naked eye” analysis done by expert scientists “walking around” the artifact and recording the conservation state of each individual element they observe. In this paper, a color image segmentation approach, based on histogram threshold and edge detection techniques is presented, to extract degradation regions, characterized by holes or cavities, from color images of stone-materials. The goal is to provide an aid to the decay diagnosis by segmenting degraded regions from color images, computing quantitative data, such as the area and perimeter of the extracted zones, and processing qualitative information, such as various levels of depth detected into the same zones. Since color is a powerful tool in the distinction between objects, a segmentation technique based on color, instead of intensity only, has been used to provide a clearer discrimination between regions. The study case concerns the impressive remains of the Roman Theatre in the city of Aosta (Italy). In particular, we have processed and analyzed some color images of the theatre puddingstones, acquired by a camera.     

Arabo-Moresque decor image retrieval system based on mosaic representations

The paper describes a new method for indexing an Arabo-Moresque decor database. This method requires that the images in the database must have the whole principal geometric information, named ‘spine’ of the decor. In practice, it is difficult to respect this request. When the distance between the camera and the real scene (fresco in Zellij) is big, the whole spine is captured but the resolution of the image is bad. On the other hand, when this distance is small, the resolution is high but the spine is not completely captured. This motivates the use of the ‘mosaicing’ technique. The contribution of this work is the combination of the mosaicing and indexing techniques for the development of an Arabo-Moresque decor image retrieval system.     

Locating contact areas and estimating contact forces between the “Mona Lisa” wooden panel and its frame

Since 2004 an international research group of Wood Technologists has been given by the Louvre Museum the task of analysing the hygro-mechanical state of the Poplar (Populus alba L.) panel on which Leonardo da Vinci painted his “Mona Lisa”, namely verifying the appropriateness of the thermo-hygrometric conditions in its exhibiting showcase, where the microclimate is actively controlled, and assessing the potential consequences of any hypothetical fluctuation. In order to acquire data about the mechanical behaviour of the panel, and to feed and calibrate appropriate simulation models, the team has not only set up a continuous monitoring by means of automatic equipment, but has also performed manual measurements on the occasion of the annual openings of the showcase where the masterpiece is conserved and exhibited. This paper reports about techniques used for estimating the forces acting between the wooden panel and its frame (the châssis-cadre), and their location, such data being of primary importance for evaluating the panel's internal stresses. The contact forces have been calculated on the basis of the local contact pressures, imprinted on a pressure-sensitive foil as a range of saturation values of the colour developed in the contact areas. The forces calculated as above have also been compared with the contact forces between the panel's back face and the crossbeams pressing it against the châssis-cadre, which have been measured by means of a load cell. As could be expected, the results from so different techniques do not strictly coincide; however the agreement is fairly good.     

Assessment of laser cleaning rate on limestones and sandstones

Within the framework of a European project, three cleaning laser devices are tested to evaluate the influence of different parameters on stone cleaning rate and efficiency. The project objective is to design a large surface-cleaning laser. One of the devices is a prototype with some technological improvements compared to the lasers used today for restoration. The tests are performed on limestone and sandstone covered with various dirt layers. The influence of fluence, water spraying, spot area, frequency, as well as particle emission rate is investigated. Results allow a comparison of the importance of each parameter and confirm the increase in cleaning speed of the new prototype. Nevertheless, it can be concluded that an automatic device will be suitable to attain a cleaning speed competitive with other traditional cleaning techniques.     

Surveying the roofs of Rome

This study is aimed at investigating a portion of the city of Rome by means of remotely sensed Multispectral Infrared And Visible Imaging Spectrometer (MIVIS) data. A particular attention was devoted to building roofs described not only as the last defining touch given to a building, the aesthetic conclusion to a whole construction process, but also as expression and sign of a society's level of civilisation, culture and technical skill. Through the classification of objects and materials, we propose to combine history and science as different ways of interpreting a city, in this case Rome, and to implement an image processing technique as an effective tool in urban planning.     

Trans-illumination and trans-irradiation with digital cameras: Potentials and limits of two imaging techniques used for the diagnostic investigation of paintings

During the past two decades, thanks to the rapid development of solid-state-based sensor technology, digital imaging emerged as one of the most attractive research areas for the noninvasive investigation of paintings and flat artworks. In particular, the commercial availability of high-performance digital cameras opened up new perspectives to transmitted imaging techniques, such as trans-illumination and trans-irradiation, which are based on the acquisition of the visible (Vis) and near infrared (NIR) radiation, respectively, transmitted through the object. Until recently, these techniques were indeed considered to be unsuitable for applications on artefacts, because of the risks of overheating and overexposure to the light of the object under analysis. Nowadays, with the new-generation digital cameras, transmitted imaging can be reconsidered as a possible tool for noninvasive diagnostics on paintings on canvas. These techniques have been proven to be effective for the examination of hidden details, such as underlying drawing, for a study of the pictorial style or the executive techniques, as well as for assessing the state of conservation of the supports. Both trans-illumination and trans-irradiation can be easily implemented by means of professional photographic digital cameras, and therefore offer a valuable alternative to the more expensive well-established methodologies, such as X-ray radiography. In some cases, they are found to be complementary to the conventional techniques in revealing details of the underlying paint layers. Potentials and limits of transmitted imaging techniques are discussed in this paper, starting from three case studies of oil-paintings on canvas that belong to the permanent collection of the Gallery of modern art at the Pitti Palace in Florence.     

People-based marketing and the cultural economies of attribution metrics

This article examines People-Based Marketing (PBM) to theorize the cultural economies of attribution metrics. Through an analysis of marketing discourses, acquisition patterns, and marketing collaborations, it examines how platform capitalism is increasingly directed towards developing cross-device identity standards that consolidate performance metrics across digital markets. PBM extends the processes of platform capitalization across media properties, and the ways that claims of value and relevance are imbricated with the metricization of behavioral change in digital markets. The imperative of PBM to standardize techniques of identification and to make media increasingly measurable across markets has been a catalyst for new forms of data resolutions through strategic acquisitions and identity resolution consortiums. Moreover, emerging regulatory changes such as GDPR may in effect further reinforce trends towards the consolidation of data management and analytics platforms necessary to resolve identity across markets.     

3D reconstruction of small sized objects from a sequence of multi-focused images

3D reconstructions of small objects are more and more frequently employed in several disciplines such as medicine, archaeology, restoration of cultural heritage, forensics, etc. The capability of performing accurate analyses directly on a three-dimensional surface allows for a significant improvement in the accuracy of the measurements, which are otherwise performed on 2D images acquired through a microscope. In this work we present a new methodology for the 3D reconstruction of small sized objects based on a multi-view passive stereo technique applied on a sequence of macro images. The resolving power of macro lenses makes them ideal for photogrammetric applications, but the very small depth of field is their biggest limit. Our approach solves this issue by using an image fusion algorithm to extend the depth of field of the images used in the photogrammetric process. The paper aims to overcome the problems related to the use of macro lenses in photogrammetry, showing how it is possible to retrieve the camera calibration parameters of the sharp images by using an open source Structure from Motion software. Our approach has been tested on two case studies, on objects with a bounding box diagonal ranging from 13.5 mm to 41 mm. The accuracy analysis, performed on certified gauge blocks, demonstrates that the experimental setup returns a 3D model with an accuracy that can reach the 0.05% of the bounding box diagonal.     

Review of several optical non-destructive analyses of an easel painting. Complementarity and crosschecking of the results

Five optical analyses of a given work of art are presented, using multispectral imaging, optical coherence tomography, goniophometry, UV-fluorescence emission spectroscopy and diffuse reflectance spectroscopy. All these methods are non-destructive, contactless, and implementable in situ. They all lead to results in quasi-real time. The multispectral camera allows imaging of the whole painting with very high definition and recording of 240 millions of spectra. Optical coherence tomography allows local 2D and 3D imaging with in-face and in depth stratigraphies inside the painting with a micrometric accuracy. It allows the evaluation of the pigment volume concentration inside a layer, the measurement of the thickness of one or two varnish layers, the detection and measurements of gaps inside the paint layer, the depth of varnish micro-cracks. Goniophotometry allows the measurement of the upper surface state of the painting in different locations, by quantifying the mean slope of the facets making up the surface. UV-fluorescence emission spectroscopy allows the identification of the resin, the binder and the ageing state of varnishes by use of databases of reference varnishes. Diffuse reflectance spectroscopy leads to pigment, pigment mixture and dye identifications again by use of databases. The three last methods are implemented with the same portable multi-function instrument. It allows time saving, locations on request in front of the artwork and easy use by non-scientists. Each instrument is described with its protocol and accuracy. The studied painting is a portrait of a lady painted by the Austrian artist Franz Strotszberg, chosen for its several restorations. The five kinds of results are successively detailed, analysed and compared between themselves. It is shown that the different results are complementary and their crosschecking brings thorough information. For example, the shape of the network of varnish micro-cracks detected on the surface with the multispectral camera is added to the measurement of their depth with optical coherence tomography. Another example allows connecting two different surface states of the upper varnished surface measured by goniophotometry with the identification of these varnish with UV-fluorescence and with their thicknesses measured with optical coherence tomography.     

Indirect estimation of injected mortar volume in historical walls using the electrical resistivity tomography

The electrical resistivity tomography (ERT) represents one of the widely used geophysical techniques for the exploration of the subsurface. In the last few years, this method has been demonstrated to be an efficient reconnaissance tool not only for monitoring degradation status of walls and foundations of historical buildings, but also for imaging the spatial distribution of injected mortar, commonly employed for consolidation purposes. A 3D resistivity tomography survey was carried out on four selected wall portions of the historical church of Montepetriolo, Perugia, Central Italy. The obtained 3D resistivity distribution models before and after grouting provided suggestive images of the internal structure of the studied walls. Moreover, the spatial distribution of the zones being filled with mortar was determined quantitatively by scaling the post- to the preinjection resistivity values. Using a well known correlation between resistivity and porosity, established in the geophysical community, a further step towards a more quantitative assessment was attempted to indirectly determine the unit volumes of the injected mortar The obtained results were satisfactory and in some cases almost similar to the yard data. Furthermore, two flat-jack tests confirmed the local increment of the mechanical resistance of the studied left front (2) and right lateral (3) wall portions.     

Infrared thermography and Georadar techniques applied to the “Sala delle Nicchie” (Niches Hall) of Palazzo Pitti,Florence (Italy)

Two noninvasive geophysical techniques, infrared thermography and georadar, were used in this study to investigate the internal walls of the “Sala delle Nicchie” (Niches Hall) of Pitti Palace, in Florence. The aim of this work was to verify that the original architectonic setting of this Hall was as reported in a planimetry of anonymous author dated late 1700. This document shows that the “Sala delle Nicchie” was characterized at that time by 10 niches instead of the six that are visible today. Both the infrared thermography and georadar surveys confirmed the presence and location of the niches as indicated in the planimetry. This study results prove the importance and benefit of using nondestructive techniques in sites of artistic and historical interest.     

Making architecture compete: open-ended accumulation meets objectification and singularisation in the UK construction industry

Sociologists over the last two decades have taken inspiration from actor-network theory to suggest that competition, like ‘the market’, takes place through a dynamic of detaching objects from one set of relations and reattaching them within another: objectification and singularisation. Yet there has been little theorisation of how competition differs between situations. To approach this question, we can ask how competition, as a process of objectification and singularisation, interacts with other patterns of movement. Ethnographers have described one such pattern in the everyday work of architects. Here a building emerges from an ever-increasing number of ‘versions’, images and models, in an open-ended accumulation. This study considers the interaction between, first, the objectification and singularisation of competition and, second, the open-ended accumulation of architectural work. To do so, I examine architectural competitions in the UK. I draw from document analysis of one competition for a school in northern England, as well as interviews with architects about their work on competitions. This study concludes that architectural competitions repeat the multiplicity of architectural work but in a more delimited form. Multiplicity is not ‘cut-off’ so much as winnowed down through an explicit process of selecting images and blocks of text.     

First experiments for the use of microblasting technique with powdered cellulose as a new tool for dry cleaning artworks on paper

This research evaluates the use of microblasting technique with powdered cellulose as a new tool for dry cleaning documents. Different cleaning tests were conducted on three documents with different properties following this new approach and the results were compared to those obtained with traditional dry cleaning with erasers. In order to assess changes caused to the supports, the treated documents were examined both before and after cleaning with optical and 3D stereomicroscopy, SEM-EDS and spectrophotometry. The results allow the conclusion that microblasting with powdered cellulose is a feasible technique to remove surface dirt or grime on paper documents. This research proves that the new use of the technique does not entail changes to the surface properties of the treated supports. Moreover, powdered cellulose is chemically stable and compatible with paper documents, preventing negative long-term effects derived from the presence of rubber residues that may remain in paper fibres when using erasers in dry cleaning treatments.     

Generation of virtual models of cultural heritage

Different techniques and tools currently exist to generate three-dimensional models of small elements, buildings and cities. Apart from being easier to interpret than two-dimensional drawings, these models facilitate data necessary for reconstruction projects, preservation or rehabilitation of the architectural or archaeological heritage. Traditional surveying only enables us to obtain discrete information of the characteristic lines that define each surface, edge, slope change etc. whereas work with massive capture techniques allows us to obtain continuous points of the surfaces. Photogrammetry or laser scanning combined with conventional photography provides information of the building in addition to its geometry. We carried out a review of the different techniques showing the advantages and disadvantages of each technique as well as the information that can be obtained by applying these techniques to the survey of the great Gate of Antioch in the town of Aleppo, declared a World Heritage Site by UNESCO in 1986, in Syria.