Using 3D digital models for the virtual restoration of polychrome in interesting cultural sites

In most cases, the polychrome paintings that decorated heritage buildings no longer exist or are reduced to mere remnants. These facts decontextualize the sites in their historical and artistic evolution, distort the intention under which they were conceived, and hamper their accomplishment. Current recovery methods are restricted to the stabilization of the remains in their present status, requiring a lot of completely manual work that is expensive and almost unrelated to the use of new technologies. Three-dimensional digitalization and modelling is proved to be the basis for the virtual recovery of paintings in a significant edifice. To do so, an innovative methodology is presented that allows the 3D geometric information of a site (captured using a laser scanner) to be combined with specially designed 2D artistic images. The resulting 3D digital models can then be focused, with high efficiency projectors, on the equivalent area of the original site, and also used as raw material to compose a video-projection without perspective effects to emulate, with due rigour, the primitive appearance, its evolution along time, the effects of the deterioration, or other interesting aspects. The results obtained at Sta. María de Mave (Palencia, Spain) are presented, supporting the potential of this new methodology not only as a scientific way to discuss possible restoration hypotheses with experts or as a didactic tool for narrating the historical evolution of a monument, but also as a spectacular show for tourists.     

3D digitizing of cultural heritage

In this paper, the authors briefly review the state of the art of the 3D acquisition and digitizing techniques applied to heritage. The main focus is on motivations, issues and technical specification of the 3D digitizing of heritage artworks. Different digitizing technologies currently available for this specific application have been evaluated and tested, with application to a pair of case studies, showing that 3D digitizing technologies are sufficiently developed for extensive application in the field of cultural heritage.     

An integrated and automated segmentation approach to deteriorated regions recognition on 3D reality-based models of cultural heritage artifacts

In the field of Cultural Heritage, image analysis represents an indispensable practice for restorers to collect information about the state of preservation of monuments and artifacts and plan restoration interventions. In addition, during the last two decades, the wide spread of remote sensing technologies and the possibility to build 3D reality-based models of artifacts allow the extension of image analysis to 3D environments. In this context, the purpose of this contribution is to show the results of investigations held in order to provide a methodology for the automatic detection of deteriorated areas within architectures and artifacts using colour images as a field of examination. Using both 2D and 3D segmentation approaches, our methodology aims at speeding and efficiently performing the automatic detection of deteriorated zones within Cultural Heritage and therefore segment 3D digital models acquired using different survey technologies. Within our investigations, we selected case studies concerning recurrent deteriorations, such as, for example, detachments, cracks and chromatic alterations; we run them both to manual and to automatic recognition and selection tests, in order to compare the results obtained using these approaches and evaluate the reliability of the automatic one. Results comparison included computational and user time, quantification of the deteriorated area error between manual and automatically detected zones. Additional parameters characterizing the specific type of deteriorations were also computed for each case study. Comparison between the automatic and the manual procedure showed that the automatic detection is faster and reliable in all our selected case studies, with evident improvements in the efficient evaluation of the entity and extension of deteriorated areas on 3D geometry.     

Automatic monitoring and 3D reconstruction applied to cultural heritage

In this article we present our global approach to the problem of accurate 3D measurement and reconstruction of 3D works of art using a calibrated multi-camera system. In particular, we illustrate a simple and effective adaptive technique for the self-calibration of CCD-based multi-camera acquisition systems with minimum a-prior information. We also propose a general and robust approach to the problem of close-range partial 3D reconstruction of objects from stereo-correspondences. Finally, we introduce a method for performing an accurate patchworking of the partial reconstructions, based on 3D curve matching.     

Efficiently capturing large,complex cultural heritage sites with a handheld mobile 3D laser mapping system

Accurate three-dimensional representations of cultural heritage sites are highly valuable for scientific study, conservation, and educational purposes. In addition to their use for archival purposes, 3D models enable efficient and precise measurement of relevant natural and architectural features. Many cultural heritage sites are large and complex, consisting of multiple structures spatially distributed over tens of thousands of square metres. The process of effectively digitising such geometrically complex locations requires measurements to be acquired from a variety of viewpoints. While several technologies exist for capturing the 3D structure of objects and environments, none are ideally suited to complex, large-scale sites, mainly due to their limited coverage or acquisition efficiency. We explore the use of a recently developed handheld mobile mapping system called Zebedee in cultural heritage applications. The Zebedee system is capable of efficiently mapping an environment in three dimensions by continually acquiring data as an operator holding the device traverses through the site. The system was deployed at the former Peel Island Lazaret, a culturally significant site in Queensland, Australia, consisting of dozens of buildings of various sizes spread across an area of approximately 400 × 250 m. With the Zebedee system, the site was scanned in half a day, and a detailed 3D point cloud model (with over 520 million points) was generated from the 3.6 hours of acquired data in 2.6 hours. We present results demonstrating that Zebedee was able to accurately capture both site context and building detail comparable in accuracy to manual measurement techniques, and at a greatly increased level of efficiency and scope. The scan allowed us to record derelict buildings that previously could not be measured because of the scale and complexity of the site. The resulting 3D model captures both interior and exterior features of buildings, including structure, materials, and the contents of rooms.     

Automated camera network design for 3D modeling of cultural heritage objects

Image-based modeling is an appropriate technique to create 3D models of cultural heritage objects, which starts with the basic task of designing the camera network. This task is, however, quite crucial in practical applications because it needs a thorough planning and a certain level of experience. The optimal camera network is designed when certain accuracy demands are fulfilled with a reasonable effort, namely keeping the number of camera shots at a minimum. In this study, we report on the development of an automated method for designing the optimal camera network for a given cultural heritage building or statue. Starting from a rough point cloud derived from a video image stream, the initial configuration of the camera network is designed, assuming a high-resolution HR state-of-the-art non-metric camera. To improve the image coverage and accuracy, we use a mathematical non-linear optimization with constraints. Furthermore, synthetic images are created to guide the camera operator to the designed images. From the first experimental test, we found that a target accuracy of 10 mm could be maintained although the initial number of more than 300 high-resolution images got reduced to less than 90 for the final, optimized network.     

Cultural heritage interactive 3D models on the web: An approach using open source and free software

Cultural heritage sites and artefacts get a significant added value from high-resolution 3D models. These models are increasingly available due to improvements in technology and to higher integration of survey techniques such as laser scanning and photogrammetry. In this paper we present a case study on the development of a web-based application for user access and interactive exploration of three-dimensional models by providing integrated geometrical and non-geometrical information into an intuitive interface. The main feature of this interactive system is to provide the user with a completely new visit experience based on a free interactive exploration interface of the object (i.e., not constrained by any predefined pathway) and on the opportunity to get more detailed information on specific parts of interest. A parallel aim achieved was to use, in data processing and in the architecture, open source tools and free software, thus providing full transparency on adopted methodology and data processing methods, and a cost effective solution both for server and client. Furthermore, the aspect of data size has been considered using a segmentation and simplification scheme and server-side data management to keep transmission size to a minimum, thus improving access speed.     

A definition of cultural heritage: From the tangible to the intangible

The aim of this work is to analyse the evolution of the concept of cultural heritage in West European states. In the last decades of the 20th century, the term “heritage” was characterised by expansion and semantic transfer, resulting in a generalisation of the use of this word, frequently used in the place of another, such as, monument and cultural property. However, all these terms are not able to cover the same semantic field. Starting by the reflection on the semantic evolution of the notion of cultural heritage in France, we approach to the international definition of heritage given by the directives, charters and international resolutions in order to define a global outline of the meaning of heritage that is not just limited to a particular national dimension. From a purely normative approach, one went to a less restrictive approach, one based on the capacity of the object to arouse certain values that led the society in question to consider it as heritage and therefore, to a further step in which heritage is no longer defined on the basis of its material aspect. This development has also made it possible to recognise intangible cultural heritage, which was ignored for a long time, as heritage to be protected and safeguarded.     

Innovative uses of 3D digital technologies to assist the restoration of a fragmented terracotta statue

This paper describes how some innovative methodologies have been designed and employed to support the restoration of the Madonna of Pietranico, a terracotta statue severely damaged in the 2009 earthquake. The statue, fragmented in many pieces, has undergone a complex restoration performed by a multidisciplinary working group. The contribution of digital technologies was planned from the very beginning, since the complexity of this restoration originated the design of innovative procedures for managing the reassembly and restoration process. The Madonna test bed was therefore an example of how technology innovation could be pushed by clear application needs. A first important contribution was the study of the recombination hypothesis of the fragments. This initial phase was performed on digitized 3D models of the statue fragments, with the aim of reducing fragments manipulation, preventing further damages and increasing the capabilities to rehearse and evaluate different reassembly options. The accuracy of the 3D scanned models and the new recombination procedure introduced in this paper allowed to manage this phase in the digital domain with successful results. The digital 3D models were also used to design and produce an innovative supporting structure, constructed with a rapid prototyping device. Another important contribution concerned the study and virtual restoration of the polychrome decoration of the statue; our aim was to reproduce and restore in the virtual 3D domain the very complex original polychrome decoration, on the base of the remaining traces. Consequently, new virtual painting functionalities have been designed on the MeshLab platform (an open-source tool for 3D models visualization and manipulation) for reproducing pictorial decorations over digital 3D models and have been assessed on this specific test bed. This allowed us also to investigate the complexity of the virtual repainting process and to identify further technology enhancements. Finally, computer graphics technologies have been also used to produce a video that tells the story of the restoration.     

On 3D reconstruction of the old city of Xanthi. A minimum budget approach to virtual touring based on photogrammetry

The old city of Xanthi (Thrace–Greece) is one of the biggest traditional settlements in Greece which has the specialty to exhibit mixed traditional Greek, European and Oriental architectural features. This paper presents a 3D reconstruction of a small part of the settlement. It deals with the idea of using open source systems in 3D graphics in order to produce realistic virtual walkthroughs for culture heritage promotion with a minimum budget and low cost infrastructure.