Semantically Annotated 3D Material Supporting the Design of Natural User Interfaces for Architectural Heritage

With the advent of artificial intelligence and natural user interfaces, the need for multimedia material that can be semantically interpreted in real time becomes critical. In the field of 3D architectural survey, a significant amount of research has been conducted to allow domain experts represent semantic data while keeping spatial references. Such data becomes valuable for natural user interfaces designed to let non-expert users obtain information about architectural heritage. In this paper, we present the architectural data collection and annotation procedure adopted in the Cultural Heritage Orienting Multimodal Experiences (CHROME) project. This procedure aims at providing conversational agents with fast access to fine-detailed semantic data linked to the available 3D models. We will discuss how this will make it possible to support multimodal user interaction and generate cultural heritage presentations.

Segmentation protocols in the digital twins of monumental heritage: a methodological development

The paper shows an advancement of the research that the authors have been carrying out in recent years in semantic structuring of digital architectural representations field, with a focus on the issue of uncertainty of annotations. The studies carried out in this regard have shown how the domain experts specialization determines a vision and interpretation of the same architectural object that we could define “categorized”. The interest was, then, in verifying which categories of experts have a greater degree of agreement in classifying and segmenting architectural elements, to highlight which specializations contribute the most in enriching the semantic reasoning about such forms. Aiming to broaden this reasoning, the research was deepened with annotation sessions concerning architecture examples that didn’t correspond to the classical orders rule but included wider fields of historical heritage (from sacred to fortified architecture). The aim is to verify whether the uncertainty of annotation is actually ascribable to a specific segment of the historical heritage, for example, the classical world, or whether the question is broader and as such in needs deeper thinking.