Cultivate Interactive Home Page *
*

Search Disabled

  Home | Current Issue | Index of Back Issues
  Issue 9 Home | Editorial | Features | Regular Columns | News & Events | Misc.

Augmented Reality Touring of Archaeological Sites with the ARCHEOGUIDE System

By Vassilios Vlahakis, John Karigiannis and Nikolaos Ioannidis - February 2003

Vassilios Vlahakis, John Karigiannis and Nikolaos Ioannidis report on ARCHEOGUIDE, the first mobile augmented reality guide for archeological sites and museums.

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Introduction

The ARCHEOGUIDE acronym stands for Augmented Reality-based Cultural HEritage On-site GUIDE [1]. It is an EU IST research project co-funded by a consortium of European companies, research institutes and public authorities. The consortium is led by INTRACOM S.A. (Greece), and consists of IGD (Germany), ZGDV (Germany), CCG (Portugal), A&C2000 (Italy), Post Reality (Greece), and the Hellenic Ministry of Culture (Greece).

The project officially ended in October 2002 and produced the first mobile augmented reality guide for outdoor archaeological sites. ARCHEOGUIDE pioneered real-time on-site access to archaeological multimedia data and enabled the reconstruction of ancient monuments and the revival of scenes from ancient life. The project fills the gap left by conventional paper guidebooks, info kiosks and audio guides and provides truly mobile devices with navigation, personalisation, and interactivity features.

ARCHEOGUIDE System Architecture

ARCHEOGUIDE consists of two main subsystems working in close collaboration. A central server and a set of mobile devices all linked together via a Wireless Local Area Network (WLAN). It is built around a client-server model and allows for expandability and use of additional devices [1]. The system can be employed at any archaeological site or museum.

A Tool for Archaeologists

The server is the heart of the system and addresses the needs of archaeologists and researchers. It comprises a multimedia database where all the information regarding a particular site is archived. This may include photographs and architectural drawings, 3D reconstruction models of monuments, textual and audio descriptions, and videos. This database material may be used for research, education or recreational applications. It is stored along with attributes that relate each data item to the geographic position where it is located or was found, dating, type, and other. With this information available, it is possible to achieve efficient search and retrieval of the required data.

The server comes with a suite of graphical authoring tools that can be used to create new content and set up its thematic and geographic organisation in the database.

Figure 1: screenshot (39KB) :The authoring environment
Figure 1: The authoring environment

A Windows-based interface (Figure 1) allows for easy use and provides operations similar to a standard editor. A Geographic Information System (GIS) Editor can be used to assign and visualise objects and monuments on a digital map of the site. It uses a 3D terrain model or digital map constructed for aerial photographs, site surveying and digitisation of existing printed maps and plans. The tool allows its users (typically archaeologists, curators, or system administrators) to define areas on the map that correspond to the main monuments as well as suggested viewpoints and tour paths for visiting them (Figure 2).

Figure 2: screenshot (21KB): The GIS editor
Figure 2: The GIS editor

Having marked those areas on the map, users can populate them with the raw data items that describe them. Their combination can create a complete description including virtual 3D reconstructions, historical information, and access to related museum exhibits.

The efficient ordering and access of this information can be achieved through the hierarchical ordering scheme shown in Figure 3.

Figure 3: diagram (14KB): Multimedia data structures
Figure 3: Multimedia data structures

An inverted tree can be used to represent the whole site (root), which is then subdivided to areas and monuments (branches), which contain the individual multimedia data objects (leaves).

The ordered data can then be used for the creation of integrated audiovisual AR tours. For this reason, rules and conditions are set for the synchronised presentation of the information so as to create a realistic and scientifically accurate augmented world.

The graphical tools can also be used as virtual reconstruction tools. In this way, archaeological hypotheses can be visualised in a short time, disseminated to the scientific community, and archived for future use. In a similar use scenario, excavation or restoration planning can also be carried out.

Finally, the content of the database can be reused in other applications. Examples include multimedia publishing, educational applications, gaming and tourism.

The Mobile AR Units

Typical users of the ARCHEOGUIDE system are the visitors to an archaeological site. They may be of any educational background, age, and nationality and have varying degrees of archaeological knowledge or computer skills. They will experience the system and its features through one of the available mobile devices. These come in various implementations to cater for different preferences and styles of use.

The mobile AR devices [2] are based on laptop computers equipped with a hybrid user-tracking system and a special visualisation device. The tracking system is based on a GPS receiver, a digital compass and a real-time video-processing algorithm performing markerless image tracking [3]. It provides very accurate calculations of the users' position and orientation and consequently the viewpoint and viewing angle. This information is then used in the rendering of monument reconstruction models and avatar animations on the natural surroundings for the creation of an enhanced view. This view illustrates present day ruins in their original form, and populates the empty site with virtual human animations [4].

The accuracy of these calculations ensures the correct scaling and placement of the corresponding models and avatars on the existing ruins.

Figure 4: screenshots (39KB): An AR reconstruction example: the Philippion 
Temple at Ancient Olympia
Figure 4: An AR reconstruction example:
The Philippion Temple at Ancient Olympia

Figure 4 illustrates the present state of a monument and its AR reconstruction offered by ARCHEOGUIDE. A high degree of realism is achieved enabling users to understand what they see in front of them while listening to a description of the history and use of the monument.

The visualisation of the results is done through a pair of AR binoculars, which are equipped with a small digital camera linked to the hybrid tracker. The device allows users to see the natural view as if looking through optical binoculars but also enhanced by the simulated visual information produced by the system. An illustration of the use of the device can be seen in Figure 5.

Figure 5: photo (28KB): The AR device in use
Figure 5: The AR device in use

Personalised Tours

An important aspect of ARCHEOGUIDE is the automatic selection of information adapted to the user profile. To achieve that, the server database objects are assigned to specific user profiles. So, once users enter their profile to the AR device, the latter automatically selects those items matching the users' profile and presents them in accordance with the users' position and orientation and the underlying rules and conditions associated with the data.

This flow of information minimises the interaction required by users and effectively gives them the freedom to focus their attention on the tour itself, instead of searching for the relevant data. At the same time they may alter the flow of information and request additional data or navigation aid through a graphical menu rendered on the binoculars' view. This scrollable menu can be conveniently controlled by three buttons on the binoculars themselves. It allows users to change the transparency and remove the rendered virtual models, view a site map marked with their position and orientation marked along the main monuments, and visualise and manipulate 3D models of museum artefacts [1].

This method gives those employing the system the freedom to interact in a user-friendly way and have full control of the presentation. In effect, touring with the mobile guide becomes an informative and pleasing experience.

The Electronic Guidebooks

ARCHEOGUIDE users are offered the choice between the AR unit presented above and two electronic book versions. These devices are based either on pen-tablets or PDA devices and are intended for use similar to consulting a standard book. They provide their users with the same information as the AR devices including personalisation and context aware data flow.

The main difference lies in the mode of presentation. Due to their limited processing power, the AR views are pre-calculated during the system installation and initialisation phases and are simply presented in alignment with the users' natural view. The visual presentation is done on their touch-sensitive screens, which are suitable for outdoor viewing even under direct sunlight.

Users can simply consult the devices for context-based information or they can change the mode of presentation and request additional data with a special pen. A graphical interface similar to bookmark tabs allows for easy switching between static views, animations, virtual views and augmented views. The user may navigate inside a 3D terrain model of the site where reconstructed monuments and avatar animations are added. Alternatively, high-resolution augmented images or panoramas can be viewed; they are automatically scrolled as the user turns and heads in another direction.

A navigation interface, similar to that presented above, is used. It also allows the preview of available reconstructions at several points in the site so that the users can plan their itinerary in a better way.

  Figure 6: screenshot (64KB: Characteristic screenshot from the pen-tablet device
Figure 6: Characteristic screenshot from the pen-tablet device

Figures 6 illustrates a characteristic screenshot from the pen-tablet device, where user location and orientation are permanently displayed on the map and the related artefacts are displayed in the right-hand section. Another option in the right-hand display is augmented panoramas featuring 3D reconstructions of monuments in the original environment.

  Figure 7: photo (46KB): Introductory menu for the PDA device
Figure 7: Introductory menu for the PDA device

On-site Installation

ARCHEOGUIDE is a versatile system that can be configured for use at any site. The first step towards an on-site installation is the accurate surveying and 3D-modelling of the site itself. This step is very important as its outcome is used in the selection of user-accessible areas, monuments and suggested tours and viewpoints. Once this has been defined in the server, the topology of the wireless network can be defined and verified through on-site coverage measurements. It is very important to ensure that while good coverage is achieved at all user accessible areas, no damage to the site or visual disturbance are caused.

The process continues with the capture of reference images from the selected viewpoints, the construction of 3D monument reconstruction models, avatar animations, 3D scanning of museum artefacts, and recording of audio narration in a selection of languages.

These steps have to be repeated for every new installation while the content creation process has to be repeated every time an additional point of interest is added to the tour.

The Market for ARCHEOGUIDE and its Future

Currently, there are only a few mobile guide applications installed at cultural heritage sites and museums. They offer basic functionality, like a static site plan, and manual access to visual information or virtual reality reconstructions in the most advanced devices. No mobile device offers AR presentations to its users and the only available substitute are static installations like CAVEs or infokiosks.

This is the reason why the innovative nature of ARCHEOGUIDE is expected to become popular with the general public and at a later stage with the scientific community. ARCHEOGUIDE results do not simply look clean and pleasing. They bring the realism and interaction missing in other systems, together with an extra element in the reconstruction of ruined sites. This element is life through the use of animations aimed at giving more information on the actual use of the site and its history. This way of enriching the information content of the presentations (e.g. knowing what people wore and looked like in a given historical environment) enhances our understanding of that historical environment and makes us more interested in discovering history and cultural heritage.

So far there has been a distinct failure of nerve from museums and archaeological sites to invest in such systems. The reasons behind that are primarily cost and risk avoidance. Yet museums and cultural heritage sites, if they are dynamic in their thinking, could benefit greatly from using 3D and augmented reality both in terms of finance and increased relevance "socially".

There is a strong argument for saying that 3D scanning could, in the mid-term future, be a standard stage in the process of acquiring an object, for reasons of cataloguing, conservation and security. Similarly, the use of GIS is becoming common practice in managing archaeological sites and planning new excavations, and many museums have moved towards virtual collections over the Internet.

The technology is now available to allow this to happen. All that is needed is the will to make good use of it and to combine existing steps of the process in an integrated framework. For these reasons ARCHEOGUIDE is appealing and very promising for adoption by major sites and museums in Europe and beyond. The system could be installed at any site and a large part of the installation and content creation cost can be slashed by reusing digital data, which is usually available for major sites.

ARCHEOGUIDE has undergone trials at Olympia, in Greece. Olympia is one of the most important archaeological sites in the world and offers a perfect use scenario, as it lies in ruins and typically only stones and columns rest intact in their original place. The system was used and evaluated by site visitors, archaeologists and technology experts and received very positive comments for the comprehensive information it provides, the realism of the AR presentations, and the animations for the revival of the ancient Olympic Games. It became an attraction itself and those who participated in the evaluation were prepared to pay a fee to rent it at the beginning of their visit. Negative comments were received for the physical dimensions and weight of the AR mobile unit. This device is being re-engineered and a compact version will be available soon.

The ARCHEOGUIDE consortium has made contacts with archaeological authorities in several countries and is in the process of commercialising the system. Several authorities have expressed interest in acquiring and installing it. A commercial version and a full-scale installation are expected to appear in 2003.

Conclusions

This brief article has aimed at presenting the ARCHEOGUIDE project and the innovations it brings to the cultural heritage sector. ARCHEOGUIDE has successfully completed its research phase and is currently undertaking the commercialisation phase. Market indications point to a full-scale installation in the near future and prospects exist for its adoption in major sites and museums. The technologies and know-how of the project are expected to find applications in other sectors like architecture, e-commerce and education.

References

  1. Vlahakis V., Ioannidis N., Karigiannis J. (2002) ARCHEOGUIDE: Challenges and Solutions of a Personalised Augmented Reality Guide for Archaeological sites. Computer Graphics in Art, History and Archaeology, Special Issue of the IEEE Computer Graphics and Applications Magazine, 22, 5, September-October 2002, 52-60.
  2. Azuma R. (1995) A Survey of Augmented Reality", in SIGGRAPH 95, Course Notes no. 9 (Developing Advanced Virtual Reality Applications), ACM Press, 1995.
  3. - Brown L.G. (1992) A Survey of Image Registration Techniques, ACM Computing Surveys, 24, 4, December 1992, 325-376.

  4. - Holloway R. (1995) Registration Errors in Augmented Reality Systems, (Ph.D. dissertation, Univ. North Carolina at Chapel Hill).
    - Reddy B., Chatterji B. (1996) An FFT-based Technique for Translation, Rotation, and Scale-invariant Image Registration. IEEE Image Processing, 5, 8, August 1996.
    - Seibert F. (1999) Augmented Reality by Using Uncalibrated Optical Tracking, Computers & Graphics, Special Issue on Augmented Reality, 23, 801-804.
    - State A., Hirota G., Chen D.T., Garrett W.F., Livingston M.A., (1996) Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking, SIGGRAPH 96: Proceedings of a Conference, ACM Press.
    - Stricker D. (2001) Tracking with Reference Images: A Real-Time and Markerless Tracking Solution for Out-Door Augmented Reality Applications, in Virtual Reality, Archaeology, and Cultural Heritage International Symposium (VAST01): Proceedings of a Conference on November 28-30 2001, 77-81.
  5. - Christopoulos G., Bastias J., The Olympic Games in Ancient Greece, Ekdotike Athenon, Athens, 1982.
    H-ANIM Specification for a standard VRML humanoid, version 1.0, 1998, on-line paper <http://ece.uwaterloo.ca:80/~h-anim/spec.html> Link to external resource
    - Ratner P. (1998) 3-D human modelling and animation, (John Wiley and sons).
    Magnenat-Thalmann N., Thalmann D. (1996) Interactive computer animation, (Prentice Hall).
    VRML Specification on-line <http://www.vrml.org> Link to external resource
    Wray M., Belrose V. (1999) Avatar in Living Space, in Virtual Reality Modelling Language VRML 99: Proceedings of a symposium.

Author Details

Vassilios Vlahakis
INTRACOM S.A.
Developments Programmes Dept.
19.5 km Markopoulo Ave.
PEANIA, ATHENS
GR-190 02
Greece

URL: <http://www.intracom.gr/> Link to external resource
Email: vvla@intracom.gr Link to an email address
Phone: +30 2106671434
Fax: +30 2106677312

Vassilios Vlahakis is Electronic Engineer at the Development Programmes Department of INTRACOM S.A. in Greece. He received his BEng Degree in Electronic Engineering from UMIST, Manchester (1993), and MSc in Biomedical Engineering (1994) and Ph.D. in Medical Image Processing (1998) from Imperial College, London. He has worked as Biomedical Engineer at St Mary's Hospital, London and as Research Engineer at GE Medical System, Paris. His research interests include Image Processing, Communications, and Augmented Reality. He is a member of IEEE, IEE and the Technical Chamber of Greece.

John Karigiannis
INTRACOM S.A.
Developments Programmes Dept.
19.5 km Markopoulo Ave.
PEANIA, ATHENS
GR-190 02
Greece

URL: <http://www.intracom.gr/> Link to external resource
Email: jkari@intracom.gr Link to an email address
Phone: +30 2106677831
Fax: +30 2106677312

John Karigiannis is Computer Engineer at the Development Programmes Department of INTRACOM S.A. in Greece. He received his BEng Degree in Computer Engineering (1998) and M.A.Sc in Electrical Engineering (2000) from Concordia University, Montreal. He has been a research assistant in the Robotics and Real-Time Systems Lab Research Group at the University of Western Ontario, Canada. His research interests include 3D modelling, simulation of multi-robot industrial processes, and haptic interfaces for VR interaction techniques. He is a member of the Technical Chamber of Greece.

Nikolaos Ioannidis
INTRACOM S.A. Developments
Programmes Dept.
19.5 km Markopoulo Ave.
PEANIA, ATHENS GR-190 02
Greece

URL: <http://www.intracom.gr/> Link to external resource
Email: nioa@intracom.gr Link to an email address
Phone: +30 2106671349
Fax: +30 2106677312

Nikolaos Ioannidis is Associate Manager at the Development Programmes Department of INTRACOM S.A. in Greece and Project Manager of ARCHEOGUIDE. He holds a Diploma in Electrical Engineering from the National Technical University of Athens (1982) and a D.E.A. in Electronics from the National Polytechnic Institute of Grenoble (1983). Before joining INTRACOM, he worked for ALPHA S.A.I. and SOGITEC Industries S.A. (Paris), as a software engineer for 3D Animation. His research interests include digital TV, Multimedia Applications, and Information Services. He is a Member of IEEE, ACM and the Technical Chamber of Greece.

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

For citation purposes:
Vassilios, V., Karigiannis, J. and Ioannidis, N. "Augmented Reality Touring of Archaeological Sites with the ARCHEOGUIDE System", Cultivate Interactive, issue 9, 7 February 2003
URL: <http://www.cultivate-int.org/issue9/archeoguide/>

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Related articles:
If you would like to view similar articles to this one click on a key word below:

< - ARCHEOGUIDE - AR - Augmented Reality - archeological sites - archeological museums - GIS - GPS - >

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -