[Table of Contents]

Plasma and Fusion Research

Volume 9, 3406054 (2014)

Regular Articles

Indoor Localization for an Augmented Reality-Aided Operation and Maintenance System based on Sensor Data Integration
Tomohiro UMETANI, Susumu YAMANE and Yuichi TAMURA
Konan University, 8-9-1 Okamoto, Higashinada, Kobe 658-8501, Japan
(Received 10 December 2013 / Accepted 27 February 2014 / Published 7 May 2014)


We propose a method for determining the location of a mobile client for augmented reality (AR) aided maintenance and operation systems using the data integration of localization results from wireless LAN signals and three-dimensional camera image sequences. The AR technology is used to enhance real information by adding virtual objects, images, and sounds through camera images. To apply the AR system to maintenance and operation tasks in large structures, a data management system for localization is crucial because of the cost for searching for real-location information. We propose a sensor data integration scheme for the localization of a mobile client the indoor structure using the localization results from camera image sequences and the results using the wireless LAN signal strength. The data integration scheme provides an area selection method using the estimation result of the location in the structure using wireless LAN signals and the precise location estimation using camera image sequences. The experimental results confirm the feasibility of the proposed method.


augmented reality, visualization, self localization, wireless LAN signals, RGBD camera, sensor data integration

DOI: 10.1585/pfr.9.3406054


  • [1] J. Hightower and G. Borriello, Computer 34, 57 (2001).
  • [2] Y. Tamura, T. Umetani and S. Kubo, Plasma Fusion Res. 8, 2506102 (2013).
  • [3] N. Mizuguchi, Y. Tamura, S. Imagawa, A. Sagara and T. Hayashi, Fusion Eng. Des. 81, 2755 (2006).
  • [4] P. Bahl and V.N. Padmanabhan, Proc. IEEE Infocom 2000 2, 775 (2000).
  • [5] Y. Tamura, Y. Takabatake, N. Kashima and T. Umetani, Plasma Fusion Res. 7, 2406036 (2012).
  • [6] T. Sato, H. Koshizawa and N. Yokoya, Int. J. Virtual Reality 9, 37 (2010).
  • [7] T. Umetani, S. Yamane and T. Tamura, Proc. Int. Conf. Ubiquitous Robots and Ambient Intelligence 240 (2012).
  • [8] T. Umetani, T. Yamashita and Y. Tamura, J. Robot. Mechatronics 23, 475 (2011).
  • [9] D.G. Lowe, Int. J. Comput. Vision 60, 91 (2004).
  • [10] P.J. Bsel and N.D. McKey, IEEE Trans. Pattern Anal. Mach. Intell. 14, 239 (1992).
  • [11] T. Umetani, S. Yamane, T. Yamashita and Y. Tamura, Trans. Inst. Syst. Control Inf. Eng. 25, 316 (2012).

This paper may be cited as follows:

Tomohiro UMETANI, Susumu YAMANE and Yuichi TAMURA, Plasma Fusion Res. 9, 3406054 (2014).