This document discusses augmented reality and the ARToolkit library. It begins with definitions of augmented reality and its challenges, such as camera tracking, handling occlusions, and illumination consistency. It then discusses augmented reality platforms for Android, including AndAR and NyARToolkit. The document outlines the system requirements and additional requirements for LG Optimus 3D devices. It provides an overview of the ARToolkit library, including its features, architecture, development principles, and limitations.
2. INDEX What is Augmented Reality ? Problems in Augmented Reality Augmented Reality on Android platform Development platform and system requirements LG Optimus 3D additional requirements ARToolKit
3. WHAT IS AUGMENTED REALITY (AR) ? It is a variation of Virtual Environments (VE) It is a system that supplements the real world with computer-generated virtual objects which seem to coexist in the same space and present the following properties: It combines real and virtual objects in real environment It executes interactively in real time It lines up real and virtual objects It is applied to all senses of the user
4. PROBLEMS IN AUGMENTED REALITY There are three major challenges associated with AR: CAMERA TRACKING HANDLING OCCLUSIONS ILLUMINATION CONSISTENCY
5. CAMERA TRACKING Fig 1: the Simple Program Running a virtual block aligned with a real mark Fig 2: Threshold Video Image with Identified Pattern
7. ILLUMINATION CONSISTENCY Three frames from a 3 hour long sequence showing virtual sculpture rendered into scene with consistent illumination.
8.
9. DEVELOPMENT PLATFORM AND SYSTEM REQUIREMENTS Multiplatform (Linux, MacOS and Windows) Windows XP (32-bit), Vista (32- or 64-bit), or Windows 7 (32- or 64-bit) Mac OS X 10.5.8 or later (x86 only) Linux (tested on Ubuntu Linux, Lucid Lynx) Android SDK (http://developer.android.com/sdk/index.html) Eclipse IDE ADT Plugin for Eclipse
10. LG OPTIMUS 3D ADDITIONAL REQUIREMENTS Real3D SDK ( http://developer.lgmobile.com/sdk/android/repository.xml) What LG Real3D provides Real3D API that helps you to control the display hardware block interliving Real3D API demos The emulator that enables you to test your 3D applications with red-cyan glasses
13. ARToolKit Software library for building AR applications. Originally developed by Dr. Hirokazu Kato. Human Interface Technology Laboratory (HIT Lab) at the University of Washington, HIT Lab NZ at the University of Canterbury, New Zealand, ARToolworks, Inc, Seattle.
14. ARToolKit Uses computer vision algorithms to solve AR tracking problem. Calculate the real camera position and orientation relative to physical markers in real time.
15. ARToolKitFEATURES Multiplatform (Linux, MacOS and Windows) Single camera tracking using any black square. Distributed with complete source code. Fast rendering based on OpenGL. Simple and modular API (in C and C++). A complete set of samples and utilities.
16. ARToolKit FEATURES OpenSource with GPL license for non- commercial usage. Commercial licenses are administered by ARToolworks, Inc., Seattle, WA, USA.
18. HOW DOES ARToolKit WORK? Source: http://www.hitl.washington.edu/artoolkit/documentation/userarwork.htm
19. LIMITATIONS Virtual objects appear only when complete markers are visible. Size of virtual objects Movement of virtual objects If users cover up part of the pattern with their hands or other objects the virtual object will disappear
20. LIMITATIONS Range issues Pattern complexity Marker orientation relative to the camera Lighting conditions
21. ARToolKit – DEVELOPMENT PRINCIPLES There are two stages when developing an ARToolKitapplication: 1. Writing the application. 2. Training image-processing routines on markers that will be used in the application.
23. LITERATURE Augment Reality (Edited by SohaMaad), 2010 Intech ARToolKit http://www.tinmith.net/lca2004/ARToolkit/ARToolKit2.33doc.pdf Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach Authors: Yuan Tian, Tao Guan* and Cheng Wang http://www.mdpi.com/1424-8220/10/4/2885/pdf
24. LINKS ARToolKit http://www.hitl.washington.edu/artoolkit/ ARToolkitPro for Android http://www.artoolworks.com/support/library/ARToolKit_Professional ARToolkitPlus 2.1.1 http://handheldar.icg.tugraz.at/artoolkitplus.php NyARToolkit for Android http://sourceforge.jp/projects/nyartoolkit/releases/?package_id=7605