This presentation explores augmented reality and potential uses within arts education.
Presented as part the SECAC 2012 Visual Resources Curator Group session, "When the Past Collides with the Present: Moving Beyond the Single Classroom Experience via Digital Technologies."
Augmenting Education: The Collision of Real and Virtual Worlds [SECAC]
1. Augmenting Education:
The Collision of Real and Virtual Worlds
Presented as part the SECAC 2012 Visual Resources Curator Group session,
"When the Past Collides with the Present: Moving Beyond the Single Classroom
Experience via Digital Technologies."
Bryan Loar
Senior Director, Research & Knowledge Management
3. Augmented Reality By DanieleCivello
Detail of Google Glass By zugaldia
augmented reality game bibliotheek deventer By
Augmented Reality Brings 3-D to Retail By nilsmengedoht Concept Art 'Tijdmachine' By Tijdmachine
IntelFreePress
Augmented Reality (AR) is the augmentation
of the visual field of a user by enhancing the
current field of vision with additional
information- Caudell and Mizell
Bryan Loar +
4. Real Environment Augmented Reality (AR) Augmented Virtuality (AV) Virtual Environment
OSU Fine Arts
Library - Nike By Global kids Screens By NMC Second
Bryan Loar Life [Modified]
3 m.
MIXED REALITY
CONTINUUM
Bryan Loar +
5. BEGINNINGS Ivan
Sutherland‟s
work at MIT
starting in 1966
led to the first
head-mounted
display
exhibited in
1968. The
1968
display‟s
translucent
properties made
Sutherland, Ivan E. A Head-Mounted Three-Dimensional
Display. Proceedings of the AFIPS Fall Joint Computer it a precursor to
Conference Washington, D.C.: Thompson Books, 1968, p.
757-764. AR.
AR& Virtual Reality (VR) share a
common ancestry.
Bryan Loar +
6. EARLY
MOBILITY
In the late 1990‟s,
researchers like Wayne
Piekarski began to
develop mobile AR
solutions. Some of the
hardware could be
purchased ready to use,
some modified, and
some created. Many of
these systems used a
backpack design to
carry the array of
necessary equipment. Tinmith-Endeavour backpack By Wayne Piekarski
Bryan Loar +
8. HEAD
“Utilizing Vuzix‟s patented quantum
optic see-thru technology, the STAR
1200XL enables you to see the real
world directly through its
MOUNTED
transparent widescreen video
displays. Computer content, such
as text, images and video, are
overlaid on the displays in full color
DISPLAYS
2D or 3D in a display overlay
equivalent to a 75-inch flat panel
display, as seen from 10 feet
(~3m).” - Vuzix
Bryan Loar +
9. Exploring In Situ with Layar By Mosman
Council
MOBILE DEVICES
junaio on iPad 2 - Augmented Reality 2.0 By metaioAR
Patti Maes Projects [Detail] By jurvetson
Bryan Loar +
11. GEO-
LOCATED
AR
TagWhat AR App - SW Portland By Robin M. Ashford
Bryan Loar +
12. Students can see who
I thought the artist
has been to and how
demonstrated technical ability
they have critiqued
but could not execute their
gallery shows on
vision
campus. The act of
John Doe 12:35 10/18 Twitter
critique can become
public discourse
without the need to be
at the same place at
the same time.
GEO-LOCATED AR
g-spot gallery, northside open studios By autovac
GALLERY SHOWS
Bryan Loar +
13. The Getty Museum's Augmented Reality Demo By The
MARKERS
Getty Museum
“The Augsburg Display
Cabinet, the Getty
Museum‟s 17th-century
„cabinet of curiosities‟…
[The] “AR feature is
intended to generate
excitement for what
museums are all about:
discovery and wonder.” -
Anne Martens, J. Paul
Getty Trust
Bryan Loar +
14. HOMEWORK
MARKERS Artist Statement
Jane Doe
Lskdjflkjsdflkjdfsldkfjlskdjfdkfjl
skfjsldfkjsldkfjlsdkjflkdjf.
VineArts Exhibits: Artist Statements By
yjessienilo
lskjdflksjdflksjdflkjsdlfkjsldkfjls
kjflksdjflksjlkdfjlskjflksjflksjldfkj
slkfjlskdjflksjlfkjslkjflsdjflkjflksjd
Students could provide a video
flkjsd.
presentation along with their
homework. The presentation could
visually illustrate the concepts they are lskjdflskjdflsldfkjlsjlskjfdlksjdflk
conveying and build their presenting sjdlfkjslkfjlskjflksjflksjlfkjslfjlsjfl
and public speaking skills. skjdflsjdljflsjflsjf.
Bryan Loar +
15. Cloud Chamber for the Trees
and Sky
Chris Drury
This shelter operates as an
oversized camera obscura or
a pinhole camera. A small
aperture in the roof projects
an inverted image of the sky
onto the floor of the chamber,
an effect that seems to pull
the sky down to the viewer.
Inside, one‟s perspective is
turned upside down. Instead
of looking up at the sky, trees,
or clouds, one looks down on
them from above.
http://www.ncartmuseum.org/
museum_park/art_in_the_par
k/
MARKERLESS
Chris Drury Cloud Chamber for the Trees and Sky NCMA 4529 By bobistraveling
Bryan Loar +
16. INSTRUCTION
EVERYWHERE
Appreciating Art Lecture Series -
Sculpture as Contemporary Art By
nhbnhb1
A teacher can create
videos that give greater
insight to objects in situ
where specific points need
to be stressed or where
little-to-no information
exists. The power of
seeing the object in situ
combined with a deeper
understanding can lead to
more in-depth discussions.
Museum Park NCMA 4502 By bobistraveling
MARKERLESS
Bryan Loar +
18. AUGMENTED
TYPOGRAPHY
Graffiti artist DAIM
partnered with the
creative agency
Jung von
Matt/next GmbH
to create an
innovative form of
typography that
can be viewed 360
degrees. The
process brings a
kinetic element to
the creation of
"Tagged in Motion" (en) - digital light writing By daimorg
digital typography.
Bryan Loar +
20. AUGMENTED
TYPOGRAPHY
The video feed is fed
through a computer and
the software recognizes
the markers.
"Tagged in Motion" (en) - digital light writing By daimorg
Bryan Loar +
21. T(ether)
“A Spatially-
and Body-
Aware
Window for
Collaborative
Editing and
Animation of
3D Virtual
T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible
Media Group
Objects” –
Tangible
Media Group
Tangible Media Group
MIT Media Lab
Bryan Loar +
22. T(ether)
T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible Media Group
Object size, shape, and location can be altered by the use of a glove with
markers.
Bryan Loar +
23. T(ether)
T(ether) – a Spatially- and Body-Aware Window for Collaborative Editing and Animation of 3D Virtual Objects By Tangible Media Group
Multiple collaborators can manipulate their own objects as well as other‟s
objects.
Bryan Loar +
24. AR INTERIOR
& INDUSTRIAL
DESIGN
In 2009, researchers investigated
AR in the context of art, design,
and cultural heritage.
Figure 11: Forming sentences of dancing letters. By Jurjen Caarls et al.
Bryan Loar +
25. AR INTERIOR
& INDUSTRIAL
DESIGN
Students explore changing the
textiles of virtual curtains in a real
room by selecting real materials
with radio frequency identification
(RFID) tags in them. Because they
have virtualized the real textile and
their system recognizes the ids,
real and virtual worlds are uniquely
intertwined. Figure 15: Touching the RFID tagged textiles at the pole changes the texture of the virtual
curtains in the room. By Jurjen Caarls et al.
Bryan Loar +
26. AR INTERIOR
& INDUSTRIAL
DESIGN
Virtual furniture designs with some
that are animated to demonstrate
the assembly process.
Figure 17: Virtual furniture designs; some are animated to show the assembly process. By
Jurjen Caarls et al.
Bryan Loar +
27. AR
CHALLENGES
CHALLENGES TO INCORPORATING AR IN EDUCATION
DEVICE AVAILABILITY
Not all students can be expected to have smart mobile devices.
SOLUTION: Create teams ensuring one person has a smart mobile
device.
OFF-SITE ACCESS
Not all student have transportation to visit sites off campus.
SOLUTION: Keep sites on campus as much as possible. This will also
give the student a deeper appreciation of the school.
Bryan Loar +
29. GOOGLE GLASS
Project Glass: One day... [Detail] By Google
Project Glass eyewear By robpegoraro Google Glass By Stuck in Customs
Bryan Loar +
30. CONTACT In 2011, researchers under
Babak Parviz at the University
of Washington successfully
LENSES
tested a 1-pixel lens “powered
by a remote radio frequency
transmitter in free space…on a
live rabbit.” (Lingley et al.,
2011)
A single-pixel wireless contact lens display By A R Lingley
et al.
Raygun Studio
Bryan Loar +
31. Imagine working with
students where only
part of the class is
present in a real life
and the rest are
virtual holograms
visible through a
head-mounted display
(HMD).
Now imagine projects
where their actions
were recorded and
your interaction does
not have to be at the
same time (i.e.
asynchronous
collaboration through
MIXED MASS
AR)
COLLABORATION
Bryan Loar +
32. Explore AR
Today! Why wait for tomorrow‟s tools. Begin
exploring augmented reality today!
Many apps are available for both iPhones and Android-based smart phones.
Slin'Gooz Junaio
Aurasma Lite Tagwhat
Bryan Loar +
33. THANK YOU
Find this presentation & more at
bryanloar.com
For more resources on AR, please go to
bit.ly/secac12-AR
All images were used for educational, non-commercial purposes only.
Bryan Loar +
Notes de l'éditeur
Caudell, T. and Mizell, D. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proceedings of the Hawaii International Conference on System Sciences, volume 25, pages 659–659. IEEE INSTITUTE OF ELECTRICAL AND ELECTRONICS, 1992.[Tom Caudell and David Mizell]
http://www.tinmith.net/wayne/thesis/piekarski-ch7-hardware.htmSystems like this are still being tested today. However, the increase of broadband networks, the processing power of mobile devices, and the adoption of cloud-based processing and services has given rise to augmented reality solutions for much smaller devices.
Smart phones and tablets act as a “magic window” into the virtual world overlaid on the real world. However, prototypes like MIT’s SixthSense, can project information onto real world objects. For example, the system can recognize books and project Amazon ratings as well as other information right onto the real world book.http://www.media.mit.edu/research/groups/1461/sixthsense
Information from third parties like Wikipedia and user-generated content are combined in a single application and visible in specific locations.
Geo-located Tweets or geo-located posts on Facebook can be viewed through a number of AR browsers including Tagwhat.
http://blogs.getty.edu/iris/cabinet-of-wonders/Fiduciary Markers are symbols that trigger particular actions. Actions can include the appearance to two-dimensional imagery, thee-dimensional models as seen here from the Getty Museum, or even videos.
Other systems use the actual object as the trigger. In this slide we can see additional information about the object, a sculpture in its natural environment, by holding up a smart mobile device. The markerless technique works best with static imagery.
http://daim.org/site/en/2008/05/tagged-in-motion-digital-light-writing-video/Note: DAIM is pronounced “Dime.” Additionally, typography become sculptural. Users can walk in and through the object to obtain a greater appreciation of the spatial relationship the object has within its environment.
“Augmented Reality for Art, Design and Cultural Heritage—System Design and Evaluation” by Jurjen Caarls, Pieter Jonker, Yolande Kolstee, Joachim Rotteveel, and Wim van EckThe image in this slide illustrates the use of 3-D typography that can be manipulated through the movement of the markers. The letters are also animated.
“Manipulation of real objects that influence (through RFID) the virtual world is “magic” for many people.“ - Jurjen Caarls et al.
“66% of those ages 18-29 own smart phones” – The Pew Research Center's Internet & American Life Project, Sept. 2012. http://pewinternet.org/Reports/2012/Smartphone-Update-Sept-2012.aspxAdditional concerns that came up during the question and answer part of the presentation were the reliability of user-generated content and the ability for information systems to handle the increased volume of data.
http://www.youtube.com/watch?v=9c6W4CCU9M4Hands-free mobility combined with voice and image recognition make Google Glass an interesting development. Google glass was introduced earlier this year, and will begin shipping to a limited number of buyers in 2013. Currently, the product relies on being tethered to a networked mobile device.In the image at the top illustrates how Google Glass can recognize imagery (in this case a movie poster), make a recommendation to purchase tickets, and then the user could respond user his or her voice.
http://iopscience.iop.org/0960-1317/21/12/125014The image on the left is an illustration of the contact lens developed at the University of Washington. The image on the right illustrates how may we may see information via contacts in the future.
This may also be an interesting case for Massive, Open Online Courses (MOOCs).
Most of the AR browser apps include third party content like geo-located tweets.Slin’Gooz empowers users to swap one image for another or an image for a video.Another popular app not included above is Acrossair.I found it to be too focused on marketing. NearestWiki works on the Acrossair browser, shows geo-located wiki info, and is a paid app. Other apps like Tagwhat include Wikipedia information for free.