Mobile Computing
Portability is key
98% of students come to college with their own computers
Over the past 5 years, desktop ownership decreased by 27%, and laptop ownership increased by 23

(flash graph)
near ubiquity of cellular telephone adoption

51.2% of students own an Internet-capable device
11.8% of students plan on upgrading to an Internet-capable device in the next 6  months

(graph)

comparision:  2007, only 12% of students owned an Internet capable device

What are they doing on these devices? geolocation, email, sns, general info access
"Little Computers"
Augmented Reality
The Virtuality Continuum
The Future
The Tricorder
Hand-held (or worn around neck)
Voice communication
Image capture
Video playback
Senses phenomena within the local environment
Knowledge of its location in space

Full color display

Digital camera

Video playback

SMS

GPS location

Wi-Fi


The Smartphone
Hand-held device
Voice communication
Image capture
Video Playback
Senses phenomena within the location environment
Knowledge of its location in space

(as I perceived it in the mid 1980's)
Smartphone Capabilities
Expectations

more than 4 in 10 respondents overall (44.5%) agreed or strongly agreed that in the next three years they expect to do many things on a cell phone or handheld Internet device that they currently do on a laptop or desktop computer. Current users also anticipated that their use of mobile services will grow, since almost three-quarters (73.7%) of respondents who currently own an Internet-capable handheld device and access the Internet from their handheld device said they expect their use of the Internet from a handheld device to increase or greatly increase in the next three years.
Current use of mobiles in the classroom

Instructors will probably not be surprised to learn that almost a third of respondents (32.2%) agreed or strongly agreed with the statement “While in class, I regularly use my cell phone or handheld Internet device for non-course activities.” When asked if they use their handheld devices for course-related activities, only 11.3% agreed or strongly agreed.
(oh, and it's also a phone!)
The Internet

Accelerometer

Microphone

Speakers

Bluetooth

Extensible software (apps)


1x
=
600x
And yes, there is an app for that.
Mobile Devices & College Students
Source: The ECAR Study of Undergraduate Students and Information Technology, 2009
Source: The ECAR Study of Undergraduate Students and Information Technology, 2009
So, how can we use mobile devices
in a classroom setting?
Ask the Audience
Poll Everywhere (www.polleverywhere.com)

Construct a poll that lets students vote using a variety of tools (SMS, web form, Twitter)




SMS Distribution Lists
TextMarks (www.textmarks.com)

Create your own text message distribution list for your classes

Easily create polls and surveys

Access your data in real time through a powerful web-based API


Digital Imaging
It's almost impossible to purchase a smartphone without a camera

Smartphone cameras can generally capture both static images as well as video

Images can be stored on the device or sent to others via MMS or a 3rd party application
Maps & Geo-location
Most smartphones have the ability to know where they are based upon GPS / Wi-Fi signals

We can capitalize on this feature and use it to provide contextual access to material
Historic Earth
Podcasts & Syndicated Content
Finding Podcasts
Creating your own podcasts
Mobile Toolbox
Health & Medicine
Image Vis 3D - university of Utah
ImageVis3D Mobile lets iPhone users easily display, rotate and otherwise manipulate 3-D images of medical CT and MRI scans, and a wide range of scientific images, from insects to molecules to engines. This free app is based on computer software from the university's Scientific Computing and Imaging (SCI) Institute.

AnatomyLab allows students to conduct a "virtual dissection" by providing images of a real human cadaver during 40 separate stages of dissection. Just hit the "View Cadaver" button. The software, which sells for $9.99, was designed by biology Professor-Lecturer Mark Nielsen and two University of Utah students, including his son.

http://mobile-libraries.blogspot.com/2009/10/iphone-body-electric-apps-visualize.html
Physiological Metrics
Fitbit - sleep sensor
Zeo - personal sleep coach
Smart Band Aid:  http://gigaom.com/2009/02/22/wi-fi-gets-personal-%E2%80%94-really-personal/

E-Reader
(Milgram, 1994)
Real Environment
Virtual Environment
Augmented Reality
Augmented Virtuality
Complete Immersion within a synthetic environment
Overcoming Fear of Heights using Virtual Reality
Helping Iraq War Veterans Overcome PTSD
A predominantly virtual space where physical elements can be inserted in real-time

A predominantly real space where virtual elements can be inserted in real-time

Examples of Augmented Reality
Why Augmented Reality?  Why Now?
AR has been around for a long time
Only recently has AR been “do-able” on a consumer grade device
Popularity has been driven by:

Fast, cheap computers
Near-ubiquitous mobile devices
Cheap / Pre-installed webcams
Flash-based implementation of AR detection algorithms
How it works
"Magic Mirror"
"Magic Lens"
A Disclaimer
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Larngear Technologies)
(Dante Technologies)
(Human Interface Technology Lab, New Zealand
Bergig, Hagbi, El-Sana & Billinghurst)

Experimental Interfaces
Text Messaging
Merging the Real and the Virtual
AR Physics
Object Recognition
Touch Sensitivity
Color Sensitivity
Games for Rehabilitation
Grab a Star
Virtual Gardner
Hospitible Rooms
Data Visualization
AR Sights
The Whisper Deck
Augmented Reality Digital 
Storytelling (Zooburst!)
Augmented Textbooks
Astronomy
Earth Science
(Larngear Technologies)
Scientific Simulation
Augmented Chemistry
Sim Snails
Bringing Physics to Life
Living Flashcards
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2010, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
(Craig Kapp, 2010, ITP @ NYU)
(Craig Kapp, 2010, ITP @ NYU)
(Craig Kapp, 2009, ITP @ NYU)
Mobile Interfaces
Layar
Google Skymap
NYC Subway Finder
The Future
6th Sense
Playstation EyePet
(Maes & Mistry, 2009, MIT Media Lab)
Sony, 2009)
Emerging Interfaces in Education
How Augmented Reality, Social Computing and Mobile Devices will change the way we Teach, Learn and Play
Craig M. Kapp
March 12th, 2010
NJEDge.Net 11th Annual Faculty Best Practices Showcase
Definition:

Augmented reality (AR) is a term for a live direct or indirect view of a physical real-world environment whose elements are augmented  by virtual  computer-generated imagery
Student Expectations
Augmented Reality!
Digital Imaging
Live Video Streaming
Google Maps
What's on my phone?
Networked Organisms and Habitats
NOAH
(Craig Kapp, 2010, ITP @ NYU)
Fun!
Thank You!
Questions?
Source: The ECAR Study of Undergraduate Students and Information Technology, 2009
Current use in the Classroom
32.2 % : "While in class, I regularly 
use my cell phone or handheld Internet 
device for non-course activities."
11.3 % : "While in class, I regularly use my cell phone or handheld Internet device for course activities."
Source: The ECAR Study of Undergraduate Students and Information Technology, 2009
1994
New Media Consortium 2010 Horizon Report
Emerging Trends
Pages Indexed by Google
1998:  26 million
2000:  1 billion
2008:  1 trillion
Available (for free!) on the iTunes App Store
Level
Compass
Ruler
G-force meter
Scale
Seismometer
= 0.1 mm thick
1994
1998
2000
2008
62,137 miles
26 million pages
1 billion pages
1 trillion pages
Introduction