mobile image processing part2

Mobile image processing — Part 2 m “Viewfinder EE368” project =» Image processing library =» Mobile application examples... Mobile devices versus personal computers Feature Motor

Mobile image processing — Part 2

m “Viewfinder EE368” project

=» Image processing library

=» Mobile application examples

Google Goggles

Product recognition

http://www.google.com/mobile/goggles

How to download Google Goggles

m Open the Android Market application

m Search for “Google Goggles”

1 result for "google goggles"

mSG Google Goggles Installed

wits Google Inc wwww

Recognizing video at a glance Visual bookmarks for movies and TV shows

Recognizing video at a glance Visual bookmarks for movies and TV shows

http://msw3.stanford.edu/~dchen/EE368/Video-Search-Android.wmv

Mobile devices versus personal computers

Feature Motorola DROID Typical PC

Screen size 4.6 in x 2.4 in 25 in x 16 in Processor speed 550 MHz 3.0 GHz

Disk space 8 GB external flash 500 GB disk

Typically 3G _

Internet access WiFi at hotspots WiFi or wired Ethernet

Telephony Core feature Supplementary feature

“Viewfinder EE368” project

=» Goals of this project

e Learn how to access frames from the viewfinder

e Learn how to modify camera parameters

e Learn how to augment the viewfinder frames

Beginning the project

e Application Name: Viewfinder EE368

e Package Name: com.example.viewfinderee368

e Create Activity: ViewfinderEE368

Android manifest file (AndroidManifest.xml)

Handle incoming Augment viewfinder viewfinder frames frames with a new and adjust camera layer of information

Viewfinder class: full screen mode

Augment viewfinder frames with a new layer of information

on top

“SY Bernd Girod, David Chen: EE368 Mobile Image Processing — Part 2 no 12

Timeline of events on the mobile device

Preview (| Capture | Capture

Preview class: frames go down two paths

Display on phone screen

Forward to callback function

, Data in YCbCr 4:2:0 format

Preview class: set camera parameters

Preview (View)

Bernd Girod, David Chen: EE368 Mobile Image Processing — Part 2 no 15

DrawOnTop class: create a paint brush

mPaintBlack = new Paint();

DrawOnTop class: YCboCr to RGB

DrawOnTop class: draw histogram bars

Viewfinder EE368 demo

http://ee368.stanford.edu/Android/ViewfinderEE368

Real-time debugging using DDMS (1)

Open Perspective > % Debug

Show View > | 2 Java Browsing

Customize Perspective Other

Save Perspective As

Real-time debugging using DDMS (2)

Name Name Size Date Time Pern

g OSEH368929E3K Online (= data 2010-03-16 17:32 drwx

(& sdcard 2010-04-05 12:54 d -1 (& system 2010-04-05 12:52 drwx

Danger of unresponsiveness

=» Users notice delays longer than ~0.5 sec

=» Android only lets your program “hang” or “freeze” for ~5 sec

before bringing up warning dialog

A\ Sorry!

The process android.process

acore has stopped unexpectedly Please try again

Activity life cycle