Multiple User InterfacesCross-Platform Applications and Context-Aware Interfaces phần 1 ppsx

Multiple User Interfaces Cross-Platform Applications andContext-Aware Interfaces Edited by Ahmed Seffah and Homa Javahery Concordia University, Department of Computer Science, Canada...

Multiple User Interfaces Cross-Platform Applications and

Context-Aware Interfaces

Edited by

Ahmed Seffah and Homa Javahery

Concordia University, Department of Computer Science, Canada

Multiple User Interfaces

Multiple User Interfaces Cross-Platform Applications and

Context-Aware Interfaces

Edited by

Ahmed Seffah and Homa Javahery

Concordia University, Department of Computer Science, Canada

Copyright  2004 John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester,

West Sussex PO19 8SQ, England Telephone ( +44) 1243 779777 Email (for orders and customer service enquiries): cs-books@wiley.co.uk

Visit our Home Page on www.wileyeurope.com or www.wiley.com

All Rights Reserved No part of this publication may be reproduced, stored in a retrieval system or

transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except under the terms of the Copyright, Designs and Patents Act 1988 or under the terms of a licence issued by the Copyright Licensing Agency Ltd, 90 Tottenham Court Road, London W1T 4LP, UK, without the permission in writing of the Publisher Requests to the Publisher should be addressed to the Permissions Department, John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England, or emailed to permreq@wiley.co.uk, or faxed to ( +44) 1243 770620.

This publication is designed to provide accurate and authoritative information in regard to the subject matter covered It is sold on the understanding that the Publisher is not engaged in rendering professional services If professional advice or other expert assistance is required, the services of a competent professional should be sought.

Other Wiley Editorial Offices

John Wiley & Sons Inc., 111 River Street, Hoboken, NJ 07030, USA

Jossey-Bass, 989 Market Street, San Francisco, CA 94103-1741, USA

Wiley-VCH Verlag GmbH, Boschstr 12, D-69469 Weinheim, Germany

John Wiley & Sons Australia Ltd, 33 Park Road, Milton, Queensland 4064, Australia

John Wiley & Sons (Asia) Pte Ltd, 2 Clementi Loop #02-01, Jin Xing Distripark, Singapore 129809 John Wiley & Sons Canada Ltd, 22 Worcester Road, Etobicoke, Ontario, Canada M9W 1L1

Wiley also publishes its books in a variety of electronic formats Some content that appears

in print may not be available in electronic books.

Library of Congress Cataloging-in-Publication Data

Multiple user interfaces : cross-platform applications and context-aware interfaces / edited by

Ahmed Seffah & Homa Javahery.

British Library Cataloguing in Publication Data

A catalogue record for this book is available from the British Library

ISBN 0-470-85444-8

Typeset in 10/12pt Times by Laserwords Private Limited, Chennai, India

Printed and bound in Great Britain by TJ International, Padstow, Cornwall

This book is printed on acid-free paper responsibly manufactured from sustainable forestry

in which at least two trees are planted for each one used for paper production.

Ahmed Seffah and Homa Javahery

Ahmed Seffah and Homa Javahery

2.1 MUI: Characterization and Evolution 112.1.1 Interaction Styles 132.1.2 Fundamental Characteristics 152.1.3 Vertical versus Horizontal Usability 16

2.2 Fertile Topics for Research Exploration 182.2.1 Context-Aware Development 182.2.2 Model-Based Development 20

vi CONTENTS

2.2.3 Pattern-Driven Development 222.2.4 Device-Independent Development 23

3 A Reference Framework for the Development of Plastic User Interfaces 29

David Thevenin, Jo¨elle Coutaz, and Ga¨elle Calvary

3.2 Terminology: Context of Use, Plastic UI and Multi-Target UI 303.2.1 Context of Use and Target 303.2.2 Multi-Target User Interfaces and Plastic User Interfaces 313.2.3 Terminology: Summary 323.3 The “Plastic UI Snowflake” 323.3.1 Target Sensitivity 333.3.2 Classes of Software Tools 333.3.3 Actors in Charge of Adaptation 343.3.4 Computation of Multi-Target and Plastic User Interfaces 353.3.5 User Interface Software Components 353.3.6 User Interface Migration 373.4 The Process Reference Framework for Multi-Target and Plastic UIs 373.4.1 General Description 383.4.2 The Process Reference Framework in the Design Phase 393.4.3 Instantiations of the Process Reference Framework 413.5 ARTStudio: An Application of the Process Reference Framework 433.5.1 The EDF Home Heating Control System 43

David England and Min Du

4.2 Temporal Contexts of Multiple Platforms 554.2.1 Fitts’ Law and the Control:Display Ratio 554.2.2 Computation Speed of the Platform 564.2.3 Support for Task Switching on Platforms 564.3 Modelling Temporal Contexts 574.3.1 Action Selection Pattern 584.3.2 Progress Monitoring Pattern 59

CONTENTS vii

4.3.3 Task Management Pattern 614.3.4 Platform Interaction Pattern 624.4 The Temporal Constraint Engine 63

Constantine Stephanidis, Alexandros Paramythis, Vasilios Zarikas,

and Anthony Savidis

Mir Farooq Ali, Manuel A P´erez-Qui˜nones, and Marc Abrams

CONTENTS ix

9 Adaptive Task Modelling: From Formal Models to XML

10 Multi-Model and Multi-Level Development of User Interfaces 193

Jean Vanderdonckt, Elizabeth Furtado, Jo˜ao Jos´e Vasco Furtado,

Quentin Limbourg, Wilker Bezerra Silva, Daniel William Tavares Rodrigues, and Leandro da Silva Taddeo

11 Supporting Interactions with Multiple Platforms Through User

Luisa Marucci, Fabio Patern`o, and Carmen Santoro

x CONTENTS

11.2 An Illustrative Scenario 21911.3 General Description of the Approach 22111.4 Role of the Task Model in Design 22311.4.1 From the Task Model to the Abstract User Interface 22511.4.2 The Language for Abstract User Interfaces 22611.4.3 From the Abstract User Interface to its Implementation 22811.5 Relations between Task Model and User Model 228

11.7.1 Navigation as a Function of Task Frequency 23211.7.2 Navigation as a Function of Task Performance 23411.7.3 Modification of Presentation 23511.7.4 Modification of Content Presentation 235

12 Migrating User Interfaces Across Platforms Using HCI Patterns 241

Homa Javahery, Ahmed Seffah, Daniel Engelberg, and Daniel Sinnig

12.2 A Brief Overview of HCI Patterns 24312.3 Redesigning User Interfaces with Pattern Mapping 24512.3.1 The Effect of Screen Size on Redesign 24512.3.2 Pattern-based Redesign: A Case Study with Navigation

13 Support for the Adapting Applications and Interfaces to Context 261

Anind K Dey and Gregory D Abowd

13.2 Why Context is Difficult to Use and Why Support is Needed for it 26413.2.1 Separation of Concerns 26413.2.2 Context Interpretation 265

CONTENTS xi

13.2.3 Transparent, Distributed Communications 26513.2.4 Constant Availability of Context Acquisition 26613.2.5 Context Storage and History 26613.2.6 Resource Discovery 26613.3 Basic Component-Based Architecture and the Conference Assistant

13.3.1 Context Widgets 26813.3.2 Context Aggregators 26813.3.3 Context Interpreters 269

13.5 Fusion Support and the In/Out Board Application 28413.5.1 The Architecture of the Location Service 28513.5.2 Representing Location 28613.5.3 Details on Positioning Systems 28713.5.4 Fusion and Aggregation of Location 28913.5.5 Accessing, Interpreting and Handling Location Data Within

14 A Run-time Infrastructure to Support the Construction of Distributed,

Simon Lock and Harry Brignull

14.2 MUI Interaction Scenario 29814.3 Requirements for Infrastructure 29914.4 Existing Approaches 30114.5 Design of Infrastructure and Development Framework 30314.5.1 Design of Interaction Metaphor 30514.5.2 Bubble Glosses 30714.6 Implementation of Infrastructure and Development Framework 31014.7 Operation of the Infrastructure 31114.7.1 Dynamic Device Service Registration 311

xii CONTENTS

14.7.2 Dynamic Device Service Selection 31114.7.3 Application Service Linkage 31214.7.4 Bubble Synchronisation 31314.8 Infrastructure Utilisation 31414.9 Application Usage Scenarios 316

Gustav ¨ Oquist, Mikael Goldstein and Didier Chincholle

16 Iterative Design and Evaluation of Multiple Interfaces for a Complex

CONTENTS xiii

16.5.2 Selected Results 36616.6 Summary and Conclusions 369

17 Inter-Usability of Multi-Device Systems – A Conceptual Framework 373

Charles Denis and Laurent Karsenty

The help of many people made this book possible, and we are grateful to all of them Wethank our editor Birgit Gruber, at John Wiley & Sons Ltd., who guided us throughoutthis project

Daniel Engelberg and Jonathan Benn were indispensable for the editing process, and

we thank them for their help in editing various chapters Daniel Sinnig patiently helpedwith revising various chapters Rozita Naghshin, our digital art expert, was a great source

of help for advice on image layout and creation To all the members of the HCSE Centered Software Engineering) Group, we thank you for participating in the discussionand brainstorming of this project

(Human-We thank FCAR (Le Fonds qu´eb´ecois de la recherche sur la nature et les technologies),NSERC (National Sciences and Engineering Council of Canada), and the Faculty ofEngineering, Concordia Research Chair programs, for their financial support

We are grateful to all the reviewers of this book We were lucky enough to have awide spectrum of international reviewers, who patiently reviewed all chapters and gave

us crucial feedback We thank John Grundy from the University of Auckland, who gave

us sound advice and feedback for a number of chapters

Above all, we thank the contributors of this book Without them, this book would nothave been possible We thank them for patiently modifying chapters, rewriting passages,and putting up with our requests We acknowledge all of them for their efforts in makingthis book a success

Ahmed Seffah Homa Javahery

About the Editors

Ahmed Seffah is a professor in the department of Computer Science at Concordia

Uni-versity He is director of the Human-Centered Software Engineering Group and theco-founder of the Concordia Software Usability and Empirical Studies Lab He holds

a PhD in software engineering from the Ecole Centrale de Lyon (France) His researchinterests are at the crossroads between software engineering and Human-Computer Inter-action (HCI), including usability measurement, user interface design, empirical studies

on developer experiences with CASE tools, human-centered software engineering, andpatterns as a vehicle for integrating HCI knowledge in software engineering practices

Dr Seffah is the vice-chair of the IFIP working group on user-centered design ologies During the last 10 years, he has been involved in different projects in NorthAmerica and Europe

method-Homa Javahery is a researcher and project manager with the Human-Centered

Soft-ware Engineering Group, including the Usability and Empirical Studies Lab, in thedepartment of Computer Science at Concordia University She holds a Master’s degree

in Computer Science from Concordia University, and a Bachelor of Science degree fromMcGill University She is combining different design approaches from human sciencesand engineering disciplines to develop a pattern-oriented framework for designing a largevariety of interfaces She has been involved in different collaborative projects at theINRIA Research Institute in Nancy, France and the Daimler-Chrysler Research Institute

in Ulm, Germany

didier.chincholle@era.ericsson.se+46 8 585 303 76

Jo¨elle Coutaz

IIHM Group, CLIPS-IMAG Lab

BP 53, 385 rue de la Bibliotheque

38041 Grenoble Cedex 9France

Joelle.Coutaz@imag.fr+33 4 76 51 48 54

Charles Denis

INTUILABPrologue 1, La Pyr´en´eenne,

BP 27/01, 31312 Lab`ege CedexFrance

denis@intuilab.com

Anind K Dey

Senior Researcher, Intel Research

2150 Shattuck Ave, Suite 1300Berkeley, CA 94704

USAanind@intel-research.net+1-510-495-3012

CEO – RedWhale Software

277 Town & Country Village Palo Alto

CGI Group Inc

1130 Sherbrooke West, 7th floor

Montreal, Quebec H3A 2M8

Mir Farooq Ali

Virginia Technology Institute

Department of Computer Science (0106)

660 McBryde HallBlacksburg, VA 24061USA

mfali@cs.vt.edu1(540) 231 1927

Peter Forbrig

University of RostockDepartment of Computer ScienceAlbert-Einstein-Str 21

D-18051 RostockGermany

pforbrig@informatik.uni-rostock.de

Elizabeth Furtado

Universidade de FortalezaNATI – C´elula EADWashington Soares, 1321Bairo Edson QueirozFortaleza (Cear´a), BR-60455770Brazil

elizabet@unifor.br

Jo˜ao Jos´e Vasco Furtado

Universidade de FortalezaNATI – C´elula EADWashington Soares, 1321Bairo Edson QueirozFortaleza (Cear´a), BR-60455770Brazil

John Grundy

University of AucklandDepartment of Computer SciencePrivate Bag 92019

Auckland

Universit´e catholique de Louvain (UCL)

Information System Unit (ISYS-BCHI)

Institut d’Administration et de Gestion

Joanna McGrenere

University of British ColumbiaDepartment of Computer Science201–2366 Main Mall

Vancouver, BC V6J 2E2Canada

joanna@cs.ubc.ca604-827-5201

Andreas M ¨uller

University of RostockDepartment of Computer ScienceAlbert-Einstein-Str 21

D-18051 RostockGermany

Xray@informatik.uni-rostock.de

Gustav ¨ Oquist

Bollhusgr¨and 7

113 31 StockholmSweden

gustav@stp.ling.uu.se+46 8 739 417 783

Alexandros Paramythis

Foundation for Research andTechnology – HellasInstitute of Computer ScienceScience and Technology Park of CreteHeraklion, Crete

GR – 71110 Greececs@ics.forth.gr+30-810-391741

Fabio Patern`o

ISTI-CNRVia G Moruzzi 1

56100 PisaItalyfabio.paterno@cnuce.cnr.it+39 050 3153066

xxii CONTRIBUTORS

Manuel P´erez-Qui ˜nones

Virginia Technology Institute

Department of Computer Science (0106)

CEO – RedWhale Software

277 Town & Country Village Palo Alto

Foundation for Research

and Technology – Hellas

Institute of Computer Science

Science and Technology Park of Crete

wilker@unifor.br

Daniel Sinnig

Concordia UniversityDepartment of Computer ScienceFaculty of Engineering

and Computer Science

1455 de Maisonneuve Blvd WestMontreal, Quebec H3G 1M8Canada

+1 514-848-3024

Constantine Stephanidis

Foundation for Researchand Technology – HellasInstitute of Computer ScienceScience and Technology Park ofCrete

Heraklion, Crete, GR – 71110Greece

cs@ics.forth.gr+30-810-391741

Leandro da Silva Taddeo

Universidade de FortalezaNATI – C´elula EADWashington Soares, 1321Bairo Edson QueirozFortaleza (Cear´a), BR-60455770Brazil

taddeo@unifor.br

Daniel William Tavares Rodrigues

Universidade de FortalezaNATI – C´elula EADWashington Soares, 1321Bairo Edson QueirozFortaleza (Cear´a), BR-60455770

Universit´e catholique de Louvain (UCL)

Information System Unit (ISYS-BCHI)

Vasilios Zarikas

Foundation for Researchand Technology – HellasInstitute of Computer ScienceScience and Technology Park of CreteHeraklion, Crete, GR – 71110

Greececs@ics.forth.gr+30-810-391741

Wenjing Zou

University of AucklandDepartment of Computer SciencePrivate Bag 92019

AucklandNew Zealandwenjingzou@hotmail.com+64-9-3737-599 ext 8761

Part I

Basic Terminology, Concepts,

and Challenges

Executive Summary and Book

Overview

Ahmed Seffah and Homa Javahery

Human-Centered Software Engineering Group, Department of Computer Science,

Concordia University, Canada

1.1 MOTIVATION

In recent years, a wide variety of computer devices including mobile telephones, personaldigital assistants (PDAs) and pocket PCs has emerged Many existing devices are nowbeing introduced as an alternative to traditional computers Internet-enabled television(WebTV), 3D-interactive platforms with voice capabilities, and electronic whiteboardsattached to desktop machines are among the many examples In addition, we are movingaway from the dominance of the WIMP (Windows, Icons, Mouse, and Pointer) system as

a main metaphor of human-computer interaction Novel interaction styles are emerging.These include web applications where users interact with the content, interactive televisioncontrolled by hand-held remotes, and PDAs with small screens and styli for gesture-basedinteraction

All these variations in devices and interaction styles require changes in design, opment and testing frameworks This book aims to introduce the reader to the currentresearch trends and innovative frameworks being developed to address these changes

devel-Multiple User Interfaces. Edited by A Seffah and H Javahery

 2004 John Wiley & Sons, Ltd ISBN: 0-470-85444-8