IS 214 : Needs and Usability Assessment

Administrivia

Teaching Team 

214 Team

Instructor Kevin McBride

Email: kmcbrid@us.ibm.com

Office number: (408) 463-2002

Office Hours: Monday 1:00pm-4:00pm TBD, South Hall

TA Jen King

Instructor Alice Chiang

Course Description

Link to course description

This course will teach you to use a variety of methods to evaluate and improve the usability of a software user interface. Both user interface and usability will be defined very broadly in the course. A user interface is any part of a system that a user interacts with, including functionality. Usability means both the ease with which users complete tasks, but also their satisfaction with the process.


The methods in this course start with analyzing users, their tasks, and the context of their work. You will learn to use surveys, focus groups, and prototypes to evaluate early designs, and to use traditional user testing, expert inspections, and guidelines to refine designs.


Finally, the course will discuss how to introduce and promote these methods in an organization. This course is appropriate for both 1st and 2nd-year MIMS students, and for students from other departments with a strong interest in user-based design and assessment, with the instructor's permission.Students will complete a major project related to needs assessment and evaluation. Second-year SIMS students may use this project to meet their final project requirement.

Course Information

Needs and Usability Assessment INFOSYS 214

Course Dates: August 29 to December 5, 2005

Lecture Schedule: Monday 1:00pm-4:00pm in 110 South Hall

Units: 3

Grading Option: Letter Grade or Satisfactory/Unsatisfactory or Pass/Not Pass

Course Texts

Required

Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, Jeffrey Rubin. Wiley, 1994. ISBN: 0471594032

This book will not be needed until the second half of the course.

Reader

Available at Course Website

Most course readings will be available on the course website and are password protected. Passwords will be sent out to the class list.

Grading Criteria

30% Class Participation

30% Interim Assignments

40% Final Project Report

Course Work

August 29 : Monday

Course Overview / Simple Usability / User-Centered Design 

Required Readings

IBM Ease of Use – User Engineering [Online]

Schneiderman Ch.3 Usability Development Process [Online]

Optional Readings

Kelly Goto and Emily Cotler, Web ReDesign 2.0, Berkeley; New Riders, 2005 [Online]

Resources

Final Projects assigned 

Due on December 12

Assignment details

September 12 : Monday

What is Usability / Overview of Usability Methods 

Required Readings

Schneiderman Ch.1 Usability Introduction Sections 1.1-1.4 [Online]

What is Usability? At UPA (follow the related links) [Online]

Usability basics from usability.gov [Online]

Interactive Methods Table [Online]

Usability Methods Toolbox [Online]

Jakob Neilsen - Introduction to Usability [Online]

Resources

Project Definition / Business Opportunity assigned 

Due on September 26

Assignment details

September 19 : Monday

Business Problem / Scenarios 

Explore the following sites to complete the Choosing Methods Scenarios exercise handed out in class:
Interactive Methods Table
Usability Methods Toolbox
Be prepared to discuss your answers.

Required Readings

IBM Ease of Use - Value [Online]

IBM Ease of Use - Business Opportunity Phase [Online]

Information and Design - Scenarios [Online]

Alan Cooper, The Inmates Are Running the Asylum - Ch. 11, Designing for People [Online]

Resources

Usability Methods Plan assigned 

Due on October 3

Assignment details

September 26 : Monday

User Analysis and Recruiting 

Required Readings

JoAnn T. Hackos and Janice C.Redish. User and Task Analysis for Interface Design, New York: Wiley, c1998. Chapter One: Introduction to User and Task Analysis for Interface Design [Online]

Hackos and Redish, Chapter Two: Thinking About Users [Online]

Ethical Principles of Psychologists and Code of Conduct 2002 - see especially sections on Privacy and Confidentiality [Online]

STC usability SIG on ethics [Online]

UC Berkeley Committee for the Protection of Human Subjects [Online]

Resources

Project Definition / Business Opportunity due 

October 3 : Monday

Task Analysis / Scenarios 

Required Readings

Hackos and Redish, Chapter Three: Thinking About Tasks [Online]

Hackos and Redish, Chapter Four: Thinking About The Users' Environment [Online]

Blomberg, J., Burrell, M., Guest, G. An Ethnographic Approach to Design. In Jacko J. A., Sears A. (eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Inc.: Mahwah, New Jersey, 2003. [Online]

Resources

Usability Methods Plan due 

Target User, Task, Scenarios assigned 

Due on October 17

Assignment details

October 10 : Monday

Surveys / Focus Groups / Interviews 

Required Readings

Mike Kuniavsky, Observing the User Experience: A Practitioner's Guide to User Research, San Francisco, Morgan-Kaufman, 2003. Chapter Eleven: Surveys [Online]

Nielsen on web surveys -- "Collecting Feedback from Users of an Archive." [Online]

Shneiderman, Section 4.4 [Online]

Dillman,Don A. (2000) Mail and Internet Surveys: the Tailored Design Method, 2nd ed. Wiley. Chapters 2, 3, and 5. (The rest of the book is recommended.) [Online]

Web-based surveys: Dillman, Don, and Dennis K. Bokwer. The web questionnaire challenge to survey methodologists. [Online]

Survey resources from UsabilityNet.org [Online]

David L. Morgan, Focus Groups as Qualitative Research, Sage, 1988; pp. 53-71, Conducting and Analyzing Focus Groups. [Online]

Krueger, Richard A., Focus Groups, 2nd ed. Sage, 1994; "Asking questions in a focus group." pp. 53-69 [Online]

Nielsen, Jakob (1997) The Use and Misuse of Focus Groups [Online]

Nielsen, Jakob (1999) Voodoo Usability [Online]

Robert S. Weiss, Learning from Strangers - The Art and Method of Qualitative Interview Studies, New York: The Free Press, 1994. Chapter 3 - Preparation for Interviewing [Online]

Weiss, Chapter 4 - Interviewing: Part 1 [Online]

Weiss, Chapter 4 - Interviewing - Part 2: Examples of Interviewing [Online]

Weiss, Chapter 5 - Issues in Interviewing [Online]

Resources

October 17 : Monday

Contextual Inquiry and Design 

Guest Lecturer: Suzanne Ginsburg of Yahoo!

Required Readings

Contextual Design: Defining Customer-Centered Systems. Hugh Beyer and Karen Holtzblatt. Morgan Kaufmann Publishers, Inc. San Francisco: 1998. Ch. 3 [Online]

Contextual Design: Ch. 6 [Online]

Resources

Target User, Task, Scenarios due 

Early Design Exploration / Competitive Evaluation assigned 

Due on October 31

Assignment details

October 24 : Monday

Design Exploration / Competitive Evaluation 

Required Readings

"Exploratory Test," p.21-22, 31-37, 42-44 of Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests [Textbook]

Resources

October 31 : Monday

Inspections / Heuristic Evaluation 

This week a selection of readings for different methods are included. Choose the ones that are of most interest to your project.

Required Readings

Nielsen and Mack, "Usability Inspection Methods," p.170-181 in Baecker, Ronald M. et al ed., Human-Computer Interaction: Toward the Year 2000, 1995, Morgan Kaufman [Online]

Nielsen's 10 Usability Heuristics [Online]

Nielsen, Jakob, "Test Your Competition" [Online]

Optional Readings

Inspection Methods: Nielsen and Mack, Usability Inspection Methods, Wiley and Sons, 1994, Chapter 12, "Observing, Predicting, and Analyzing Usability Problems," p.295-339 [Online]

Inspection Methods: Nielsen and Mack, Usability Inspection Methods, Wiley and Sons, 1994, Chapter 5, "The Cognitive Walkthrough Method: A Practitioner's Guide." p.105-140 [Online]

Design Exploration: Hakim, Jack, and Spitzer, Tom, "Prototyping for Usability" Usability Professionals Association Conference Proceedings 2000. [Online]

Design Exploration: User Inteface Engineering Paper, "Using Paper Prototypes to Manage Risk." [Online]

Competitive Evaluation: Li, Jin, "Goal-Directed Competitive Analysis: Evaluating the User Interface in the Real World," Usability Professionals Association Conference Proceedings 2000. [Online]

Competitive Evaluation: Jakob Neilsen "Competitive Testing of Website Usability" [Online]

Heuristic Evaluation: Instone on Site Usability Evaluation [Online]

Heuristic Evaluation: Instone on Site Usability Heuristics for the Web [Online]

Heuristic Evaluation: Tognazini, First Principles [Online]

Resources

Early Design Exploration / Competitive Evaluation due 

Inspection / Heuristic Evaluation assigned 

Due on November 7

Assignment details

November 7 : Monday

Usability Testing - Planning and Conducting 

Required Readings

pgs.25-46, 67-73, 83-95, 179-182, 214-224. of Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests [Textbook]

Resources

Inspection / Heuristic Evaluation due 

User Testing assigned 

Due on November 28

Assignment details

November 14 : Monday

Usability Testing - Analyzing and Reporting 

Guest Lecturer: Peter Merholz of Director of Practice Development, Adaptive Path

Required Readings

Chapter 10, "Transforming Data into Findings and Recommendations" of Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests [Textbook]

Resources

November 21 : Monday

Tools / Guidelines / Accessibility 

Optional Readings

W3C Accessibility Initiative: Introduction to web accessibility [Online]

W3C Accessibility Initiative: Introduction to involving disabled users in evaluations [Online]

W3C Accessibility Initiative: Quick tips for improving accessibility [Online]

Neilsen on International Usability Testing [Online]

Resources

November 28 : Monday

Managing Usability in an Organization 

Required Readings

Chapter 11, "Establishing A Usability Program: Strategies and Tactics" of Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests [Textbook]

Optional Readings

Usability Professionals Association Code of Conduct [Online]

Resources

User Testing due 

Guidelines Evaulation assigned 

Due on December 5

Assignment details

December 5 : Monday

Discuss Final Papers 

Guidelines Evaulation due 

December 12 :

Final Papers Due - No Class 

Final Projects due 

last updated on 2005-11-27 by Jen King