• Heuristic Evaluation
• Cognitive Walkthrough
• HTA (Hierarchical Task Analysis)
• Competitive Analysis

• Card Sorting
• Discount Usability

(Tested 2 different prototypes)

• Lab-Based Testing

• Visibility, Consistency, Navigation (difficult to return to site (hard to tell when you have left)
• Language & jargon
• Distracting Graphics
• Inconsistent Layout
• Clarity of Top Bar
• Mouse-overs not clear with selection action

• 6 categories for groupings
• Users tended to focus on left side of page
• Users preferred aesthetics of Prototype 1
• Users preferred performance of Prototype 2

• Layout was moderately user friendly
• Navigation bar was well received
• Some link terms not well understood

• Black Background vs Blue Background
• Warrior Icon (used in other UW sites)
• Reorganized main groupings

• Created a left/right margin for novice and experts (?)
• Black background with warrior animation
• Included a "search" on the main page

• Added a "How Do I?" section
• Changed some link names (eg. Staff/Admin to "Contact Library Staff")
• Used Arial font for text
• Yellow for text links

• Heuristic Evaluation (Nielsen)

• Design Walkthroughs (members of group)
• HTA
• Competitive Analysis

• U of Arizona
• U of Washington
• U of Pennsylvania
• NCSU
• Dalhousie

• Card Sorting
• Discount Usability

• Keystroke Level Analysis (KLA)
• Lab-Based Usability Testing
  • Timed trials
  • Subjective rating

• Accessibility / Visibility (text version)

• Semantics - ambiguity (language and jargon)

• Navigation - backtrack

• Functionality (poor feedback)
• Inconsistent Layout
• Aesthetics - cluttered
• On-line Help - need for tutorials

• Need to revise and regroup headings

• Online reference tool menu confusing
• Word "subject" confusing; suggest "faculty" instead
• Word "resources" confusing; suggest "services" instead
• Need for "connect from home" link
• Need to better define navigation bar and highlight
• Expectation for mouse rollovers

• Minimize graphics

• Include top navigation bar
• Include "Quick Search"
• Revise headings:
  • Books and Journals
  • Patron Info
  • About the Library
  • Services for
  • Library Forms
  • Local Sites

• Included UW logo
• Text version to right
• Define navigation buttons
• Site index
• Weekly specials
• Further revised headings and feedback
• Books, Journals, Databases
• Other Libraries
• My Info
• Library and Community Info
• Online Reference Tools
• Resources for UW people

• Added library pictures
• Better definition of links on navigation bar
• Side left (search/ highlight text, library forms)
• Headings as follows:
• Books, Journals, Databases
• Other Libraries
• My Account Info
• Library and Community Info
• Research Tools
• Services for UW people

• Heuristic Evaluation (Nielsen, Norman)
• Design Walkthrough
• HTA
• Competitive Analysis
  • Dalhousie

• Card Sorting
• Discount Usability

• KLA
• Lab-Based Usability Testing

• Problems with feedback from mouse-overs
• Ambiguous terminology, e.g. "Trellis", "Find It", "Get It" (Language & jargon)
• Inconsistent use of "/" and "&"
• Number of steps to "Patron info"
• Need for clean/clear pages (Inconsistent Layout)
• Need for search tool on main page
• Need for "Quick Link"
• Need for "How to Find" help

• Need to revise main headings

• Top navigation bar not well used
• Tags when mousing-over links should be included

Left Side

• Search section / How to Find

Middle - UW shield graphic with headings

• Find Books, Journals, Data
• Search for Journal Articles
• About the Library
• Services for Faculty and Students
• Internet Resources

Right Top

• Library Forms
• Text version

Bottom

• Main navigation bar

Left Side

• Quick Search
• Library Forms
• How do I.?
• Quick Links

Centre and Right - UW shield with headings:

• Find Books, Journals, Data

• Reference shelf
• Services For.
• About the Library
• Help

Bottom

• Main navigation bar

• Same as Phase Two

• Highlighted navigation bar

• Heuristic Evaluation (Nielsen)
• Cognitive Walkthrough
• HTA
• Competitive Analysis

• Card Sorting
• Design Walkthrough

• KLA
• Lab-Based Usability Testing

• Confusing terms and classification of sub-links (Language & jargon)
• Need for a search function
• Need for more clearly defined navigation bar
• Lack of appropriate feedback upon mouse-over of sub-headings. Mouse-overs not clear with selection action

• User testing confirmed earlier concerns
• Influenced order of categories

• Issues of using red as highlight for colour-blind
• Need more representative image of libraries

• Removed graphic
• Included dedicated search function
• Left side navigation bar, Quick links; headings:
  • What's New
  • Find it
  • Get it
  • About the Library
  • Services for
  • Local sites
  • Today's News
  • Check e-mail
  • Help

• included DC graphic
• added UW shield watermark
• top navigation bar
• headings:
  • Search UW Resources
  • Other Libraries
  • Library Information
  • Services
  • What's New
  • Outside Links
  • Help

• Menu option for pop-up box
• Add a search function
• Add frequently used links to navigation bar
• Include related sub-headings

• Heuristic Evaluation
• Design Walkthrough
• HTA
• Competitive Analysis

• Card Sorting
• Discount Usability

• KLA
• Lab-Based Usability Testing

• Interface lacks consistency
• Need to memorize content of main links
• Many redundant paths to find info
• Inconsistent layout and use of menu types
• Click & show --> extra steps
• Graphic distractions

• Users commented on lack of graphics
• Size of font not consistent for links

• Users weren't familiar with services that they were looking for in tests (slowed trials)
• Some link names not intuitive

• Text-based version only
• Headings:
  • About the Library
  • Services
  • Course Information
  • Renewals
  • View Patron Information
  • Electronic Resources
  • Borrowing Materials
  • Library Forms

• Icons to replace headings
• Headings:
  • Electronic resources
  • About the library
  • Borrowing Materials
  • Course Information
  • View Patron information
  • Help
  • Library Forms
  • What's New
• Quick search at top, UW catalogue Trellis

Did not make further recommendations

• Heuristic Evaluation
• Design Walkthrough
• HTA
• Competitive Analysis

• Card Sorting
• HTA
• Discount Usability
  • (Tested 2 different prototypes)

• KLA
• Lab-Based Usability Testing

• Use of icons recommended
• Language unclear (e.g. "Find it", "Get it" confusion; explain terms like TRELLIS, TUG; link titles should match page linked to). Language & jargon
• Mouse-overs not clear with selection action
• Colour change (red to blue) with mouse-overs confusing (recommend blue turn red) Visibility, Consistency
• Menu options should change colour with mouse-over
• Help is not helpful, recommend help/search tool
• Background graphic distracting, obscures "text version" link

• Icons and wording changes were useful
• Eliminating mouse-overs added another layer of navigation
• Need top navigation bar consistent across all pages
• Forms unfamiliar
• Site search tool used frequently and appropriately
• Functions easier to locate
• Fewer errors with interpretation of link names
• Reorganized menu items
• Prototype 2 superior

• Problems with wording and location of menu options (e.g. electronic dictionaries)
• Aesthetics need improvement

• Search available on main page
• Phrasing of the main menu changed and number of options reduced
• Mouse-overs replaced with description of links

• Use frames to maintain consistency in top navigation bar
• Used new wording and grouping
• Include forms dropdown menu and link to text version
• Include search on main page

• Include two small pictures of libraries on home page
• Add watermark of UW coat of arms
• Change colour used when item selected to something more subtle
• Wording altered and some reorganization required
• Change order of menu items
• Investigate icons
• Use consistent layout and phrasing on secondary pages

Team Number

Tasks performed

Current

1

2

3

4

5

6

1. Where would you go to find general help with a research topic in your department?

14 s

25 s

25 s

38 s

22 s

32 s

41 s

10 s

15 s

17 s

38 s

6 s

10 s

13 s

6 s

30 s

31 s

7 s

13 s

75 s

15 s

18 s

5 s

10 s

10 s

15 s

12 s

6 s

22 s

5 s

10 s

45 s

16 s

23 s

12 s

49 s

40 s

19 s

10 s

16 s

31 s

35 s

8 s

8 s

7 s

10 s

7 s

45 s

27 s

19 s

23 s

42 s

8 s

6 s

11 s

16 s

10 s

8 s

12 s

7 s

33 s

5 s

16 s

18 s

24 s

27 s

45 s

11 s

20 s

31 s

Team Number

Current

1

2

3

4

5

6

Key Words

3/5

(60%)

7/10 (70%)

4/7 (57%)

8/9 (89%)

9/11

(82%)

8/9 (89%)

5/10

(50%)

Major Links

2/5

(40%)

8/10

(80%)

4/13

(31%)

9/9

(100%)

10/11

(91%)

8/9

(89%)

7/10

(70%)

Graphics

3/5

(60%)

6/10

(60%)

11/13

(85%)

7/9

(78%)

7/11

(64%)

3/9

(33%)

3/10

(30%)

Navigation Bars

3/5

(60%)

8/10

(80%)

8/13

(62%)

7/9

(78%)

5/11*

(46%)

1/9*

(11%)

6/10*

(60%)

Overall layout

3/5

(60%)

8/10

(80%)

10/13

(77%)

9/9

(100%)

9/11

(82%)

2/9

(22%)

6/10

(60%)