Archive for the ‘Usability’ Category

Academic Papers Blog expert-review information-architecture information design iphone maps Projects readability site-navigation task-analysis usability testing user-task-analysis user experience design user interface design video Writing

Notes: Why are online catalogs still hard to use?

Wednesday, June 22nd, 2005

Borgman, C.L. (1996). Why are online catalogs still hard to use? Journal of the American Society for Information Science, 47 (7): 493-503. 

In this 1996 study, Borgman revisits a 1986 study of online library catalogs. In the original study, computer interfaces and online catalogs were still fairly new—the study looked at how the design of traditional card catalogs could inform the design of new online catalogs. By the time of this study online catalogs were common but still not easy to use. Three kinds of knowledge were seen as necessary for online catalog searching: conceptual knowledge about the information retrieval process in general, semantic knowledge of how to query the particular system, and technical knowledge including basic computer skills. Semantic knowledge and technical knowledge differ here in the same way as semantic and syntactic knowledge in computer science. The study also covers specific concepts like action, access points, search terms, boolean logic, and file organization. In the short term, Borgman recommends training and help facilities to help users gain the skills they need to use current systems. In the long run, though, libraries must employ the findings of information-seeking process research if they are ever going to create usable interfaces.

The study does point out a number of reasons why online catalogs are difficult for users, whether it’s because they lack computer skills or semantic knowledge. One good example is from a common type of query language. Even if the user knows that “FI” means “find” and “AU” means author, they may not know whether to use “FI AU ROBERT M. HAYES,” “FI AU R M HAYES,” “FI AU HAYES, ROBERT M,” etc., and how the results will differ. Unfortunately the article lacks clear instructions or examples of how to make the systems better. The conclusion that different types of training materials could be helpful seems to me like a bandage rather than a cure.

I think a lot of the criticisms are still true, but that modern cataloging and searching systems have become easier. I’m not so sure it’s because catalog designers have started applying information-seeking research in their interfaces, though. It almost seems like library systems are being made easier in self-defense. Users are getting more and more used to a Google or Yahoo type interface—a simple search box that looks at full text and uses advanced algorithms to find relevant results. I think part of this is due to the fact that people in the library field have experience with complicated, powerful structure search systems and are used to a lot of manual encoding of records. Web developers, lacking this background, have been more free to think in terms of searching massive amounts of unstructured data and automating the collection and indexing process. I also think that simple things such as showing the results, including summaries of each item, in a scrollable, clickable list, have helped a great deal to support the information seeking process. Things like search history and “back” and “forward” buttons, “search within these results,” automatic spell checking, etc. are becoming pretty standard as well.

Usability test of the Kent State IAKM home page

Thursday, December 11th, 2003

Note: this report shows the results of a usability test of the Information Architecture and Knowledge Management program web site at Kent State University in 2003. The site has since been redesigned.

1. Introduction

In usability study of the IAKM web site I found a number of serious problems. Current IAKM students were asked to complete a series of tasks using the site. Although participants were able to complete the tasks 91.67 percent of the time, they met all performance goals for each task only 36.11 percent of the time. The site is not fundamentally broken, but clearly there is room for improvement. Through statistical analysis, observations of the students, and remarks made by the students a number of issues were uncovered.

Many of the problems were global problems with site navigation and labeling, but there were also a number of prominent local problems. The severity of problems were rated via three categories:

  • Severe—prevents the user from completing a task or results in catastrophic loss of data or time.
  • Moderate—significantly hinders task completion but users can find a work-around.
  • Minor—irritating to the user but does not significantly hinder task completion. (Artim, 1).

Problems are also rated by scope. Any problem can be either global, meaning it applies to most pages or the site as a whole, or local, meaning it is particular to a page or specific section. Global problems are generally more pressing than local ones.

Findings are presented first in order of importance, followed by a description of the study methods.

  (more…)

Information visualizations and spatial maps on the web – Usability concerns

Thursday, October 23rd, 2003

Visualizing the web

Although web technologies are constantly changing, most users still browse the web the same way they did back in 1995–typing keywords into search boxes, clicking from home page, to section, to subsection on a navigation bar, or following link, to link, to link. The fact that it is called a “web” suggests that there should be other ways of navigating websites, and there are a number of projects attempting to employ information visualizations and spatial maps to do so.

All web pages organize information visually, but “information visualization centers around helping people explore or explain data that is not inherently spatial, such as that from the domains of bioinformatics, data mining and databases, finance and commerce, telecommunications and networking, information retrieval from large text corpora, software, and computer-supported cooperative work.” (“InfoVis 2003 Symposium”) Spatial metaphors are used to communicate different levels of information. A simple, static example would be a personal homepage built to look like the designers home, with links to favorite movies in the living room and recipes in the kitchen. A more advanced example would be a customer relationship management system for a large company which instead of presenting a list of technical support problems and solutions, displays an interactive map of problems, with more common problems in a larger font size, and recent problems in red. In both cases, users get an immediate grasp of complex information.

Such visualizations are intended to help solve two current web usability problems: the lack of a wide view to web structure, and the lack of query refinement based on relationships of retrieved pages (Ohwada 548). But they must do so without creating additional usability barriers. This paper will describe three current information visualization projects and describe some of the usability issues these sorts of projects face.

(more…)

Usability Review of My Lycos

Wednesday, October 15th, 2003

Note: this usability review as done as part of my graduate coursework at Kent State University.

Usability

My Lycos is a substantial player in the portal/personal site market. The site is owned by Terra Lycos, which is currently seventh on the list of parent sites with the most visits (Nielsen//NetRatings, 1). The site offers a wide range of services, tools, and options, and allows users to log into accounts with other Terra Lycos sites like Tripod and Quote.com (My Lycos, 1). A previous paper (Newton, 1) examined the site and analyzed some user tasks. This paper will also re-analyze the tasks in the original paper, and take a second look at the site, through four usability guidelines from the textbook (Dumas, 56) and five from a popular usability site (Nielsen, 1).

1. Giving the user control

The original paper and a cursory examination of My Lycos show plenty of opportunity for users to take control. Users have 35 possible content boxes to choose from in eight categories. Some boxes can be further customized—the News box, for example, gives users the ability to pick up to 13 different types of news, rank them, and pick out local news sources. The main user control problem is the lack of a central place to change all settings or an easy walk through of the options available. It is likely many users miss that they can customize news, because the only indication is a small edit tag in the news box itself.

 

  (more…)

Usability Review of My.Go2Net.com

Wednesday, October 8th, 2003

Note: this usability review as done as part of my graduate coursework at Kent State University.

Usability Review of My.Go2Net.com

There is bound to be argument over what the primary, or first rule of usability is. But before any other rules or guidelines, a site must first satisfy the “zeroith” rule of usability: users must be able to get to the site. Go2Net fails this test because my.go2net.com is completely unavailable (Go2Net, 1). This is a problem first because competing sites already follow the my.[sitename].com URL convention (Welcome, 1). Worse, at one point my.go2net.com was a valid domain and had some amount of user recognition (Nasser, 1). This is especially bad for prospective portal sites, where the intention is that users will use the site as a launching point for the rest of the web. Anyone that had set their homepage to my.go2net.com has had to either update their homepage setting in their browser or pick a different site altogether. Portals need to seem stable and established–making major changes to a site’s navigation might counter that impression, but changing domain names around is even worse. Also, many users will only find Go2Net through links on other sites and pages. Although a Google search of sites linking to my.go2net.com comes up empty today (link:my.go2net.com, 1), Go2Net may have lost out on traffic from older links that have since been removed.

Additional usability rules are easy to find, but there is no authoritative list. This paper will consider four guidelines from the textbook (Dumas, 56) and five from a popular usability site (Nielsen, 1).

 (more…)

Usability Study: Kent State School of Library Science Website

Wednesday, September 17th, 2003

Kent State University School of Library Science Web Site

Site Design

The most basic level of usability is accessibility. Although it is beyond the scope of this analysis to consider problems that disabled users may have, it is useful to look at the site through the eyes of the Javascript-disabled or the DSL-disabled, those who do not have the latest, most up-to-date browsers with all the options turned on. One thing in the KSU SLIS site’s favor is the lack of any necessary plugins, like Flash or QuickTime VR, which some users might not have installed. The home page and the site’s navigation bar do use Javascript, which some users may have turned off, but disabling Javascript does not completely break the site’s navigation. It does, however, mean the users only have access to the first level of the navigation hierarchy from the homepage, which might make it a little more difficult to figure out which section is the appropriate one to go to.

On the plus side, the site is fairly slow-connection friendly. The entire homepage, including the Javascript rollover images, is only about 163K. The site makes appropriate use of alt tags for images, so anyone using a text-only browser like Lynx or surfing with images off will still be able to get around. Again, they will miss the descriptive second-tier categories for each section. The site is fully navigable in a full-text browser, but there are two problems: first, the homepage has no descriptive text, and second, there’s not always a link back to the homepage, probably because the image that links back has not alt text on most pages.

  (more…)