Benchmarking Public Library Web Sites



Benchmarking Public Library web sites for accessibility and usability

T he sample used in the following surveys comprises Public Library Web sites nominated for the EARL "Best on the Web Award" of 1999.

The following surveys were undertaken between January - February 2002. Two of the surveys focus specifically on how accessible the entry level web pages are for disabled people. The remaining three surveys test for more general usability.


Domain Names

The domain names of the Public Library Web sites are summarised below.

No. Name URL Comment
1 Anglesey http://www.ynysmon.gov.uk/english/library/index.htm

use of .gov.uk

bi-lingual site

2 Birmingham

http://www.birmingham.gov.uk/epislive/libpages.nsf/437194deb

01c293b802564d60047624b/57f79d64d1e6177880256609002b5239?

OpenDocument

long url - due to CMS
3 Calderdale http://www.calderdale.gov.uk/libraries/libraries.html  
4 East Sussex http://www.eastsussexcc.gov.uk/lia/main.htm  
5 Essex http://www.essexcc.gov.uk/libraries/  
6 Islington http://www.islington.gov.uk/learning/librarylist.asp?sectionid=26  
7 Kingston http://www.kingston.gov.uk/Enjoying/Libraries/default.htm  
8 Knowsley http://www.knowsley.gov.uk/leisure/libraries/  
9 Leeds http://www.leeds.gov.uk/library/library.html/  
10 Monmouthshire http://www.monmouthshire.gov.uk/leisure/libraries/  
11 NE Lincs http://www.nelincs.gov.uk/ic/living/library/content.htm/  
12 North Lincs http://www.btwebworld.com/northlincs/library/index.htm/  
13 Nottingham

http://www.nottinghamcity.gov.uk/coun/department/leisure_com/libraries/

default.asp

authority + dept + underscore
14 Southampton http://www.southampton.gov.uk/education/libraries/main.htm/  
15 Suffolk http://www.suffolkcc.gov.uk/libraries_and_heritage/ underscore used
16 Wakefield http://www.wakefield.gov.uk/community/libraries/home.htm  

Summary

Discussion

Many of the sites have long unmemorable URLs as entry points. This is not very desirable in terms of branding, ease of indexing, etc. Top level domains are consistent - majority of library authorities use .gov.uk.

404 Error Page

A summary of the 404 error pages provided by the Public Library web sites is given below.

Name error generating URL error message generated
Anglesey go standard 404 message
Birmingham

go

branded message + instructions and links to home page/index etc
Calderdale go branded 404 message + links to services
East Sussex go standard 404 message
Essex go standard 404 message
Islington go standard 404 message
Kingston go branded message + links + explanatory notes + contact details
Knowsley go branded message + links
Leeds go standard 404 message
Monmouthshire go standard 404 message
NE Lincs go standard 404 message
North Lincs go standard 404 message
Nottingham go branded message + explanatory notes + links to home page + contact details
Southampton go standard 404 message
Suffolk go branded message + links + search facility
Wakefield go standard 404 message

Accessibility:

The following tools were used to check the sites for their accessibility to disabled people e.g. visually impaired people.

WAVE analysis

Pennsylvannia's initiative on Assistive Technology (PIAT) has produced the 'WAVE' to check if your page is accessible to people with disabilities. WAVE uses some of the techniques described in "Techniques for Web Accessibility Evaluation and Repair Tools" - work done by the Evaluation and Repair group of the W3C Web Accessibility Initiative (WAI)

WAVE: uses icons and there is a tutorial which you might want to print out. The analysis for each site checked is also easier to interpret if printed. Key checks include: a check for the reading order of tables (to enable screen readers to read document) and an 'Alt-text' check for images and icons.

Bobby

Name
WAVE analysis

 

Bobby check

 

Comments
Anglesey 17 x missing alt text: page fails

1x Priority 1error (A) (frames with no titles)

3 x priority 1 (U)

page fails to meet Bobby AAA approved status

15 x no alt text used in frame + 2 missing alt text in page header
Birmingham 4 x missing alt text: page fails

4 'possible' Priority 1 errors: perform manual check

page fails to meet Bobby AAA approved status

3 header titles are gif images with no alt text
Calderdale

 

use of alt text questioned - perform manual check to see if good replacement for image

5 x Priority 1 errors (U): perform manual check

numerous 'possible' priority 1 errors requiring manual check

page fails to meet Bobby AAA approved status

tables headers/row identifiers; alt text too long (150 chars - use separate description)

 

East Sussex 15 x alt text - perform manual check to see if good replacement for image

1 x Priority 1 error (A) - missing alt text

page fails to meet Bobby AAA approved status

 
Essex failed on several occasions - web master contacted failed as for WAVE  
Islington 1 x missing alt text: page fails

1 x Priority 1 error (A) - missing alt text

page fails to meet Bobby AAA approved status

image is for Adobe acrobat reader - text provided but not linked to 'Get Acrobat Reader' image
Kingston

42 x missing alt text: page fails

failed to connect on two consecutive days  
Knowsley 14 x alt text - perform manual check to see if good replacement for image

5 x Priority 1 (u) errors

page fails to meet Bobby AAA approved status

Bobby errors include missing alt text; tables without structural markup; use of colour and data tables
Leeds 9 x missing alt text: page fails

2 x Priority 1 errors (A) - missing alt text

6 x Priority 1 errors (u)

page fails to meet Bobby AAA approved status

alt-text missing for 9 images/buttons
Monmouthshire 2 x alt text - perform manual check to see if good replacement for image

3 x Priority 1 (u)

page fails to meet Bobby AAA approved status

provide alternative content for script; use of colour to convey info; missing alt text
NE Lincs 3 x alt text of questionable utility 4 x Priority 1errors (U) e.g. library.gif (728 bytes) and sitemap.gif (445 bytes).
North Lincs 19 x alt text - perform manual check to see if good replacement for image

4 x Priority 1 errors (u)

page fails to meet Bobby AAA approved status

colour; tables; data tables
Nottingham 37 x missing alt text: page fails

2 x Priority 1 errors (A)

7 x Priority 1 errors (u)

numerous possible Priority 1 errors - perform manual check

page fails to meet Bobby AAA approved status

 
Southampton 4 x alt text - perform manual check to see if good replacement for image

4 x Priority 1 errors (A)

page fails to meet Bobby AAA approved status

Bobby: use of style sheets; colour; missing alt text; structural markup for table headers
Suffolk

1 x missing alt text (potential fail but see comment 1)

1 x blank alt text (comment 2)

1 x Priority 1 error (A) - missing alt text

page fails to meet Bobby AAA approved status

(1) missing text refers to horizontal line

(2) bland alt text refers to horizontal line

Wakefield

2 x missing alt text: page fails

No Priority 1 errors found

2 x Priority 2 errors (A)

page fails to meet Bobby AAA approved status

disparity in the WAVE and Bobby results.

Summary of findings

One site only had zero Priority 1 Accessibility errrors using Bobby. Maximum number of Priority 1 (A) errors for one site was 4.

Majority of errors generated due to missing ALT text. However logos and decorative images may be counted as missing ALT text and empty ALT string e.g. ALT=" " is preferable - this tells screen reading software that these images can be skipped/ignored.

Warning: Results need careful interpretation.

Search facilities

Name
Search facility available
comments
Anglesey Microsoft - type unknown no results obtained - too slow when tried on several occasions
Birmingham Texis/Thunderstone

Information from product website:

"the only search engine with the structure of a SQL relational database (rdbms)"

Note: changes to URL and site since first accessed

Calderdale none found provides page of links to WWW search tools and resources e.g. Altavista; Excite; Yahoo; All the Web; Webwise and Phil Bradley's pages
East Sussex none found  
Essex Microsoft Index Server  
Islington Microsoft - type unknown  
Kingston Microsoft Index Server  
Knowsley none found  
Leeds developed in-house  
Monmouthshire Microsoft Index  
NE Lincs none found  
North Lincs Sun-Netscape iPlanet not available at the time - internal error
Nottingham yes - type unknown  
Southampton Muscat Empower  
Suffolk ht://dig  
Wakefield none found