Wayback Machine
Wayback Machine, founded by Internet Archive, is a longstanding digital archive. I conducted usability tests to assess user navigation and search functionality. Methods included Think Aloud and System Usability Scale (SUS). Users, aged 22-24, tested the interface using Windows Surface and Chromebook devices.
Testing Results
Mental Model
Overall, users found navigating the site to be easy, but there were issues with understanding terminology. Two examples of terminology that users did not understand were crawlers and API. There was also slight confusion with certain features and functions (ex: WordPress Broken Link Checker).
Think Aloud
What became clear during the Think Aloud was that slight variations in phrasing impacted search results. If users were to type "The New York Times" instead of "New York Times," they would be given significantly fewer screengrabs. The February 8,2002, screengrab was one of the captures that were missing. It also wasn't clear to users how to navigate the calendar, which led to a delay in completing the task.
System of Usability Score
The scores were 45,47.5 and 67.5. This puts user satisfaction in between the poor and okay range.
Analysis
To analyze the compiled data, grounded theory was applied.
-
Codes highlighted confusion and affordance issues, with emerging categories like 'User-Centered Design Issues' and 'Lack of Clarity.'
'User frustration' was a recurring theme.
-
Codes related to 'prior experience impacting usability testing' and 'assumptions due to limited knowledge' began forming.
Confusion regarding design persisted.
Core categories focused on 'interface design impacting usability,' including issues like 'non-user-friendly language' and 'false affordances.'
-
Lack of clarity was prominent, with codes like 'Assumption about Website Function' and 'Confusion surrounding features' featuring most frequently.
A total of 15 storylines were developed.
The core category identified was 'Usability Issues Related to Bad User-Centered Design.
Results
Based on the lower-than-average SUS score and the data collected from the qualitative evaluation methods, the design and layout of the website impacted usability and satisfaction.