This usability test plan describes the recommended approach for the user interface test a usability assessment that addressing the following issues: Efficiency and effectiveness of use. Time to accomplish tasks. Nature and incidence of errors . User satisfaction with the Interfaces . Participant Selection and Recruitment: A total of 2 Instructors will be recruited from the Athens State Computer Science Department. Facilities The test sessions will be conducted in the Computer Lab on the Athens State Main Campus in Athens Alabama. The test participants will use a Pentium class mahcine with Windows 98 or Windows XP . The participants will be given the choice to take the test in the morning or afternoon. The lab contain several other computing machines, a Televison and a screen to capture the user’s computer screen in real-time and convert it to video, The test administrator will sit beside and behind the participant to observe and notes on his or her actions. If necessary, the accessibility challenged participants will be tested at their work or home. The test administrator will take a photo to verify that the testing actually took place. Test Procedures Set-Up Participants will be greeted by the test administrator, , and brought to the test station where they will be briefed on the nature of the test. Prior to the test, participants will be asked to complete a short demographics questionnaire and a consent form. Test Administration Each test participant will be involved in a single test session that will last approximately 35 minutes one-on-one with a test administrator. The administrator will direct participants through a prepared script. The administrator will allow participants time to accomplish a series of tasks as described in the guide with a minimum of cues and suggestions offered only if needed. When intervening on such occasions, the test administrator will ask leading questions in an attempt to discern the underlying causes of any difficulty the participant may be experiencing. Data Collection The test administrator will note how participants move in their attempt to accomplish a task. An emphasis will be placed on understanding the logic that users are following to accomplish their task so we will ask them to "think aloud." This will interfere with obtaining strict timing information although we will note both time and errors. After completing the sequence of tasks, participants will be asked to briefly evaluate the interface using a questionnaire and asked to offer suggestions and comments about the interface. Analysis and Report The test administrator will review test notes as needed, from each test session. The data to be aggregated include: Summary and range of comments on the simplicity and understandability of the interface The quantity of correct and incorrect attempts (i.e., errors) to complete tasks The ease and importance of specific capabilities A summary of post-test comments Usability problems are categorized by severity, judged on probable frequency and likely impact on productivity. The report will include key differences, if any, among the two participant groups.
