 |
 |
 |
|
 |
 |
 |
|
 |
|
|
|||||||||
|
|
Results of User Tests of Webinator
PART I
QUESTION 1
Cumulative Cumulative
COMPUTER Frequency Percent Frequency Percent
-------------------------------------------------------
. 1 3.7 1 3.7
Macintosh 12 44.4 13 48.1
PC 10 37.0 23 85.2
Unix 4 14.8 27 100.0
Cumulative Cumulative
BROWSER Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.7 1 3.7
Lynx 2 7.4 3 11.1
Netscape 2.x 2 7.4 5 18.5
Netscape 3.x 13 48.1 18 66.7
Netscape Communi 9 33.3 27 100.0
QUESTION 2 Query=history
Cumulative Cumulative
Q2HITS Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.7 1 3.7
0 1 3.7 2 7.4
136 1 3.7 3 11.1
141 9 33.3 12 44.4
488 1 3.7 13 48.1
51 1 3.7 14 51.9
527 1 3.7 15 55.6
640 1 3.7 16 59.3
770 1 3.7 17 63.0
823 6 22.2 23 85.2
? 1 3.7 24 88.9
??? 1 3.7 25 92.6
can'ttell -see n 1 3.7 26 96.3
lots 1 3.7 27 100.0
Cumulative Cumulative
Q2EXPECT Frequency Percent Frequency Percent
-------------------------------------------------------
. 1 3.7 1 3.7
Fair 9 33.3 10 37.0
Poor 7 25.9 17 63.0
Very Poor 6 22.2 23 85.2
Very Well 2 7.4 25 92.6
Well 2 7.4 27 100.0
Cumulative Cumulative
Q2TIME Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.7 1 3.7
1 sec 2 7.4 3 11.1
1 second 1 3.7 4 14.8
10 sec 1 3.7 5 18.5
10 seconds 1 3.7 6 22.2
11 secs 1 3.7 7 25.9
2 seconds 3 11.1 10 37.0
2-3 seconds 1 3.7 11 40.7
3 sec 1 3.7 12 44.4
3 seconds 2 7.4 14 51.9
3 x 15seconds. N 1 3.7 15 55.6
4 sec 1 3.7 16 59.3
4 seconds 2 7.4 18 66.7
4 secs 1 3.7 19 70.4
5 sec. 1 3.7 20 74.1
5 seconds 1 3.7 21 77.8
7 sec 1 3.7 22 81.5
7 seconds 1 3.7 23 85.2
8 sec 1 3.7 24 88.9
about5 seconds 1 3.7 25 92.6
threeseconds 1 3.7 26 96.3
undera minute 1 3.7 27 100.0
Cumulative Cumulative
Q2SITES Frequency Percent Frequency Percent
-----------------------------------------------------
. 3 11.1 3 11.1
no 9 33.3 12 44.4
yes 15 55.6 27 100.0
QUESTION 3 Query=writing history
Cumulative Cumulative
Q3HITS Frequency Percent Frequency Percent
-------------------------------------------------------
. 2 7.4 2 7.4
12 1 3.7 3 11.1
1308 1 3.7 4 14.8
136 7 25.9 11 40.7
2491 1 3.7 12 44.4
3253 1 3.7 13 48.1
33 9 33.3 22 81.5
51 1 3.7 23 85.2
5226 1 3.7 24 88.9
7420 1 3.7 25 92.6
8447 1 3.7 26 96.3
can'ttell 1 3.7 27 100.0
Cumulative Cumulative
Q3CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
. 1 3.7 1 3.7
no 4 14.8 5 18.5
yes 22 81.5 27 100.0
Cumulative Cumulative
Q3TIME Frequency Percent Frequency Percent
------------------------------------------------------------
. 1 3.7 1 3.7
1 sec 2 7.4 3 11.1
1 second 3 11.1 6 22.2
10 sec 1 3.7 7 25.9
2 seconds 3 11.1 10 37.0
2-3 seconds 1 3.7 11 40.7
3 sec 2 7.4 13 48.1
3 seconds 1 3.7 14 51.9
3 secs 1 3.7 15 55.6
4 seconds 2 7.4 17 63.0
4 secs 1 3.7 18 66.7
5 sec 2 7.4 20 74.1
5 seconds 3 11.1 23 85.2
7 sec 1 3.7 24 88.9
about5 seconds 1 3.7 25 92.6
fast 1 3.7 26 96.3
four seconds 1 3.7 27 100.0
QUESTION 4 Query=+writing +history
Cumulative Cumulative
Q4HITS Frequency Percent Frequency Percent
-------------------------------------------------------
. 1 3.7 1 3.7
0 2 7.4 3 11.1
12 1 3.7 4 14.8
1324 1 3.7 5 18.5
136 6 22.2 11 40.7
2507 1 3.7 12 44.4
33 8 29.6 20 74.1
3441 1 3.7 21 77.8
50 1 3.7 22 81.5
51 1 3.7 23 85.2
5248 1 3.7 24 88.9
8447 1 3.7 25 92.6
? 1 3.7 26 96.3
can'ttell 1 3.7 27 100.0
Cumulative Cumulative
Q4CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
. 2 7.4 2 7.4
no 20 74.1 22 81.5
yes 5 18.5 27 100.0
Cumulative Cumulative
Q4TIME Frequency Percent Frequency Percent
------------------------------------------------------------
. 2 7.4 2 7.4
0.1 second 1 3.7 3 11.1
1 sec 2 7.4 5 18.5
1 sec. 1 3.7 6 22.2
1 second 2 7.4 8 29.6
10 secs 1 3.7 9 33.3
2 sec 1 3.7 10 37.0
2 seconds 2 7.4 12 44.4
2-3 seconds 1 3.7 13 48.1
3 1 3.7 14 51.9
3 sec 2 7.4 16 59.3
3 seconds 4 14.8 20 74.1
3 secs 1 3.7 21 77.8
4 seconds 1 3.7 22 81.5
5 sec 1 3.7 23 85.2
9 sec 1 3.7 24 88.9
9 seconds 1 3.7 25 92.6
about5 seconds 1 3.7 26 96.3
two seconds 1 3.7 27 100.0
[QUESTION 5 NOT APPLICABLE]
QUESTION 6 Proximity=1 word
Query=+writing +history
Cumulative Cumulative
Q6HITS Frequency Percent Frequency Percent
----------------------------------------------------
. 2 7.4 2 7.4
0 1 3.7 3 11.1
5 12 44.4 15 55.6
8+???? 1 3.7 16 59.3
9 11 40.7 27 100.0
Cumulative Cumulative
Q6CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
. 2 7.4 2 7.4
no 8 29.6 10 37.0
yes 17 63.0 27 100.0
Cumulative Cumulative
Q6TIME Frequency Percent Frequency Percent
--------------------------------------------------------------
. 2 7.4 2 7.4
.5 sec 1 3.7 3 11.1
0.5 seconds 1 3.7 4 14.8
1 sec 1 3.7 5 18.5
1 second 3 11.1 8 29.6
10 secs 1 3.7 9 33.3
12 sec 1 3.7 10 37.0
15 secs. queryca 1 3.7 11 40.7
2 sec 1 3.7 12 44.4
2 seconds 2 7.4 14 51.9
2 secs 1 3.7 15 55.6
3 sec 2 7.4 17 63.0
3 seconds 4 14.8 21 77.8
4 sec 1 3.7 22 81.5
5 seconds 3 11.1 25 92.6
7 seconds 1 3.7 26 96.3
threeto fourseco 1 3.7 27 100.0
QUESTION 7 Query="writing about history"
Cumulative Cumulative
Q7HITS Frequency Percent Frequency Percent
----------------------------------------------------
. . 1 3.7 1 3.7
0 n 2 7.4 3 11.1
1 n 1 3.7 4 14.8
1 y 17 63.0 21 77.8
1+???n 1 3.7 22 81.5
109 n 1 3.7 23 85.2
136 n 1 3.7 24 88.9
33 n 1 3.7 25 92.6
33 y 1 3.7 26 96.3
9 y 1 3.7 27 100.0
Cumulative Cumulative
Q7CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
. 1 3.7 1 3.7
no 7 25.9 8 29.6
yes 19 70.4 27 100.0
Cumulative Cumulative
Q7TIME Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.7 1 3.7
0.1 second 1 3.7 2 7.4
1 sec 4 14.8 6 22.2
1 second 1 3.7 7 25.9
10 seconds 1 3.7 8 29.6
11 sec 1 3.7 9 33.3
14 sec 1 3.7 10 37.0
15 secs. queryca 1 3.7 11 40.7
2 sec 1 3.7 12 44.4
2 seconds 4 14.8 16 59.3
3 seconds 2 7.4 18 66.7
4 seconds 1 3.7 19 70.4
5 seconds 2 7.4 21 77.8
6 sec 1 3.7 22 81.5
6 seconds 1 3.7 23 85.2
8 sec 1 3.7 24 88.9
9 secs 1 3.7 25 92.6
QueryTime Exceed 1 3.7 26 96.3
six seconds 1 3.7 27 100.0
PART II
QUESTION 1 Query=What modems should I use to connect to PennNet?
Cumulative Cumulative
QII-1HITS Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.7 1 3.7
0 1 3.7 2 7.4
0/-->auto fuzzy 1 3.7 3 11.1
1 2 7.4 5 18.5
17 1 3.7 6 22.2
20 4 14.8 10 37.0
26 4 14.8 14 51.9
50 5 18.5 19 70.4
50+ 1 3.7 20 74.1
51 1 3.7 21 77.8
? 1 3.7 22 81.5
? notgiven 1 3.7 23 85.2
????? 1 3.7 24 88.9
can'ttell 1 3.7 25 92.6
cant tell 1 3.7 26 96.3
fuzzy 1 3.7 27 100.0
Cumulative Cumulative
QII-1EXPECT Frequency Percent Frequency Percent
-------------------------------------------------------
. 1 3.7 1 3.7
Fair 7 25.9 8 29.6
Poor 3 11.1 11 40.7
Very Poor 2 7.4 13 48.1
Very Well 9 33.3 22 81.5
Well 5 18.5 27 100.0
Cumulative Cumulative
QII-1TIME Frequency Percent Frequency Percent
-------------------------------------------------------------
. 1 3.7 1 3.7
1 sec 1 3.7 2 7.4
1 second 1 3.7 3 11.1
12 secs 1 3.7 4 14.8
14 sectimed out 1 3.7 5 18.5
15 sec 1 3.7 6 22.2
15 secs. 1 3.7 7 25.9
2 sec 1 3.7 8 29.6
2 seconds 4 14.8 12 44.4
2-3 seconds 1 3.7 13 48.1
3 seconds 2 7.4 15 55.6
3 secs 1 3.7 16 59.3
4 sec 1 3.7 17 63.0
4 seconds 2 7.4 19 70.4
5 sec 1 3.7 20 74.1
5 seconds 3 11.1 23 85.2
5-6 sec 1 3.7 24 88.9
6 sec 1 3.7 25 92.6
7 seconds 1 3.7 26 96.3
four seconds 1 3.7 27 100.0
QUESTION 2 Query="U.S. Robotics"
Cumulative Cumulative
QII-2HITS Frequency Percent Frequency Percent
--------------------------------------------------------------
"0, so it did a fuzzy... 1 3.8 1 3.8
. 1 3.8 2 7.7
12 1 3.8 3 11.5
14 4 15.4 7 26.9
20 2 7.7 9 34.6
2554 1 3.8 10 38.5
50 3 11.5 13 50.0
51 1 3.8 14 53.8
5335 1 3.8 15 57.7
6 7 26.9 22 84.6
7555 1 3.8 23 88.5
83 2 7.7 25 96.2
can'ttell 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
Q9CLOSER Frequency Percent Frequency Percent
-----------------------------------------------------
. 1 3.8 1 3.8
0"y 1 3.8 2 7.7
no 6 23.1 8 30.8
yes 18 69.2 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-2TIME Frequency Percent Frequency Percent
--------------------------------------------------------------
. 1 3.8 1 3.8
.5 sec 1 3.8 2 7.7
0.5 second 1 3.8 3 11.5
1 second 1 3.8 4 15.4
1-2 seconds 1 3.8 5 19.2
13 secbeforetime 1 3.8 6 23.1
2 sec 2 7.7 8 30.8
2 seconds 2 7.7 10 38.5
2 secs 1 3.8 11 42.3
2-3 seconds 1 3.8 12 46.2
3 sec 1 3.8 13 50.0
3 seconds 3 11.5 16 61.5
4 sec 1 3.8 17 65.4
4 seconds 1 3.8 18 69.2
4 secs 1 3.8 19 73.1
5 sec 1 3.8 20 76.9
5 seconds 1 3.8 21 80.8
9 1 3.8 22 84.6
9 seconds 1 3.8 23 88.5
a fewseconds 1 3.8 24 92.3
es2 seconds 1 3.8 25 96.2
threeseconds 1 3.8 26 100.0
Frequency Missing = 1
QUESTION 3 Query=%US Robot
Cumulative Cumulative
QII-3HITS Frequency Percent Frequency Percent
-----------------------------------------------------
11 1 3.8 1 3.8
. 1 3.8 2 7.7
0 2 7.7 4 15.4
1 1 3.8 5 19.2
11 1 3.8 6 23.1
116 3 11.5 9 34.6
1393 1 3.8 10 38.5
14 1 3.8 11 42.3
15 8 30.8 19 73.1
20 1 3.8 20 76.9
2567 1 3.8 21 80.8
3537 1 3.8 22 84.6
50 1 3.8 23 88.5
51 1 3.8 24 92.3
5355 1 3.8 25 96.2
7583 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-3CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
n 1 3.8 1 3.8
. 2 7.7 3 11.5
no 13 50.0 16 61.5
yes 10 38.5 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-3TIME Frequency Percent Frequency Percent
-------------------------------------------------------------
. 1 3.8 1 3.8
.25 sec 1 3.8 2 7.7
0.5 seconds 1 3.8 3 11.5
1 second 1 3.8 4 15.4
1-2 seconds 1 3.8 5 19.2
1/2 second 1 3.8 6 23.1
11 seconds 1 3.8 7 26.9
2 sec 2 7.7 9 34.6
2 seconds 3 11.5 12 46.2
2 secs 1 3.8 13 50.0
2-3 seconds 1 3.8 14 53.8
3 sec 2 7.7 16 61.5
3 seconds 1 3.8 17 65.4
3 secs 1 3.8 18 69.2
4 sec 2 7.7 20 76.9
4 seconds 1 3.8 21 80.8
5 seconds 1 3.8 22 84.6
9 sec 1 3.8 23 88.5
a fewseconds 1 3.8 24 92.3
o 2 seconds 1 3.8 25 96.2
one-two seconds 1 3.8 26 100.0
Frequency Missing = 1
QUESTION 4 Query=+"U.S. Robotics" +#>14.4
Cumulative Cumulative
QII-4HITS Frequency Percent Frequency Percent
-------------------------------------------------------
83 1 3.8 1 3.8
. 1 3.8 2 7.7
0 1 3.8 3 11.5
14 4 15.4 7 26.9
20 1 3.8 8 30.8
2574 1 3.8 9 34.6
3 1 3.8 10 38.5
3544 1 3.8 11 42.3
50 2 7.7 13 50.0
51 1 3.8 14 53.8
6 6 23.1 20 76.9
7 1 3.8 21 80.8
7597 1 3.8 22 84.6
83 3 11.5 25 96.2
can'ttell 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-4CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
y 1 3.8 1 3.8
. 1 3.8 2 7.7
no 14 53.8 16 61.5
yes 10 38.5 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-4TIME Frequency Percent Frequency Percent
-------------------------------------------------------------
. 1 3.8 1 3.8
.5 sec 1 3.8 2 7.7
0.3 seconds 1 3.8 3 11.5
1 second 2 7.7 5 19.2
11 sec 1 3.8 6 23.1
13 seconds 1 3.8 7 26.9
14 sectimed out 1 3.8 8 30.8
2 sec 2 7.7 10 38.5
2 seconds 1 3.8 11 42.3
2 secs 1 3.8 12 46.2
2-3 seconds 1 3.8 13 50.0
3 sec 2 7.7 15 57.7
3 seconds 3 11.5 18 69.2
4 seconds 1 3.8 19 73.1
4 secs 1 3.8 20 76.9
5 sec 1 3.8 21 80.8
7 seconds 1 3.8 22 84.6
a fewseconds 1 3.8 23 88.5
es2 seconds 1 3.8 24 92.3
four seconds 1 3.8 25 96.2
seconds 1 3.8 26 100.0
Frequency Missing = 1
QUESTION 5 Query=+"U.S. Robotics" +#>14.4 ~baud
Cumulative Cumulative
QII-5HITS Frequency Percent Frequency Percent
-------------------------------------------------------
37 1 3.8 1 3.8
. 1 3.8 2 7.7
0 1 3.8 3 11.5
14 5 19.2 8 30.8
2 6 23.1 14 53.8
20 1 3.8 15 57.7
42 3 11.5 18 69.2
5 1 3.8 19 73.1
50 2 7.7 21 80.8
51 1 3.8 22 84.6
6 1 3.8 23 88.5
7604 1 3.8 24 92.3
8 1 3.8 25 96.2
can'ttell 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-5CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
n 1 3.8 1 3.8
. 2 7.7 3 11.5
no 9 34.6 12 46.2
yes 14 53.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-5TIME Frequency Percent Frequency Percent
-------------------------------------------------------------
. 1 3.8 1 3.8
0.2 seconds 1 3.8 2 7.7
1 sec 1 3.8 3 11.5
1 second 1 3.8 4 15.4
1.5 sec 1 3.8 5 19.2
12 sec 1 3.8 6 23.1
14 sectimed out 1 3.8 7 26.9
2 sec 2 7.7 9 34.6
2 seconds 2 7.7 11 42.3
2-3 seconds 1 3.8 12 46.2
2.5 sec 1 3.8 13 50.0
3 sec 1 3.8 14 53.8
3 seconds 4 15.4 18 69.2
5 sec 1 3.8 19 73.1
5 secs 1 3.8 20 76.9
6 seconds 1 3.8 21 80.8
7 seconds 1 3.8 22 84.6
a fewseconds 1 3.8 23 88.5
four seconds 1 3.8 24 92.3
o 3 seconds 1 3.8 25 96.2
seconds 1 3.8 26 100.0
Frequency Missing = 1
QUESTION 6 Query=+"U.S. Robotics" +#>14.4 ~baud /199[67]
Cumulative Cumulative
QII-6HITS Frequency Percent Frequency Percent
-------------------------------------------------------
4 1 3.8 1 3.8
. 1 3.8 2 7.7
0 3 11.5 5 19.2
1 1 3.8 6 23.1
14 11 42.3 17 65.4
4 3 11.5 20 76.9
50 3 11.5 23 88.5
51 1 3.8 24 92.3
6 1 3.8 25 96.2
can'ttell 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-6CLOSER Frequency Percent Frequency Percent
------------------------------------------------------
n 1 3.8 1 3.8
. 1 3.8 2 7.7
no 18 69.2 20 76.9
yes 6 23.1 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QII-6TIME Frequency Percent Frequency Percent
-------------------------------------------------------------
"querycancelled 1 3.8 1 3.8
. 1 3.8 2 7.7
.10 sec 1 3.8 3 11.5
0.3 seconds 1 3.8 4 15.4
1 sec 1 3.8 5 19.2
12 sec 1 3.8 6 23.1
14 sectimed out 1 3.8 7 26.9
2 sec 2 7.7 9 34.6
2 seconds 3 11.5 12 46.2
2-3 seconds 1 3.8 13 50.0
3 sec 1 3.8 14 53.8
3 seconds 4 15.4 18 69.2
4 sec 1 3.8 19 73.1
6 sec 1 3.8 20 76.9
6 seconds 1 3.8 21 80.8
8 seconds 1 3.8 22 84.6
few seconds 1 3.8 23 88.5
five seconds 1 3.8 24 92.3
o 2 seconds 1 3.8 25 96.2
seconds 1 3.8 26 100.0
Frequency Missing = 1
PART III
QUESTION 1 Proximity=rank
Query=undergraduate research
Cumulative Cumulative
QIII-1HITS Frequency Percent Frequency Percent
--------------------------------------------------------------
"50? (got 31-4 1 3.8 1 3.8
!!!"not reported 1 3.8 2 7.7
. 2 7.7 4 15.4
20 8 30.8 12 46.2
30+ 1 3.8 13 50.0
47 4 15.4 17 65.4
50 2 7.7 19 73.1
51 1 3.8 20 76.9
? 3 11.5 23 88.5
??? 1 3.8 24 92.3
can'ttell 1 3.8 25 96.2
too many to tell 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QIII-1EXP Frequency Percent Frequency Percent
-------------------------------------------------------
"Fair 1 3.8 1 3.8
. 1 3.8 2 7.7
Fair 8 30.8 10 38.5
Poor 5 19.2 15 57.7
Very Poor 2 7.7 17 65.4
Very Well 3 11.5 20 76.9
Well 5 19.2 25 96.2
agesFair 1 3.8 26 100.0
Frequency Missing = 1
Cumulative Cumulative
QIII-1TIME Frequency Percent Frequency Percent
-----------------------------------------------------------
4 seconds 1 3.8 1 3.8
5 secs 1 3.8 2 7.7
. 1 3.8 3 11.5
0.5 seconds 1 3.8 4 15.4
1 sec 2 7.7 6 23.1
1 second 1 3.8 7 26.9
10 sec 1 3.8 8 30.8
2 seconds 2 7.7 10 38.5
2-3 seconds 1 3.8 11 42.3
3 sec 2 7.7 13 50.0
3 seconds 3 11.5 16 61.5
3 secs 1 3.8 17 65.4
4 sec 2 7.7 19 73.1
4 seconds 2 7.7 21 80.8
5 seconds 1 3.8 22 84.6
8 sec 1 3.8 23 88.5
fast 1 3.8 24 92.3
few seconds 1 3.8 25 96.2
threeseconds 1 3.8 26 100.0
Frequency Missing = 1
QUESTION 2 Is context information helpful?
Cumulative Cumulative
QIII-2CLOSER Frequency Percent Frequency Percent
----------------------------------------------------
. 1 4.2 1 4.2
no 7 29.2 8 33.3
yes 16 66.7 24 100.0
Frequency Missing = 3
QUESTION 3 Is link reference report useful?
Cumulative Cumulative
QIII-3USEFUL Frequency Percent Frequency Percent
-----------------------------------------------------
no 1 3.8 1 3.8
ye 1 3.8 2 7.7
. 1 3.8 3 11.5
no 7 26.9 10 38.5
yes 16 61.5 26 100.0
Frequency Missing = 1
QUESTION 4 Is expanding search by similar documents useful?
Cumulative Cumulative
QIII-4USEFUL Frequency Percent Frequency Percent
-----------------------------------------------------
ye 1 3.8 1 3.8
. 1 3.8 2 7.7
no 12 46.2 14 53.8
sno 1 3.8 15 57.7
yes 11 42.3 26 100.0
Frequency Missing = 1
Back to Penn Web main page.
|
|
 |
|
|
 |
|
| Information Systems and ComputingUniversity of PennsylvaniaComments & Questions |
 |
|