Penn Computing
Computing Menu Computing A-Z
Computing Home Information Systems & Computing Penn
Please note: This material is no longer current and appears online for archival purposes only.
Use the search and navigation tools above to locate more up-to-date materials, if they exist.

Email Evaluation 2002 - Test Form Results

Ranking:   0=Client doesn't have this functionality     1=Not very   2=Moderately   3=Very

User 13 2 10 9 11 16 21 22 23 24 25 26 1 3 4 6 7 8 12 14 15 17 18 5 19 20
Mulberry 2.1.2                         X X X X X X X X X X X      
Messenger 6.2.1           X X X X X X X                            
Messenger 4.79       X X                                          
Eudora 5.1   X X                                              
Outlook 2000                                               X X  
Outlook XP                                                   X
Entourage X                                                  
 
Mac OS 8.6                                                    
Mac OS 9.2.2           X                                        
Mac OS X 10.1 X                 X                     X          
Windows 98/ME     X X X                   X                      
Windows NT 4.0             X                         X            
Windows 2000                 X   X   X X   X   X X     X   X    
Windows XP   X           X       X         X           X     X
Linux/Solaris                                                 X  
 
1. How intuitive was the installation process? 3 3 3 3 3 3 3 2 2 2 3 3 3 1 2 3 2 2 2 3 3 1 1      
2. Are you asked where to store user data on multiple-user machines?   Y Y N   N N N     Y N   Y   N N N N N N N N      
3. Will the client function for a user with restricted access to the system?   Y   N       Y N   Y         Y Y Y     Y   Y      
4. What options are allowed?
Additional comments on installation.
5. How easily can you configure the client? 2 2 3 2 3 2 3 2 2 2 3 3 2 1 1 1 2 2 2 2 2 0 1      
6. Does the client have "wizards" to help with the configuration? Y   N N Y Y Y   Y Y Y Y N N N N N N N N N N N      
7. Can you configure the client to use an external editor when composing or reading messages? N   N     N Y N   N     N   N N     N N N   N      
Additional comments on configuration.
8. Copy/Paste   3 3 3 3 3 3 3 2 3 3 3 3 3 1 2 2 2 3 3 3 2 2      
9. Cut/Paste   3 3 3 3 3 3 3 2 3 3 3 0 3 1 2 2 2 3 3 3 2 2      
10. Word wrapping   3 3 3 3 3   2 2 3 3 3 3 2 1 3 3 3 2 3 3   2      
11. Realignment or paragraphs   2 3 3 3 2 3 2   3 3 3     2 3 2 2 2 3 3   1      
12. Spell-checking   2   3 3 3 3 3 2 3 3 3 2 3 1 2     2 1 1 2 1      
13. Is there a default dictionary for the spell-checker?   Y   Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y      
14. Can you create a personal dictionary for the spell-checker?   Y       Y Y Y Y Y Y   Y Y   Y Y Y Y Y Y   Y      
15. Search for and replace a word   0 0   3 3 3 3 2 3 3   3 3 1 1 1 1 2 3 3 1 0      
16. Search forward for a word   2 3   3 2 3 3 2 3 3 3 3   1 2 2 2 2 3 3 1 1      
17. Search backward for a word     0   3 3   3 2 3 3 3 3 2 1 0 0 0   3 3 1 1      
18. Create a signature file   2 3   3 2 3 3 1 3 3 3 2   1 2 2 2 2 3 2 2 1      
19. Can you create multiple signature files?   Y Y       N N Y N N Y Y   N N     N Y Y N Y      
20. Create a stationery file   2 2     0   0     3   0   0 1     0 0 0   1      
21. Can you create multiple stationery files?     Y     N   N         N Y   Y     N N N   Y      
22. Are there options for how/whether to send web formatted messages?           Y Y   Y Y Y Y Y   Y Y     Y Y Y Y        
23. Can you create a message and specify a delivery receipt?     Y     N N N Y N   N N N Y Y       Y Y N Y      
24. Can you create a message and specify a precedence header?           Y Y Y   N     N     N       N N N        
25. Can you create a message and specify an expiration date?           N N N   N     N N   N       N N N N      
26. Can you create a message with a blank "From:" header?     N   N N N N   N N N N N N N       Y N N N      
27. Can you blind copy ("Bcc:" mail header) on all sent messages?     Y   Y Y Y Y Y Y Y Y N Y   N     Y Y Y Y Y      
Additional comments on message creation.
28. How easily can you read messages?   3 3 3 3 3 3 3 2 3 3   3 3 3 2 3 3 3 2 3 1 1      
29. How easily can you open a message using your desktop word processing package?             0 3   1     3     2     0 2 0 1 1      
30. Can you preview a message before you download it to your desktop?   Y   Y     Y N   Y Y Y     N N N N Y N N   N      
31. In the case where the message line is longer than the reading window, how well does the client handle text wrapping?   3 3 2 3 3 2   2 3 2 3 3 3   3 3 3 2 3 3 2 2      
32. How well does the client handle printing of messages?   2 3 3 3   2 3 2 3 3   3 3 3 1 3 3   2 3 2 2      
33. Did you receive a delivery receipt for a message that had one?     Y       Y         Y   N Y N       N Y   Y      
34. Could you tell the precedence for a message that had one?           Y Y Y   Y     Y N   N       N   N Y      
35. Could you tell the expiration date for a message that had one?                         Y N   N       N            
36. Which of the following best describes what happens to a message when you delete it?   2 3   3 2 2 2 2 3 1 2 2 2 2 2 2 2 2 2 2 2 2      
37. Is there an "undelete" option?   Y Y   Y Y Y Y Y Y   Y Y Y Y Y Y Y Y Y Y Y Y      
38. How easily can you include the text of the original message in your reply?   3 3 3 3 3 3 2 2 3 3 3 3 3 3 3 1 1 2 3 2 2 2      
39. How easily can you edit the text of the original message in your reply?   3 3 3 3 3 3 3 2 3 3 3 3 3 3 3 2 2 2 3 3 2 2      
40. How easily can you exclude the text of the original message in your reply?     2 3 3 3 3   2 3 2 3 3 3 3 3 1 1 2 2 2 1 2      
41. When replying to a message and including the text of the original message, try to run the spell-checker on your reply. Does the spell-checker also check the quoted text from the original message?   N       Y N N Y Y N N Y Y Y Y Y Y Y Y Y   Y      
42. How easily can you add a preface to the body of the message?   2 3 2 3 3 3 3 2 3 3 3 3 3 3 3 3 3 2 3 3 2 2      
43. How easily can you change the subject of the message?   3 3 2 3 3 3 3 2 3 3 3 3 3 3 3 3 3 2 3 3 2 2      
44. How easily can you edit the forwarded message?   3 3 2 3 3 3 3 2 3 3 3 3 3 3 3 3 3 2 3 3 2 2      
45. How easily can you bounce/redirect a message?       2   0 0 0       0 3 0   2     2 3 3 1 2      
46. How easily can you resend a message that you already sent?   2 3 2 3 0 0 2 2 0 1 3 3   2 1     2 3 3 1 2      
47. Did you have to create a new message in order to resend a message that you had already sent?   N N N Y Y Y Y N Y Y Y N     N     Y N N N N      
Additional comments on incoming messages.
48. ASCII text           Y Y Y Y Y   Y Y   Y Y     Y Y Y Y Y      
49. Images     Y   Y Y Y Y Y   Y Y Y Y Y Y     Y Y Y Y Y      
50. Sound files     Y   Y   Y   Y     Y Y   Y Y       Y Y   Y      
51. Spreadsheet     Y   Y Y Y Y Y   Y Y Y   Y Y     Y Y Y Y Y      
52. Word processor file     Y   Y Y Y Y Y Y Y Y Y   Y Y     Y Y Y Y Y      
53. Database file             Y   Y   Y Y Y   Y Y     Y Y Y   Y      
54. MIME file               Y Y             Y       Y Y          
55. ASCII text           3 3 3 3 3   3 3   3 3     3 3 3 2 2      
56. Images     3 3 3 3 3 3 3   3 3 3 0 3 3     3 3 0   2      
57. Sound files     3 3 3   3   3     3 3   3 3       3 0   2      
58. Spreadsheet     3 3 3 3 3 3 3   3 3 3   3 3     3 3 0   2      
59. Word processor file     3 3 3 3 3 3 3 2 3 3 3   3 3     3 3 0 2 2      
60. Database file       3     3   3   3 3 3   3 3     3 3 0   2      
61. MIME file               3 3             3       3 0          
62. When you forward a message with an attachment, is the attachment correctly preserved?     Y Y Y Y Y Y   Y Y Y N N Y Y     Y Y Y Y Y      
63. When you resend a message with an attachment, is the attachment correctly preserved?     Y Y Y   Y Y     Y Y Y N   Y     Y Y Y Y Y      
Additional comments on attachments.
64. How easily can you create a filter that is triggered by the sender's identity?     2 2 2 3 3 2 2       3     2       3 3   2      
65. How easily can you create a filter that is triggered by the text of the message?           3 3 0 2     3 3     1       3 3   2      
66. Can you test multiple conditions when filtering?           Y N Y Y     N Y     Y     Y Y Y   Y      
67. When testing multiple conditions, must all conditions be met for filtering to work?           N N N N       N     Y     N Y N   Y      
68. When testing multiple conditions, can you opt to only have some condition met?           Y N Y Y       Y     Y     Y Y Y   Y      
69. Can you have multiple actions when filtering?           N N N N     N Y     Y     Y Y Y   N      
70. If you don't store local copies of your messages, does filtering still work?           Y Y Y       Y Y     Y     Y Y Y   Y      
71. How easily can you import/export filters to/from other email applications?     2   3   3         0 0     0         0   0      
Additional comments on filtering.
72. How easily can you lookup an email address in the Public Directory?     3   3   3 3     3 0     1 2     2 1 1 0 1      
73. When you do a search that results in multiple hits, how easily can you tell which email address is the one that you want?     2 3 3   3 2 2   3 0       3       3     2      
74. When you do a search that results in multiple hits, did you get all possible hits or was there a system limit on how many addresses display?         Y   Y Y     Y         N     Y       Y      
75. How easily can you add an email address to your addressbook?     2 2 3   3 3 2   3 3 3   1 2     2 2 1 2 1      
76. Could you add the address without having to retype or cut/paste?         Y   Y Y Y     Y N     Y     Y Y N   Y      
77. Is a history of past addresses maintained for auto-completion?       Y Y   Y Y Y   Y Y N   Y N       N N          
78. Can you edit the history list?       Y     Y       Y         N       N N          
79. How easily can you maintain your own contact list?     3 1 3     3     2 3       3     2 3 1 1 2      
80. Can you share your contact list with others?               N               Y       Y N N Y      
Additional comments on addressbooks.
81. Inbox     Y Y Y   Y     N Y Y Y Y Y Y Y Y Y Y Y Y Y      
82. Sent     Y Y Y   Y     Y N Y N N N N Y Y N N N N Y      
83. Trash     Y Y Y   Y     Y Y Y N     N N N N N N N Y      
84. What other folders are automatically created by the client?
85. Inbox     Y   Y   N N Y N   N N     Y     Y N N N        
86. Sent     Y   Y   Y Y Y   Y Y Y   Y N     Y Y Y N        
87. Trash     Y   Y   Y Y     Y         N     Y Y Y          
88. Are you able to copy a message from one folder on the server to another folder on the server using the "copy" command.             Y   Y Y   Y Y     N     Y N Y N Y      
89. Using click-drag-drop, drag an e-mail message from one folder on the server to another folder on the server. Did the message actually move rather than being copied?             Y Y Y Y   Y Y     Y     N Y Y Y Y      
90. Using click-drag-drop, drag an e-mail message from one folder on the server to another folder on the desktop. Did the message actually move rather than being copied?             N Y Y Y   N Y     N     N Y Y   Y      
91. How easily can you search a folder on the server and a folder on the desktop for a particular word?             3 3 2 3   3 3     3     2 3 3   2      
92. Are you able to specify a search order?             Y N N N   Y       Y     Y Y N          
93. How easily can you reorganize how messages are listed in a folder?             3 3 2     3 3     2     2 3 3   3      
94. What format is used for locally stored mail client?
95. How easily can you import/export messages to/from other email applications?                 2       0     1     1 0 0   2      
96. How easily can you resync your folders?             3   2     3       2       3 3   2      
97. Is resynchronization automatic?             Y Y       N       Y     N Y Y   Y      
98. Can resynchronization be forced?             Y N N Y   Y       Y     N Y Y   Y      
Additional comments on mail storage.
99. How easily can you check mail for multiple accounts?     3 2 2   1 2 3 3 2         3     2 3 3   2      
100. How easily can you send mail for multiple accounts?     3 2 2   1 2 2 3 3       3 3     2 3 3   2      
Additional comments on multiple accounts.
101. Can you change your password from within the client? N Y N   N   N N   N     N     Y Y Y   N N N Y Y N N
102. Kerberos with POP N N         N N N N   N Y     N Y Y Y   Y   Y Y N N
103. Kerberos with IMAP N N         N N N N   N Y Y Y Y Y Y Y Y Y Y Y Y N N
104. Kerberos with SMTP N N         N N N N   N Y Y Y Y Y Y Y Y Y Y   Y N N
105. Kerberos with LDAP N N         N N N N   N Y     Y       Y N     N N N
106. Kerberos with NNTP N N         N N N N   N N               N     N N N
107. SSL with POP Y Y         N Y Y       N           Y   N     Y Y Y
108. SSL with IMAP Y Y         Y Y Y   Y Y N           Y   N     Y Y Y
109. SSL with SMTP Y Y         Y   Y Y   Y N           Y   N     Y Y Y
110. SSL with LDAP Y           Y   Y       N               N     N    
111. SSL with NNTP Y           Y   Y       N               N     N    
112. How easily can the client be used with PGP?   2         3   2 1           2       3     2 1    
Describe how client responds if SSL is used with a hostname that does not match the hostname of the security certificate on server
Additional comments on security.
113. Based on review of vendor web site, how well supported does the product seem to be? 2 2 3   2   2 1 1 2 3 2 2     2 0 0 2 2 2 2 3      
114. How good is the online help system? 2 2 3 3 2   2 2 2 2 3 1 2 1 2 1 0 0 1 2 0 1 3      
Additional comments on technical support.
115. How easily can the client synch with Palm-OS products?                               0         0   0      
Describe synch options in more detail
Additional comments on palm interoperability.
How easy and intuitive is the installation and configuration process? Are there tools for creating a custom installer?
Is it easy to mess up the configuration.
Do you think the application is sturdy and robust enough to handle configuration problems? Did it crash a lot? Did it auto-recover when the system crashed?
Is the application resource intensive? Did you notice slowdown of your machine during the testing process?
How easy to use is the client? How Intuitive? How much can you change/personalize the user interface?
How end-user friendly do you consider it to be?
How difficult will the learning curve be for a beginning user?
Did the application have the ability to multi-task?
Will cost be a factor for this product?
Other comments.

Please note: This material is no longer current and appears online for archival purposes only.
Use the search and navigation tools above to locate more up-to-date materials, if they exist.
top

Information Systems and Computing
University of Pennsylvania
Comments & Questions


University of Pennsylvania Penn Computing University of Pennsylvania Information Systems & Computing (ISC)
Information Systems and Computing, University of Pennsylvania