 |
 |
 |
|
 |
 |
 |
|
 |
|
|
|||||||||
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Apple Mail 1.2 | X | ||||||||||||||||||||||
| Apple Mail 1.3.x | X | ||||||||||||||||||||||
| Entourage | X | X | X | ||||||||||||||||||||
| Eudora 6.x | X | X | X | X | X | ||||||||||||||||||
| Mozilla 1.6 | X | X | X | X | X | ||||||||||||||||||
| Netscape 7.1 | X | X | X | ||||||||||||||||||||
| Opera 5 | |||||||||||||||||||||||
| Opera 7.23 | X | ||||||||||||||||||||||
| Outlook Professional 2003 | X | X | |||||||||||||||||||||
| Outlook XP | X | ||||||||||||||||||||||
| Outlook Xpress | X | ||||||||||||||||||||||
| Mac OS 9.2x | X | X | X | ||||||||||||||||||||
| Mac OS 10.2.8 | X | X | X | X | X | ||||||||||||||||||
| Mac OS 10.3x | X | X | X | X | X | ||||||||||||||||||
| Windows 2k Pro | X | X | |||||||||||||||||||||
| Windows XP | X | X | X | X | X | X | X | X | |||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 1. Does the client explicity support Authenticated SMTP? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 2. Does the client support Authenticated IMAP/POP (SSL/TLS and/or Kerberos/GSSAPI)? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 3. Does the client support LDAP (simple or authenticated)? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y |
| 4. Does the client have a built-in, trainable spam filtering tool/opton? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | N | N |
| 5. How intuitive was the installation process? | 3 | 0 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 1 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 1 | 3 | |
| 6. Does cleitn support mulitple users by storing data separately? | Y | Y | Y | Y | N | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 7. Rate installation. | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 2 | 1 | 3 | 3 | 3 | 3 | 2 | 3 | 2 | 3 | 2 | 3 |
| Additional comments on installation: | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 8. How easily can you configure the client? | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 2 | 3 | 2 | 2 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 2 | 3 | |
| 9. Rate configuration. | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 2 | 3 | 2 | 2 | 3 | 2 | 2 | 2 | 3 | 3 | 3 | 2 | 3 | |
| Additional comments on configuration: | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 10. Type a known recipient in the To: field and check evaluate autocompletion of address | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 1 | 1 | 3 | |
| 11. Realignment of paragraphs There was lots of confusion about what is realignment and in what context. Elaborations should be made for this question in the future. |
3 | 3 | 0 | 3 | 2 | 3 | 0 | 3 | 3 | 2 | 3 | 3 | 3 | 1 | 3 | 2 | 3 | 3 | 0 | 3 | 3 | 3 | 0 |
| 12. Spell-checking | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 0 | 3 | 3 | 3 | 0 | 3 | 3 | 3 | 2 |
| 13. Create a signature file Some of the clients can't create a signature file but they do allow you to opt to use one that you've created outside of the app. |
3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 3 | 3 | 2 | 0 | 2 | 2 | 0 | 0 | 3 | 3 | 3 | 3 | 3 |
| 14. Can you create multiple signature files? Some of the clients can't create a signature file but they do allow you to opt to use one that you've created outside of the app. |
Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | N | Y | Y | Y | Y | |||
| 15. Are there options for how/whether to send web formatted messages? This is a system-wide configuration option rather than a message-by-message option. Some testers anticipated that since this was asked in the message creation section, that the option would be per message. |
Y | Y | Y | Y | Y | N | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y |
| 16. Can you blind copy ("Bcc:" mail header) on all sent messages? This is a system-wide configuration option rather than a message-by-message option. Some testers anticipated that since this was asked in the message creation section, that the option would be per message. |
N | Y | N | Y | Y | Y | Y | Y | N | N | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | |
| 17. HTML file - how easily is the HTML file sent as a file, rather than being displayed in-line? | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 2 | 2 | 2 | 2 | 2 | 3 | 3 | 3 | 3 | 3 |
| 18. Image - how easily is the image sent as a file, rather than being displayed in-line? | 1 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 3 | 2 | 2 | 1 | 3 | 3 | 3 | 3 | |
| 19. When you forward a message with an attachment, is the attachment correctly preserved? | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 0 | 3 | 2 | 2 | 2 | 3 | 3 | 3 | 3 |
| 20. When you bounce/redirect a message with an attachment, is the attachment correctly preserved? Some testers did not understand the concept of bouncing. They thought forwarding was the same as bouncing. |
Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | N | Y | N | Y | Y | |||||||
| 21. Does the client keep the attachment with the original message? This question was testing whether the client stores the attachment in a separate file. That was not evident from the question. |
Y | Y | Y | Y | Y | N | N | N | Y | Y | Y | Y | Y | Y | N | N | Y | Y | Y | Y | Y | ||
| 22. Rate message creation. | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 3 | 3 |
| Additional comments on message creation. | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 23. How easily can you display the full headers of a message? | 3 | 3 | 2 | 3 | 1 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 3 | 1 | 1 | 3 | 1 |
| 24. In the case where the message line is longer than the reading window, how well does the client handle text wrapping? | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 2 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 |
| 25. How easily can you "undelete" messages? | 1 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 |
| 26. Is there a tool to unquote/requote text? Mozilla and Netscape can quote text but not unquote. Eudora has tools but they are not intuitive. |
N | Y | N | Y | Y | Y | N | Y | N | Y | Y | N | Y | Y | N | N | Y | Y | N | N | N | N | N |
| 27. Is there a tool to rejustify text? Mozilla, Netscape, and Eudora have tools but they are not intuitive. |
N | Y | N | Y | Y | Y | N | Y | N | Y | Y | Y | Y | N | Y | Y | N | N | N | Y | Y | N | |
| 28. This question was eliminated since there isn't an instance where one would want to send the full headers when replying to a message. |
3 | 3 | 1 | 2 | 3 | 0 | 3 | 1 | 1 | 1 | 2 | 2 | 1 | 2 | 0 | 0 | 1 | 2 | 1 | ||||
| 29. When replying to a message and including the text of the original message, does the spell-checker ignore the quoted text from the original message? This is not a default option but it can be configured. |
Y | N | N | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | N | N | Y | Y | Y | |||||
| 30. How easily can you bounce/redirect a message? Some testers did not understand the concept of bouncing. They thought forwarding was the same as bouncing. |
3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 3 | 3 | 0 | |||||
| 31. How easily can you include the full headers of the message that you forward? There is a tool but it is not intuitive. |
3 | 3 | 1 | 2 | 1 | 3 | 0 | 3 | 2 | 1 | 1 | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 1 | 1 | 1 | ||
| 32. How easily can you check/send mail for multiple accounts? | 3 | 3 | 3 | 3 | 3 | 1 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | |
| 33. Rate incoming/outgoing messages. | 3 | 3 | 2 | 3 | 2 | 2 | 2 | 3 | 3 | 2 | 2 | 3 | 2 | 2 | 2 | 2 | 3 | 2 | 2 | 2 | 2 | 2 | |
| Additional comments on incoming/outgoing message. | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 34. How easily can you create a simple filter? | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 2 | 3 | 2 | 2 | |
| 35. How easily can you create a complex filter? | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 1 | 1 | ||
| 36. Does it support server-side filtering (.i.e., sieve)? Some testers did not understand the concept of server-side filtering. |
Y | N | N | Y | N | N | Y | N | Y | N | N | N | N | N | N | ||||||||
| 37. Can a filter direct messages into a server-side folder? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | |||
| 38. Does it have a mechanism to import/export filters to/form other email applications? | Y | N | Y | N | Y | N | N | Y | N | N | Y | Y | Y | N | Y | Y | N | Y | Y | Y | N | ||
| 39. Rate filtering. | 3 | 3 | 3 | 3 | 2 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 3 | 2 | 2 | 1 | 1 | ||
| Additional comments on filtering: | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 40. How easy is it to mark a message as junk/not junk? | 3 | 3 | 1 | 1 | 2 | 3 | 3 | 2 | 3 | 0 | 3 | 3 | 0 | 0 | 3 | 3 | 0 | 2 | 1 | 1 | 0 | ||
| 41. How easy is it to change the junk threshhold? Some testers did not understand what a junk threshhold is. |
3 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 2 | 1 | 3 | 0 | 0 | 1 | 0 | 0 | 3 | 1 | 3 | 0 | 0 | ||
| 42. How easy is it to dig out false positives? | 3 | 3 | 3 | 2 | 2 | 3 | 3 | 2 | 3 | 3 | 3 | 2 | 0 | 2 | 2 | 2 | 2 | 2 | 2 | 1 | 0 | ||
| 43. Does it follow embedded HTML image tags (used by spam harvesters)? AppleMail will follow tags if the message has not been identified as spam. |
N | Y | N | Y | N | Y | N | Y | N | N | Y | Y | |||||||||||
| 44. Rate spam filtering. | 3 | 3 | 2 | 2 | 2 | 3 | 3 | 1 | 2 | 2 | 3 | 3 | 0 | 2 | 3 | 2 | 1 | 2 | 2 | 1 | 0 | ||
| Additional comments on spam filtering: | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 45. How easily can you lookup an email address in the Public Directory? | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 0 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 0 | 2 | 2 | 2 | 2 | ||
| 46. How easily can you add an email address to your addressbook? | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 2 | 3 | ||
| 47. How easily does your client's address book inegrate with other application or OS address books (importing/exporting)? | 3 | 3 | 2 | 2 | 2 | 1 | 0 | 3 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 3 | 2 | 2 | 2 | 2 | |||
| 48. Rate address books. | 3 | 3 | 3 | 3 | 3 | 2 | 2 | 2 | 3 | 2 | 3 | 3 | 3 | 3 | 2 | 2 | 2 | 2 | 2 | 2 | |||
| Additional comments on address books. | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 49. Can you change the default location - Sent | N | N | Y | Y | Y | Y | N | N | N | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y |
| 50. Can you change the default location - Trash | N | N | Y | Y | Y | Y | Y | N | N | Y | N | N | N | N | N | Y | Y | Y | N | N | N | N | |
| 51. How easily can you move, copy, and drag/drop between local and network folders? | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | ||
| 52. How easily can you search a folder on the server and a folder on the desktop for a particular word? | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 2 | 3 | 3 | 2 |
| 53. This question was eliminated since this function is automatic and because there is no option to do it, testers will incorrectly score negative. |
3 | 3 | 3 | 2 | 2 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 2 | 0 | 1 | 0 | 0 | 0 | 3 | 3 | |||
| 54. How easily can you import/export messages to/from other email applications? | 3 | 3 | 1 | 3 | 3 | 3 | 1 | 0 | 3 | 2 | 1 | 3 | 3 | 2 | 3 | 2 | 2 | 2 | 3 | 1 | 3 | 2 | 1 |
| 55. Is subscribing to new folders automatic? | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 3 | 1 | 1 | 1 | 3 | 0 | 3 | 3 | 3 | 1 | 1 | 3 | 3 | |
| 56. Rate folders/mail storage. | 3 | 3 | 2 | 3 | 3 | 3 | 2 | 2 | 3 | 2 | 2 | 3 | 2 | 2 | 3 | 3 | 2 | 2 | 3 | 2 | 3 | ||
| Additional comments on folders/mail storage. | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 57. Kerberos/GSSAPI with POP | Y | Y | N | N | N | Y | Y | Y | Y | Y | N | N | N | N | N | N | N | N | Y | Y | N | N | N |
| 58. Kerberos/GSSAPI with IMAP | Y | Y | N | N | N | Y | Y | Y | Y | Y | N | N | N | N | N | N | N | N | Y | Y | N | N | N |
| 59. Kerberos/GSSAPI with SMTP | Y | Y | N | N | N | Y | Y | Y | Y | Y | N | N | N | N | N | N | N | N | Y | Y | N | N | N |
| 60. Kerberos/GSSAPI with LDAP | Y | Y | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | ||
| 61. SSL/TLS with POP | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | |
| 62. SSL/TLS with IMAP | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 63. SSL/TLS with SMTP | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 64. SSL/TLS with LDAP | Y | Y | Y | Y | N | N | N | N | N | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | |
| 65. How easily can the client be used with PGP/GPG? | 1 | 0 | 1 | 1 | 0 | 2 | 2 | 3 | 1 | 2 | 1 | 1 | 0 | 2 | 3 | 3 | 0 | ||||||
| 66. Rate security. | 3 | 3 | 2 | 3 | 2 | 3 | 2 | 2 | 3 | 2 | 2 | 2 | 3 | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 3 | 2 | 2 |
| Additional comments on security. | |||||||||||||||||||||||
| User | 14 | 2 | 5 | 7 | 13 | 6 | 8 | 10 | 15 | 20 | 1 | 4 | 12 | 17 | 22 | 9 | 18 | 19 | 16 | 11 | 23 | 21 | 3 |
| 67. How easily does this client handle uninstallation and preserve (not destroy!) user data folders or files? | 3 | 0 | 2 | 3 | 0 | 3 | 1 | 2 | 3 | 3 | 2 | 3 | 1 | 3 | 3 | 2 | 3 | 3 | 3 | 1 | 3 | 2 | |
| 68. Rate uninstallation. | 3 | 0 | 2 | 3 | 0 | 3 | 1 | 2 | 3 | 3 | 2 | 3 | 3 | 3 | 3 | 2 | 3 | 3 | 3 | 1 | 3 | 2 | |
| Additional comments on uninstallation: | |||||||||||||||||||||||
| How easy and intuitive is the installation and configuration process? Are there tools for creating a custom installer? | |||||||||||||||||||||||
| Did it crash a lot? Did it auto-recover when the system crashed? | |||||||||||||||||||||||
| Is the application resource intensive? Did you notice slowdown of your machine during the testing process? | |||||||||||||||||||||||
| How user friendly is the client? How much can you change/personalize the user interface? | |||||||||||||||||||||||
| How good is the online help system? | |||||||||||||||||||||||
| Palm-OS Interoperability: Does the client sync email and address book data? | |||||||||||||||||||||||
| Will cost be a factor for this product? | |||||||||||||||||||||||
| Other comments | |||||||||||||||||||||||
|
 |
|
|
 |
|
| Information Systems and ComputingUniversity of PennsylvaniaComments & Questions |
 |
|