| Name: |
|
| E-Mail Address: |
|
| Date: |
|
| Please choose the product you are testing
and the operating system of the machine on which you are testing. If your
environment is not included in the following select lists, please do
not proceed but notify the
group about the discrepancy. |
| Product and Version Being Evaluated:
|
|
| OS and Version used for Testing:
|
|
| |
| Basic Requirements |
| If the client doesn't have the following features, it fails our requirements and probably won't be supported or recommended. |
| |
| |
1. |
Does the client explicitly support Authenticated SMTP?
|
Untested
No
Yes
|
| |
2. |
Does the client support "Authenticated" IMAP/POP (SSL/TLS and/or Kerberos/GSSAPI)?
|
Untested
No
Yes
|
| |
3. |
Does the client support LDAP (simple or authenticated)?
|
Untested
No
Yes
|
| |
4. |
Does the client have a built-in, trainable spam filtering tool/option?
|
Untested
No
Yes
|
| |
| |
| Installation |
| |
| |
5. |
How intuitive was the installation
process? |
Untested
N/A
Not very
Moderately
Very
|
| |
6. |
Are you asked where to store user data on multiple-user
machines? |
Untested
No
Yes
|
| |
7. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on installation:
|
| |
| Configuration |
| |
| |
8. |
How easily can you configure the client? |
Untested
N/A
Not very
Moderately
Very
|
| |
9. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on configuration:
|
| |
| Message Creation |
| |
| To: Fields: Rate how easily or how well
the client performs these functions. |
| |
10. |
Type a known recipient in the To: field and
evaluate autocompletion of address |
Untested
N/A
Not very
Moderately
Very
|
| |
| Message body: create a message using
the following functions and indicate how easily or how well the client performs
these functions. |
| |
11. |
Realignment or paragraphs |
Untested
N/A
Not very
Moderately
Very
|
| |
12. |
Spell-checking |
Untested
N/A
Not very
Moderately
Very
|
| |
13. |
Create a signature file |
Untested
N/A
Not very
Moderately
Very
|
| |
14. |
Can you create multiple signature files? |
Untested
No
Yes
|
| |
15. |
Are there options for how/whether to send web formatted
messages? |
Untested
No
Yes
|
| |
16. |
Can you blind copy ("Bcc:" mail header) on all
sent messages? |
Untested
No
Yes
|
| |
| Attachments: Upon receipt of a message, how easily can you read/save them with this client. |
| |
17. |
HTML file - how easily is the HTML file sent as a file, rather than being displayed in-line? |
Untested
N/A
Not very
Moderately
Very
|
| |
18. |
Image - how easily is the image sent as a file, rather than being displayed in-line? |
Untested
N/A
Not very
Moderately
Very
|
| |
19. |
When you forward a message with an attachment,
is the attachment correctly preserved? |
Untested
N/A
Not very
Moderately
Very
|
| |
20. |
When you bounce/redirect a message with an attachment, is
the attachment correctly preserved? |
Untested
No
Yes
|
| |
21. |
Does the client keep the attachments with the original message?
|
Untested
No
Yes
|
| |
22. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on message creation:
|
| |
| Incoming Messages |
| |
| |
23. |
How easily can you display the full headers of
a message? |
Untested
N/A
Not very
Moderately
Very
|
| |
24. |
In the case where the message line is longer than
the reading window, how well does the client handle text wrapping? |
Untested
N/A
Not very
Moderately
Very
|
| |
| Try to delete one of your received messages.
|
| |
25. |
How easily can you "undelete" messages? |
Untested
N/A
Not very
Moderately
Very
|
| |
| Try to reply to one of your received
messages. |
| |
26. |
Is there a tool to unquote/requote text? |
Untested
No
Yes
|
| |
27. |
Is there a tool to rejustify text? |
Untested
No
Yes
|
| |
28. |
How easily can you include the full headers of
the message in your reply? |
Untested
N/A
Not very
Moderately
Very
|
| |
29. |
When replying to a message and including the text
of the original message, does the spell-checker ignore the quoted text from the original message?
|
Untested
No
Yes
|
| |
| Try to forward one of your received messages.
|
| |
30. |
How easily can you bounce/redirect a message? |
Untested
N/A
Not very
Moderately
Very
|
| |
31. |
How easily can you include the full headers of
the message that you forward? |
Untested
N/A
Not very
Moderately
Very
|
| |
| Multiple Accounts.
|
| |
32. |
How easily can you check/send mail for multple accounts? |
Untested
N/A
Not very
Moderately
Very
|
| |
33. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on incoming/outgoing messages:
|
| |
| Filtering |
| |
| |
34. |
How easily can you create a simple filter? |
Untested
N/A
Not very
Moderately
Very
|
| |
35. |
How easily can you create a complex filter? |
Untested
N/A
Not very
Moderately
Very
|
| |
36. |
Does it support server-side filtering (i.e., sieve)? |
Untested
No
Yes
|
| |
37. |
Can a filter direct messages into a server-side folder? |
Untested
No
Yes
|
| |
38. |
Does it have a mechanism to import/export filters to/from other email applications? |
Untested
No
Yes
|
| |
39. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on filtering:
|
| |
| Spam Filtering |
| |
| |
40. |
How easy is it to mark a message as junk/not junk? |
Untested
N/A
Not very
Moderately
Very
|
| |
41. |
How easy is it to change the junk threshhold? |
Untested
N/A
Not very
Moderately
Very
|
| |
42. |
How easy is it to dig out false positives? |
Untested
N/A
Not very
Moderately
Very
|
| |
43. |
Does it follow embedded HTML image tags (used by spam harvesters? |
Untested
No
Yes
|
| |
44. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on spam filtering:
|
| |
| Address Books |
| |
| |
45. |
How easily can you lookup an email address in the
Public Directory? |
Untested
N/A
Not very
Moderately
Very
|
| |
46. |
How easily can you add an email address to your
addressbook? |
Untested
N/A
Not very
Moderately
Very
|
| |
47. |
How easily does your client's address book integrate
with other application or OS address books (importing/exporting)? |
Untested
N/A
Not very
Moderately
Very
|
| |
48. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on address books:
|
| |
| Folders/Mail Storage |
| |
| Can you change the default location for
the following mailboxes? |
| |
| |
49. |
Sent |
Untested
No
Yes
|
| |
50. |
Trash |
Untested
No
Yes
|
| |
| Create some folders on both the server
and desktop. |
| |
51. |
How easily can you move, copy, and drag/drop between
local and network folders? |
Untested
N/A
Not very
Moderately
Very
|
| |
52. |
How easily can you search a folder on the server
and a folder on the desktop for a particular word? |
Untested
N/A
Not very
Moderately
Very
|
| |
53. |
How easily can you resync your folders? |
Untested
N/A
Not very
Moderately
Very
|
| |
54. |
How easily can you import/export messages to/from other email applications? |
Untested
N/A
Not very
Moderately
Very
|
| |
55. |
Is subscribing to new folders automatic? |
Untested
N/A
Not very
Moderately
Very
|
| |
56. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on folders/mail storage:
|
| |
| Security |
| |
| Does the client support the following
protocols? |
| |
57. |
Kerberos/GSSAPI with POP |
Untested
No
Yes
|
| |
58. |
Kerberos/GSSAPI with IMAP |
Untested
No
Yes
|
| |
59. |
Kerberos/GSSAPI with SMTP |
Untested
No
Yes
|
| |
60. |
Kerberos/GSSAPI with LDAP |
Untested
No
Yes
|
| |
61. |
SSL/TLS with POP |
Untested
No
Yes
|
| |
62. |
SSL/TLS with IMAP |
Untested
No
Yes
|
| |
63. |
SSL/TLS with SMTP |
Untested
No
Yes
|
| |
64. |
SSL/TLS with LDAP |
Untested
No
Yes
|
| |
65. |
How easily can the client be used with PGP/GPG? |
Untested
N/A
Not very
Moderately
Very
|
| |
66. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on security:
|
| |
| Uninstallation |
| |
| |
67. |
How easily can the client handle uninstallation and preserve (not destroy!) user data (local folders, address books, filters, preferences)?
|
Untested
N/A
Not very
Moderately
Very
|
| |
68. |
Please rate the client's overall performance for this category. |
Untested
N/A
Not very
Moderately
Very
|
| |
Additional comments on uninstallation:
|
| |
| Overall Evaluation |
| |
How easy and intuitive is the installation
and configuration process? Are there tools for creating a custom installer?
|
| |
Did it crash a lot?
Did it auto-recover when the system crashed?
|
| |
Is the application resource intensive?
Did you notice slowdown of your machine during the testing process?
|
| |
How user friendly is the client?
How much can you change/personalize the user interface?
|
| |
How good is the online help system?
|
| |
Palm-OS Interoperability: Does the client sync email and address book data?
|
| |
Will cost be a factor for this product?
|
| |
Other comments
|
