| Basic Show Stopper Questions: (if the client doesn't have the following features, it fails our requirements and won't be supported or recommended - i.e. you don't need to finish testing) | ||
| Per Question Rating: Yes or No | ||
| 1. | Does the client explicitly support Authenticated SMTP? | |
| 2. | Does the client support "Authenticated" IMAP/POP (SSL/TLS and/or Kerberos/GSSAPI)? | |
| 3. | Does the client support LDAP (simple or authenticated)? | |
| 4. | Does the client have a built-in, trainable spam filtering tool/option? | |
|
||
Continue on with the rest of the evaluation if the client passed these first four questions. |
||
| Installation | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 5. | How intuitive was the installation process? | |
| 6. | Are you asked where to store user data on multiple-user machines? Yes or No | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
|
Please rate the client's overall performance for this category and provide
detailed comments pertaining to the
above questions: |
||
| Configuration | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 7. | How easily can you configure the client? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
|
Please rate the client's overall performance for this category and provide
detailed comments pertaining to the
above question: |
||
| Message Creation | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| To: Fields: Rate how easily or how well the client performs these functions. | ||
| 8. | Type a known recipient in the To: field and check evaluate auto-completion of address | |
| Message body: create a message using the following functions and indicate how easily or how well the client performs these functions. | ||
| 9. | Realignment of paragraphs (re-justify) | |
| 10. | Spell-checking (as you type or when sending?) | |
| 11. | Create a signature file | |
| 12. | Can you create multiple signature files? | |
| 13. | Are there options for how/whether to send web formatted messages? | |
| 14. | Can you blind copy ("Bcc:" mail header) on all sent messages? | |
| Attachments: | ||
| Upon receipt of a message, how easily can you read/save them with this client. | ||
| 15. | HTML file - how easily is the HTML file sent as a file, rather than being displayed in-line? | |
| 16. | Image - how easily is the image sent as a file, rather than being displayed in-line? | |
| 17. | When you forward a message with an attachment, is the attachment correctly preserved? | |
| 18. | When you bounce/redirect a message with an attachment, is the attachment correctly preserved? | |
| 19. | Does the client keep the attachments with the original message? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Incoming/Outgoing Messages | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 20. | How easily can you display the full headers of a message? | |
| 21. | In the case where the message line is longer than the reading window, how well does the client handle text wrapping? | |
| Try to delete one of your received messages. | ||
| 22. | How easily can you undelete messages? | |
| Try to reply to one of your received messages. | ||
| 23. | Is there a tool to unquote/requote text? Yes or No | |
| 24. | Is there a tool to rejustify text? Yes or No | |
| 25. | How easily can you include the full headers of the message in your reply? | |
| 26. | When replying to a message and including the text of the original message, does the spell-checker ignore the quoted text from the original message? Yes or No | |
| Try to forward/redirect one of your received messages. | ||
| 27. | How easily can you bounce/redirect a message? | |
| 28. | How easily can you include the full headers of the message that you forward? | |
| Multiple Accounts | ||
| 29. | How easily can you check/send mail for multiple accounts? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Filtering | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 30. | How easily can you create a filter? (simple) | |
| 31. | How easily does it do complex filtering? | |
| 32. | Does it support server-side filtering (i.e. sieve)? Yes or No | |
| 33. | Can a filter direct messages into a server-side folder? Yes or No | |
| 34. | Does it have a mechanism to import/export filters to/from other email applications? Yes or No | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Address Books | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 35. | How easily can you lookup an email address in the Public Directory (LDAP auto-completion)? | |
| 36. | How easily can you add an email address to your addressbook? | |
| 37. | How easily does your client's address book integrate with other application or OS address books (importing/exporting)? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Spam Filtering | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 38. | How easy is it to mark a message as junk/not junk? | |
| 39. | How easy is it to change the junk threshhold? | |
| 40. | How easy is it to dig out false positives? | |
| 41. | How easily can you turn off following of embedded html image tags (used by spam harvesters)? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Folders/Mail Storage | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Can you change the default location for the following mailboxes? | ||
| 42. | Sent - Yes or No | |
| 43. | Trash - Yes or No | |
| Create some folders on both the server and desktop. | ||
| 44. | How easily can you move, copy, and drag/drop between local and network folders? | |
| 45. | How easily can you search a folder on the server and a folder on the desktop for a particular word? | 46. | How easily can you import/export messages to/from other email applications? |
| 47. | How easily can you resync your folders (new folders/deleted folders)? | |
| 48. | Is subscribing to new folders automatic? Yes or No | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Security | ||
| Per Question Rating: Yes or No | ||
| Does the client support the following protocols? | ||
| 49. | Kerberos/GSSAPI with POP | |
| 50. | Kerberos/GSSAPI with IMAP | |
| 51. | Kerberos/GSSAPI with SMTP | |
| 52. | Kerberos/GSSAPI with LDAP | |
| 53. | SSL/TLS with POP | |
| 54. | SSL/TLS with IMAP | |
| 55. | SSL/TLS with SMTP | |
| 56. | SSL/TLS with LDAP | |
| 57. | How easily can the client be used with PGP/GPG? - rate 0-3 based on "Category Rating" scale below |
|
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Uninstallation | ||
| Per Question Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| 58. | How easily does this client handle uninstallation and preserve (not destroy!) user data (local folders, address books, filters, preferences)? | |
| Category Rating: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | ||
| Please rate the client's overall performance for this category and provide detailed comments pertaining to the above questions: | ||
| Overall Evaluation | ||
|
How easy and intuitive is the installation and configuration
process? Are there tools for creating a custom installer? |
||
|
Did it crash a lot? Did it auto-recover when the client crashed? |
||
|
Is the application resource intensive? Did you notice slowdown of your machine
during the testing process? |
||
|
How user friendly is the client? How much can you
change/personalize the user interface? |
||
| How good is the online help system? |
||
| Palm-OS Interoperability: Does the client sync email and address book data? | ||
|
Will cost be a factor for this product? |
||
|
Other comments |
||