| Installation | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 1. | How intuitive was the installation process? | ||
| 2. | Are you asked where to store user data on multiple-user machines? | ||
| 3. | Will the client function for a user with restricted access to the system? | ||
| 4. |
What options are allowed (e.g., user's profile area)? |
||
|
Additional comments on installation: |
|||
| Configuration | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 5. | How easily can you configure the client? | ||
| 6. | Does the client have "wizards" to help with the configuration? | ||
| 7. | Can you configure the client to use an external editor when composing or reading messages? | ||
|
Additional comments on configuration: |
|||
| Message Creation | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| Create a message using the following functions and indicate how easily or how well the client performs these functions. | |||
| 8. | Copy/Paste | ||
| 9. | Cut/Paste | ||
| 10. | Word wrapping | ||
| 11. | Realignment or paragraphs | ||
| 12. | Spell-checking | ||
| 13. | Is there a default dictionary for the spell-checker? | ||
| 14. | Can you create a personal dictionary for the spell-checker | ||
| 15. | Search for and replace a word | ||
| 16. | Search forward for a word | ||
| 17. | Search backward for a word | ||
| 18. | Create a signature file | ||
| 19. | Can you create multiple signature files? | ||
| 20. | Create a stationery file | ||
| 21. | Can you create multiple stationery files? | ||
| 22. | Are there options for how/whether to send web formatted messages? | ||
| 23. | Can you create a message and specify a delivery receipt? | ||
| 24. | Can you create a message and specify a precedence header? | ||
| 25. | Can you create a message and specify an expiration date? | ||
| 26. | Can you create a message with a blank "From:" header? | ||
| 27. | Can you blind copy ("Bcc:" mail header) on all sent messages? | ||
|
Additional comments on message creation: |
|||
| Incoming Messages | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 28. | How easily can you read messages? | ||
| 29. | How easily can you open a message using your desktop word processing package? | ||
| 30. | Can you preview a message before you download it to your desktop? | ||
| 31. | In the case where the message line is longer than the reading window, how well does the client handle text wrapping? | ||
| 32. | How well does the client handle printing of messages? | ||
| 33. | Did you receive a delivery receipt for a message that had one? | ||
| 34. | Could you tell the precedence for a message that had one? | ||
| 35. | Could you tell the expiration date for a message that had one? | ||
| Try to delete one of your received messages. | |||
| 36. |
Which of the following best describes what happens to a message
when you delete it? actually deleted marked for deletion moved to a deleted folder none of the above |
||
| 37. | Is there an "undelete" option? | ||
| Try to reply to one of your received messages. | |||
| 38. | How easily can you include the text of the original message in your reply? | ||
| 39. | How easily can you edit the text of the original message in your reply? | ||
| 40. | How easily can you exclude the text of the original message in your reply? | ||
| 41. | When replying to a message and including the text of the original message, try to run the spell-checker on your reply. Does the spell-checker also check the quoted text from the original message? | ||
| Try to forward one of your received messages. | |||
| 42. | How easily can you add a preface to the body of the message? | ||
| 43. | How easily can you change the subject of the message? | ||
| 44. | How easily can you edit the forwarded message? | ||
| 45. | How easily can you bounce/redirect a message? | ||
| 46. | How easily can you resend a message that you already sent? | ||
| 47. | Did you have to create a new message in order to resend a message that you had already sent? | ||
|
Additional comments on incoming messages: |
|||
| Attachments | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| Try to send yourself a message with the following types of attachments and indicate whether you could successfully send them. | |||
| 48. | ASCII text | ||
| 49. | Images | ||
| 50. | Sound files | ||
| 51. | Spreadsheet | ||
| 52. | Word processor file | ||
| 53. | Database file | ||
| 54. | MIME file | ||
| Once you've sent the above messages, how easily can you read them with this client. | |||
| 55. | ASCII text | ||
| 56. | Images | ||
| 57. | Sound files | ||
| 58. | Spreadsheet | ||
| 59. | Word processor file | ||
| 60. | Database file | ||
| 61. | MIME file | ||
| 62. | When you forward a message with an attachment, is the attachment correctly preserved? | ||
| 63. | When you resend a message with an attachment, is the attachment correctly preserved? | ||
|
Additional comments on attachments: |
|||
| Filtering | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 64. | How easily can you create a filter that is triggered by the sender's identity? | ||
| 65. | How easily can you create a filter that is triggered by the text of the message? | ||
| 66. | Can you test multiple conditions when filtering? | ||
| 67. | When testing multiple conditions, must all conditions be met for filtering to work? (e.g., the sender = "joeuser@server.upenn.edu" AND the message contains "testing") | ||
| 68. | When testing multiple conditions, can you opt to only have some condition met? (e.g., the sender = "joeuser@server.upenn.edu" OR the message contains "testing") | ||
| 69. | Can you have multiple actions when filtering? | ||
| 70. | If you don't store local copies of your messages, does filtering still work? | ||
| 71. | How easily can you import/export filters to/from other email applications? | ||
|
Additional comments on filtering: |
|||
| Addressbooks | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 72. | How easily can you lookup an email address in the Public Directory? | ||
| 73. | When you do a search that results in multiple hits, how easily can you tell which email address is the one that you want? | ||
| 74. | When you do a search that results in multiple hits, did you get all possible hits or was there a system limit on how many addresses display? | ||
| 75. | How easily can you add an email address to your addressbook? | ||
| 76. | Could you add the address without having to retype or cut/paste? | ||
| 77. | Is a history of past addresses maintained for auto-completion? | ||
| 78. | Can you edit the history list? | ||
| 79. | How easily can you maintain your own contact list? | ||
| 80. | Can you share your contact list with others? | ||
|
Additional comments on addressbooks: |
|||
| Folders/Mail Storage | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| Are the following mailboxes automatically created by the client? | |||
| 81. | Inbox | ||
| 82. | Sent | ||
| 83. | Trash | ||
| 84. | What other folders are automatically created by the client? | ||
| Can you change the default location for the following mailboxes? | |||
| 85. | Inbox | ||
| 86. | Sent | ||
| 87. | Trash | ||
| Create some folders on both the server and desktop. | |||
| 88. | Are you able to copy a message from one folder on the server to another folder on the server using the "copy" command. | ||
| 89. | Using click-drag-drop, drag an e-mail message from one folder on the server to another folder on the server. Did the message actually move rather than being copied? | ||
| 90. | Using click-drag-drop, drag an e-mail message from one folder on the server to another folder on the desktop. Did the message actually move rather than being copied? | ||
| 91. | How easily can you search a folder on the server and a folder on the desktop for a particular word? | ||
| 92. | Are you able to specify a search order? | ||
| 93. | How easily can you reorganize how messages are listed in a folder? | ||
| 94. |
What format is used for locally stored mail (e.g., Berkeley mail format)? |
95. | How easily can you import/export messages to/from other email applications? |
| 96. | How easily can you resync your folders? | ||
| 97. | Is resynchronization automatic? | ||
| 98. | Can resynchronization be forced? | ||
|
Additional comments on mail storage: |
|||
| Multiple Accounts | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 99. | How easily can you check mail for multiple accounts? | ||
| 100. | How easily can you send mail for multiple accounts? | ||
|
Additional comments on multiple accounts: |
|||
| Security | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 101. | Can you change your password from within the client? | ||
| Does the client support the following protocols? | |||
| 102. | Kerberos with POP | ||
| 103. | Kerberos with IMAP | ||
| 104. | Kerberos with SMTP | ||
| 105. | Kerberos with LDAP | ||
| 106. | Kerberos with NNTP | ||
| 107. | SSL with POP | ||
| 108. | SSL with IMAP | ||
| 109. | SSL with SMTP | ||
| 110. | SSL with LDAP | ||
| 111. | SSL with NNTP | ||
| 112. | How easily can the client be used with PGP? | ||
|
Describe how client responds if SSL is used with a hostname
that does not match the hostname of the security certificate
on server (e.g., home.seas instead of imap.seas): |
|||
|
Additional comments on security: |
|||
| Technical Support | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 113. | Based on review of vendor web site, how well supported does the product seem to be? | ||
| 114. | How good is the online help system? | ||
|
Additional comments on technical support: |
|||
| Palm-OS Interoperability | |||
| Ranking: 0=Client doesn't have this functionality 1=Not very 2=Moderately 3=Very | |||
| 115. | How easily can the client synch with Palm-OS products? | ||
|
Describe synch options in more detail (e.g., can both mail and
addresses be synchronized?): |
|||
|
Additional comments on palm interoperability: |
|||
| Overall Evaluation | |||
|
How easy and intuitive is the installation and configuration
process? Are there tools for creating a custom installer? |
|||
|
Is it easy to mess up the configuration. |
|||
|
Do you think the application is sturdy and robust enough to handle configuration
problems? Did it crash a lot? Did it auto-recover when the system crashed? |
|||
|
Is the application resource intensive? Did you notice slowdown of your machine
during the testing process? |
|||
|
How easy to use is the client? How Intuitive? How much can you
change/personalize the user interface? |
|||
|
How end-user friendly do you consider it to be? |
|||
|
How difficult will the learning curve be for a beginning user? |
|||
|
Did the application have the ability to multi-task? |
|||
|
Will cost be a factor for this product? |
|||
|
Other comments |
|||