Server-side Concerns:
- Software Requirements & Platform Support
- Platform Performance/Resource Usage
- Virtual Support
- Security Support
- Session Management
- Protocol Support
- Configurability
Server Script
- Assemble component software, compile and configure on Windows
NT, Linux,
Tru64 UNIX, Solaris with IIS, Apache, Netscape Enterprise/Fastrack,
or proprietary
server.
- Was any trouble encountered with the install?
- Did you compile or did it come with precompiled binaries?
- Was any software involved that excludes it from
consideration?
- Was there any difficulty encountered in the base level
configuration
and launch of the software?
- How was the documentation on the installation procedure?
- Did you see any obvious security holes in the setup of the
product?
- Log on to the administrative console and configure support for
a single
server instance.
- Is the console web-based, terminal-based or both?
- Was the console intuitive and complete? Was it
necessary to
do custom configuration on a lower level?
- Any conflict with other processes on system?
- Start a client session and check to see that everything is in
working
order
- Monitor system logs and software error logs for
imapd/mail/software
errors.
- Monitor system load levels.
- How exactly is the product allocating resources?
- Was it a CGI-based product?
- Was it integrated into the webserver on any level?
- Send mail and attachments, retrieve mail and attachments,
delete mail,
move messages, forward, etc. and check for errors.
- Configure the server with multiple servers instances.
- How difficult was this?
- Was this within the supported configuration parameters or did
you have
to do additional work?
- What security protocols does product support?
- Kerberos V4 or V5
- SSL
- SMTP Authentication
- How does it store user data such as addressbooks, preferences,
productivity
information, etc.?
- Database? If so, what db products does it support.
- Flat file?
- None?
- Can the data be stored elsewhere (LDAP, e.g.)?
- What type of session does the product use?
- Cookies? If so, can you manage cookies configuration in
administrative
console?
- Tokens/Tickets? If so, custom-based or standards-based?
- Does the product support POP3 and/or IMAP?
- If yes to POP3, how does it support POP3?
- Is the use of POP3 a server specific
configuration option
or a user preference?
- If the POP server has been configured to retain the
POP_DROP file,
is the file retained?
- If yes to IMAP, how does it support IMAP?
- How does it support IMAP preferences like
purging, deletion,
folder creation, deletion and subscription and manipulation
of messages
between folders?
- Does it let you configure a default subdirectory in the
user's folder
to store message folders in?
- How is accouting information stored?
- Can the administrator customize the user interface (banners, graphics, etc.)?
- Was the product intended to be customized?
- How difficult/easy is it to do this?
- Is it written in HTML or does it use some other scripting
language?
- Is source code available?
- If yes, how difficult is it to patch code?
- What other features are supported that have not already been noted in our comments on the product?
|