To help providers maintain their web sites, link checking and statistics software is run on a regular basis for the following servers:
ISC provides daily activity logs and weekly summary reports for hosted web sites and applications that customers should regularly access.
- For virtual hosts, daily activity logs become available at 12:01 the following day.
- For sites using Akamai, there is a 3 day delay for activity logs due to Akamai’s data delivery schedule.
- By default, logs are sanitized to protect user privacy. However, data is sanitized systematically in order to allow the identification of repeated requests from the same host etc. In the event of suspicious behavior, web developers may contact ISC to obtain full IP addresses.
- Web developers may check logs and reports via a web browser, or may contact ISC to arrange for daily logs to be directly written to a secure directory.
- It is customers' responsibility to monitor these reports for any problems or suspicious activity.
ISC also offers opt-in link error reports that search for problematic links on your web site.
How to access your reports
Access to provider reports is presented via a secure web interface and restricted to authorized providers. To view reports for a particular site within www.upenn.edu, you must have:
Enter your PennKey and password in the area provided, and select the "Submit" button. After successful authentication, you should see a form listing the directories for which you have access. Choose the directory that you wish to view a report for and click "Continue". If a directory for which you should have access is not listed, you can contact email@example.com.
Choosing a report
After you are authenticated, you will see a form listing:
- This Week's Statistics
- Last Week's Statistics
- Request Custom Report
- Request Sanitized Log
When you have finished, select the "Continue" button.
Interpreting the link checker report
Notice: As of Jan 5th, 2008 the "link checker" is a opt-in report
To request that the "link checker" report for your site please contact: firstname.lastname@example.org with the URL of your site.
The link checker report is essentially a list of links which are problematic in your website. If there are no links found to be problematic, your report will be empty.
As a provider, it is important to understand that not every link listed in the report is something that you necessarily need to fix. Links that are out-of-the-ordinary in any way are included in the report. The links are always listed along with the page that contained them, and each link is categorized by the type of problem that was encountered.
Within each category, you will see a list of your own pages. Under each page, indented, is a list of each link within that page which is problematic. In order to debug your website, you are encouraged to view both the pages and the links. If you are unsure if a link should be fixed, you are encouraged to test the link simply by clicking on it.
Below is a list of categories and helpful hints for each of the most common categories:
Interpreting the statistics report
The statistics report contains information regarding hits on your site during a given week. Reports are generated each Saturday morning and are accessible via the provider reports web interface.
The statistics report is divided into 5 sections:
- General Summary
- Successful Requests. This number is commonly referred to as the number of hits your website received during the period. See the definition of a hit for more information.
- Failed Requests. This number shows how many times a viewer of your website recieved an error. The most common error is when a user follows a link in your website and the destination page is removed. User typing the wrong address within your virtual domain name also resolts in errors. Please see the Status Code Report section to see which errors have been generated. Additionally, he list of Failed requests can be found in the Failure Report section.
- Data Transferred. Each hit to your website involves a data transfer between the web server and the web browser. The "Bytes Transmitted" is the total number of characters transferred between the web server and all web browsers which accessed your site.
- Daily Report and Hourly Summary. These are graphs which show how many hits your server recieved in a given time period.
- Domain Report. This section reports on which domain names the viewers of your website came from.
- Status Code Report. This section reports on what status codes your website viewers recieved for every hit. Please see above for explanation of status codes.
- File Size Report. This shows how large your file transfers were for each hit.
- Failure Report. This shows which URLs generated the most failures. Most likely the page has permission errors, or there is a dead link to the page which does not exist any more. You are advised to take a look at failing pages and try to fix the problem
- Request Report. You can see which pages and files were most frequently accessed.
Request a custom report
Custom reports allow you to create adhoc reports for your directory.
Request Sanitized log
Sanitized log provide Apache combined log format with the host information
Your authentication session will enable you to view reports without retyping your username and password for as long as you leave your web browser open. If you wish to end the session, simply click on the "Log Out" button at the bottom of each page, or exit your browser.