The Information Technology Services (ITS) Alerts System is a rapid-delivery method used to distribute timely information on major ITS services, unexpected outages, and maintenance schedules to the Penn State community.
Updated: 53 min 30 sec ago
Schedule changes and information pertaining to Information Technology Services (ITS) during the holiday have been posted at http://its.psu.edu/about/holiday-schedule-changes.
ITS staff resolved the wireless service disruption by 11:30 AM.
In the course of working on a wireless connectivity issue at Telecommunications building last evening. ITS staff made a mistake in a networking change which affected the following buildings listed below. Wireless services have been operational since 11:20 am.
Ag Science Industries
Erickson Food Sciences
Wireless service to the affected buildings have been restored as 6:30 PM.
All networking services disruptions related to the reboot and replacement of the Telecom6 router were resolved by 2:30 PM on Saturday, August 23, 2014.
Around 12:44pm WebAccess started working normally. Staff continue working to determine the cause of the problem.
Sites.psu.edu is currently unreachable. Staff are investigating if it's related to another planned network outage during the maintenance time frame (5am - 7am) or if it's an infrastructure issue on the Sites servers.
On Thursday, August 28, 2014, during the regularly scheduled maintenance window (5:00 a.m. - 7:00 a.m.), Information Technology Services (ITS) will upgrade the DataFlux production server. It is anticipated that this upgrade won't impact normal production hours.
The following service may not be available during the scheduled upgrade:
The issue was found to be backend storage. Sites is currently running; though uploads could be slow for the time being. We will continue to work on this issue tomorrow and keep this alert open in case we need to update it.
The electrical shutdown in the Telecommunications Building has been completed this morning and affected University services have been restored. ITS staff began powering down equipment around 12:45 AM and the power was restored by 1:30 AM. ITS staff began to power on equipment at that time; most services were restored by 2:00 AM. We experienced hardware failure on 2 router cards upon restoring power, and staff worked to replace those cards - that work was completed between 2:30 AM and 7:00 AM.
The sites.psu.edu service is currently down. Staff are investigating the issue.
On Wednesday, August 20, 2014, during the regularly scheduled maintenance window (5:00-7:00 a.m.), Information Technology Services (ITS) will enable IPv6 on the Friends of Penn State website (http://fps.psu.edu). This change should not cause any noticeable loss in service.
A number of library services will be unavailable due to scheduled maintenance on Thursday, August 21, 2014 between 5:00 and 7:00 am EDT. These include:
Libraries Website, Digital images, books and journals accessible through the Digital Collections site: http://www.libraries.psu.edu/psul/digital.html plus Peoples Contest, Les Ãcrits dâAimÃ© CÃ©saire, The Union Catalog of Early Movable Books and Scholarsphere.
Other library services such as The CAT, Course Reserves, A-Z Database List and LionSearch will not be impacted.
ITS staff discovered issues with several cables connected to backup.aset.psu.edu. The failed cabling resulted in the server being unable to communicate with storage hardware. The communication issues lead to the server becoming unresponsive. The failed cables have been replaced. The TSM service on backup.aset.psu.edu resumed function around 12:55 PM.
At 5am this morning DataCenters, Telecommunications and Networking Services (TNS), Services and Solutions (SaS), and Smeal College of Business were working on a planned equipment change intended to remove aging equipment, increase redundancy, and add scalability to the existing network infrastructure. At approximately 6am, a previously undocumented dependency was discovered that resulted in loss of network connectivity for all ITS VMHosting customers. Services were restored at approximately 8:10AM.
There is an after action review scheduled for tomorrow morning to explore any other undocumented dependencies and to re-examine the process to mitigate the risk of future unplanned outages.
We apologize for the disruption of service.
As of 11:50 am today (Friday, August 15), additional database space has been allocated and the server is back in production.
Red Hat resolved their network issues, and the satellite server has rebuilt it\'s repo caches and is now available. Please report any issues you encounter to email@example.com.
From 5:30am until 8:04am the IPv6 addresses for www.psu.edu were not responding due to a network caching error. After clearing the cache, the IPv6 addresses started working as expected.