The Information Technology Services (ITS) Alerts System is a rapid-delivery method used to distribute timely information on major ITS services, unexpected outages, and maintenance schedules to the Penn State community.
Updated: 23 min 53 sec ago
ITS staff has been working to resolve the remaining network disruptions. During investigation, we identified a symptom that required the router to be rebooted again. The reboot occurred at 9:50 PM and most services were restored by 10:00 PM. ITS will be working with customers to restore the networking services that remain disrupted.
On Thursday, August 28, 2014, during the regularly scheduled maintenance window (5:00 a.m. - 7:00 a.m.), Information Technology Services (ITS) will upgrade the DataFlux production server. It is anticipated that this upgrade won't impact normal production hours.
The following service may not be available during the scheduled upgrade:
The issue was found to be backend storage. Sites is currently running; though uploads could be slow for the time being. We will continue to work on this issue tomorrow and keep this alert open in case we need to update it.
The electrical shutdown in the Telecommunications Building has been completed this morning and affected University services have been restored. ITS staff began powering down equipment around 12:45 AM and the power was restored by 1:30 AM. ITS staff began to power on equipment at that time; most services were restored by 2:00 AM. We experienced hardware failure on 2 router cards upon restoring power, and staff worked to replace those cards - that work was completed between 2:30 AM and 7:00 AM.
The sites.psu.edu service is currently down. Staff are investigating the issue.
On Wednesday, August 20, 2014, during the regularly scheduled maintenance window (5:00-7:00 a.m.), Information Technology Services (ITS) will enable IPv6 on the Friends of Penn State website (http://fps.psu.edu). This change should not cause any noticeable loss in service.
A number of library services will be unavailable due to scheduled maintenance on Thursday, August 21, 2014 between 5:00 and 7:00 am EDT. These include:
Libraries Website, Digital images, books and journals accessible through the Digital Collections site: http://www.libraries.psu.edu/psul/digital.html plus Peoples Contest, Les Ãcrits dâAimÃ© CÃ©saire, The Union Catalog of Early Movable Books and Scholarsphere.
Other library services such as The CAT, Course Reserves, A-Z Database List and LionSearch will not be impacted.
ITS staff discovered issues with several cables connected to backup.aset.psu.edu. The failed cabling resulted in the server being unable to communicate with storage hardware. The communication issues lead to the server becoming unresponsive. The failed cables have been replaced. The TSM service on backup.aset.psu.edu resumed function around 12:55 PM.
At 5am this morning DataCenters, Telecommunications and Networking Services (TNS), Services and Solutions (SaS), and Smeal College of Business were working on a planned equipment change intended to remove aging equipment, increase redundancy, and add scalability to the existing network infrastructure. At approximately 6am, a previously undocumented dependency was discovered that resulted in loss of network connectivity for all ITS VMHosting customers. Services were restored at approximately 8:10AM.
There is an after action review scheduled for tomorrow morning to explore any other undocumented dependencies and to re-examine the process to mitigate the risk of future unplanned outages.
We apologize for the disruption of service.
As of 11:50 am today (Friday, August 15), additional database space has been allocated and the server is back in production.
Red Hat resolved their network issues, and the satellite server has rebuilt it\'s repo caches and is now available. Please report any issues you encounter to firstname.lastname@example.org.
From 5:30am until 8:04am the IPv6 addresses for www.psu.edu were not responding due to a network caching error. After clearing the cache, the IPv6 addresses started working as expected.
The Microsoft IT Academy eLearning service is currently unavailable. This means you will not be able to log in to the service or access the eLearning content and tutorials at this time. We are working with Microsoft to make the service available as soon as possible and anticipate a fix from them early next week.
The ITS Streaming Service will be unavailable during the 5am to 7am maintenance window on Aug 12, 2014. During this time, technical staff will be performing hardware maintenance on the servers that provide this service. We expect the service to be fully available by 7am.
Beginning Friday, August 8, 2014, after 6:00 p.m. and continuing until 5:00 a.m. Monday, August 11, 2014, Information Technology Services (ITS) will perform routine maintenance on the Access Account authentication servers. During this time password changes (https://www.work.psu.edu/password/) may take up to two hours to complete. Users may wish to avoid password changes during this maintenance period. Alternatively, if you choose to change your password this weekend, the changes will be queued and should be processed within two hours. The old password will continue to work until the changes are processed.
On Monday, August 11th, beginning at 3:00AM and ending at 4:00AM, OPP will be performing maintenance on the electrical panel at Pollock Hall. During this work, all data,voice and video services will be disrupted to all the buildings that are served out of the Pollock hubsite.
ITS staff will be on site in case any unknown issues occur, we appreciate your patience and if you have any questions, please feel free to contact the Network Operations Center.
The server upgrade was successful. Testing was completed at 9:09am.
The problem of some Windows computers not being able to map PASS network drives is recurring today. New thoughts are that this may not be just CLM Windows builds but perhaps anyone connecting to \\\\win.pass.psu.edu and may have to do with the load balancer in front of the SMB gateways. We have one example of rebooting the client not helping. Users needing files from their PASS space and no access to another computer that can map PASS, can download them from https://webfiles.psu.edu.
First phase for the WebAccess Update was completed this morning.