Title: SDSC Outage Report – 13 January 2015, 0530-0610 – Project StorageDescription: SDSC Project Storage encountered an outage this morning (Tuesday 2015.01.13) between 5:30A-6:10A. If you had jobs running during that time please verify that they completed successfully. The following NFS and Samba shares were affected: ps-017.sdsc.edu:/ps-data/bglab ps-027.sdsc.edu:/ps-data/brain_observatory ps-002.sdsc.edu:/ps-data/camera ps-030.sdsc.edu:/ps-data/colemanlab ps-018.sdsc.edu:/ps-data/cwphs ps-032.sdsc.edu:/ps-data/dom ps-013.sdsc.edu:/ps-data/dsc ps-001.sdsc.edu:/ps-data/lca ps-003.sdsc.edu:/ps-data/matta2 …
Category Archive: Incident Notification
SDSC Outage Notification – 10 Dec 2014, 17:00-17:33 – Core NFS services
Title: SDSC Outage Notification – 10 Dec 2014, 17:00-17:33 – Core NFS servicesDescription: At approximately 17:00, the core NFS fileserver ‘cavern’ became unresponsive. Engineers successfully rebooted the server and restored service at 17:33. Services potentially affected: – hosted web services – managed Linux virtual machines – managed Linux physical systems – incoming @sdsc.edu emailStart Time: …
SDSC Outage Notification – VMWare – 4 Nov 2014, 19:00
Title: SDSC Outage Notification – VMWare – 4 Nov 2014, 19:00 Update: 5 Nov 2014, 01:35 All services have been restored. Please contact SDSC support with any questions or concerns. Update: 5 Nov 2014, 01:20 Citrix, Sharepoint and Printing services have been restored. Update: 5 Nov 2014, 01:15 Commvault services have been restored. Linux guests …
SDSC Outage Notification – mysql – 2 Nov 2014, 01:30
Title: SDSC Outage Notification – mysql – 2 Nov 2014, 01:30Update 7:15, 2 Nov 2014: All services have been restoredDescription: SDSC is experiencing an outage of the production mysql services on ‘mysql2.sdsc.edu’. Engineers are investigating.Date: 2014-11-02
SDSC Outage Notification – Network – 31 Oct 2014, 13:15
Title: SDSC Outage Notification – Network – 31 Oct 2014, 13:15Description: SDSC networking experienced a brief outage around 13:15 on 31 Oct 2014. The outage lasted approximately five minutes. The networking team is investigating and we will post any additional information.Start Time: 13:15Date: 2014-10-31End Time: 13:20
SDSC MySQL Service Outage – 11:30, 20 Oct 2014
Title: MySQL Service Outage – 11:30, 20 Oct 2014Description: Database services on production MySQL may be unavailable while we restart the database to correct out of resource issues. We will update as we have more information.Start Time: 11:30Date: 2014-10-20
SDSC Colocation Network Upgrade – 19 Aug 2014 (Updates)
Update 21:29, 19 Aug 2014: Both switchgroups have been restored to service. Please contact operations with any problems or concernsUpdate 20:21, 19 Aug 2014: Two switchgroups serving the Z39 and L47 areas are still under maintenance. These switches also service cloud storage, unmigrated web sites, and various customer systems.
SDSC Project Storage Server Offline – 23:15, 12 Aug 2014
Title: SDSC Project Storage Server Offline – Description: Host ps-c03-1 which services the following project storage mounts, hung at approximately 23:15 on 12 Aug 2014. Storage engineers are restarting services. ps-001 ps-002 ps-003 ps-004 ps-008 ps-013 ps-014 ps-015 ps-016 ps-017 ps-018 ps-027 ps-028 ps-030 ps-032 ps-045 ps-047 ps-048 ps-049 ps-050 ps-051Start Time: 23:15Date: 2014-08-12
SDSC Network Interruptions – 9 Aug 2014
Title: SDSC Network Interruptions – 9 Aug 2014Description: Update 17:23, 9 Aug 2014 : Work is complete and routing is stable. Update 17:15, 9 Aug 2014 : The routing process is currently being restarted. Update 18:29, 9 Aug 2014 : SDSC and UCSD networking engineers will be restarting a core networking process on the primary …
(Update) SDSC Colocation Network Upgrades – 5 Aug and 19 Aug, 2014
Title: SDSC Colocation Network Upgrades – 5 Aug and 19 Aug, 2014 Update, 21:13, 5 Aug 2014 : All systems are operational. Please contact SDSC operations for any questions or concerns Update, 20:38, 5 Aug 2014 : Networking connectivity between VLANs internal to the SDSC network is still having problems. This may show as an …