The University of Texas at Austin

ITS Services Status

Current Service Interruptions

9/29/2014
7:31 PM
RESOLVED: Austin Disk Connectivity Issues
Service Restored

7:30 PM
All servers are now operating and testing indicates that functionality has been fully restored.  ITS Systems staff are continuing to monitor the behavior of the service.


2:15
Testing indicates that the affected server is once again functioning properly.  We will bring it back into production status at 7:00pm today and continue to monitor its performance before considering the issue resolved.


9:54
We are continuing to verify the affected server’s functionality.

The next update will be Monday 9/29/2014 at 4:00pm unless the situation changes.


4:13 PM
Emergency maintenance will be performed on the malfunctioning server beginning 12:00 AM on Sun 28 Sep.
Austin Disk will continue to operate but with less redundancy since the server has already been taken out of service. Note, however, that there is planned maintenance on the rest of Austin Disk occurring between 12:00am and 6:00am on Sunday.
The next update will be 10:00 AM on Mon 29 Sep unless the situation worsens or the server is returned to service before then.


3:09 PM
Austin Disk customers have reported intermittent connectivity issues this week. This was initially diagnosed as a client issue but now appears to be a server issue.
One of two redundant servers seems to be the source of the issue. It was taken out of service and clients should have restored connectivity once their caches clear (~15 minutes) or they restart their machines (which clears the caches immediately).
Please report any issues that continue after a restart to the ITS Help Desk so that we can continue to gather data.

9/29/2014
6:02 PM
RESOLVED: Canvas: RecordUploadPlayback of media gives error or sticks on “Loading…”
Service Restored

18:00
Our engineers have resolved the problem with the Kaltura integration in regards to recording, uploading and playing back media in Canvas. A full incident report will be provided in the next 24 hours describing:
• What caused the issue
• What was done to fix it
• Preventative measures to avoid future similar incidents

We apologize for any inconvenience and frustration this has caused for you and your institution’s users. Please let us know if your users continue to experience any media problems so that we can review it further. 


16:59
Our Ops team is still working on the record\upload\playback issues with our Kaltura integration. There is not yet an ETA for resolution but we are working to resolve it as quickly as possible. We apologize for any inconvenience and will provide another update within 30 minutes.


16:24
We are still seeing the record\upload\playback issues with our Kaltura integration and our Ops team is working to resolve it as quickly as possible.  We apologize for any inconvenience and will provide another update within 30 minutes.


15:48
We are currently seeing an issue with our Kaltura integration that is preventing users from using the Record\Upload media feature or playback an media that was recorded\uploaded with Canvas’ Kaltura integration.
We are working to resolve this as quickly as possible and apologize for any inconvenience. We will provide an update within 30 minutes.

9/29/2014
11:56 AM
Expedited: Non-Disruptive Red Hat Enterprise Linux security patching for CVE-2014-7169
Unplanned Maintenance

11:52
A critical security vulnerability for Bash has been identified in Red Hat Enterprise Linux (RHEL).

ITS Systems has been monitoring vendor response and follow up. A previous patch for CVE-2014-6271 was released and applied last week to RHEL hosts managed by ITS Systems. Red Hat released a subsequent patch for CVE-2014-7169 to address further concerns for the Bash vulnerabilities.

The latest patch will be applied to all RHEL hosts managed by ITS Systems in the following stages, today (9/29):

- All TEST (and lower) hosts, 11:30 am
- All QUAL (and lower) hosts, 12:00 pm
- All PROD (and lower) hosts, 12:30 pm

The patch is expected to be non-disruptive, and has been confirmed to be so on internal test systems.

Based on the tests with the current patch and the lack of any adverse effects with application of patch for CVE-2014-6271, the risk and impact is expected to be Low.

Patches will be applied throughout the day, with completion expected by 5:00 pm.

Critical security updates for Red Hat related to this vulnerability are being made available on the Campus RHNS Service as they are released (typically within 30-60 minutes).

If you run Red Hat Enterprise Linux and do not yet have your systems connected to Satellite, you can find out more information here:

http://www.utexas.edu/its/rhns/

Past Service Interruptions

Upcoming Maintenance

<<< 04/06/2014 - 04/26/2014 >>>
12:00 AM - 1:00 AM
Mainframe maintenance window
Service: Mainframe
Description: The UT Austin mainframe will undergo planned maintenance early Sunday morning beginning shortly after 12:00 AM midnight and lasting approximately 1 hour into Sunday morning. UT Direct, applytexas.org,... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
9:00 AM - 11:00 AM
FC switch replacement
Description: Two FC switches will be swapped out for newer devices in UDC-C. Affected customers have been notified.
9:00 AM - 10:00 AM
TEST uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine maintenance on the TIM TEST system.
2:30 PM - 3:00 PM
Group Email and Urgent Email Nondisruptive Expedited Maintenance
Service: Urgent Email System
Description: The Group and Urgent Email Systems will be patched to perform a necessary security update. The patch should not cause any downtime.
5:30 PM - 6:00 PM
Shibboleth Expedited - Non-Disruptive Maintenance
Service: Shibboleth
Description: Shibboleth (idp.its.utexas.edu) service will be restarted. We should be able to perform a rolling restart of the service and should cause no disruption to users.
6:00 PM - 8:00 PM
UTLogin Expedited - Non-Disruptive Maintenance
Service: UTLogin
Description: ITS Applications will be conducting an expedited, non-disruptive maintenance on the UTLogin system.

Date: Wed 4/10/2014
Start time: 6:00 PM
End time: 8:00 PM

Impact: None expected
9:30 AM - 10:30 AM
Javamail, FTPMail Qual and Test host patching
Service: Mainframe Email
Description: Javamail and FTPMail QUAL and TEST hosts (jmail-t01 and jmail-t02.its.utexas.edu) will be patched serially, with accumulated patches from Red Hat.

There will be no service interruption, as at ... (more)
4:30 PM - 4:45 PM
Emergency non-disruptive maintenance on WebSpace
Service: WebSpace
Description: Emergency maintenance will be performed on WebSpace to remediate a security issue. No user-visible outage is expected.
5:00 PM - 5:30 PM
Shibboleth Expedited - Non-Disruptive Maintenance
Service: Shibboleth
Description: Shibboleth (idp.its.utexas.edu) will undergo a brief, non-disruptive maintenance.
8:30 AM - 9:30 AM
Expedited Non Disruptive maintenance of Document repository
Service: Document Repository
Description: Perform a security update to remediated the OpenSSL bug. Less than 3 minutes interruption is expected on each server.
9:30 AM - 10:30 AM
SDS - Digital Download Service maintenance
Service: Software Distribution and Sales
Description: SDS-DD will be temporarily disrupted for emergency maintenance. The disruption should not last for more than 10 minutes
2:00 PM - 3:00 PM
UTLogin Expedited - Non-Disruptive Maintenance
Service: UTLogin
Description: ITS Applications will be conducting an expedited, non-disruptive maintenance on the UTLogin system.

Date: Wed 4/10/2014
Start time: 2:00 PM
End time: 3:00 PM

Impact: None expected
9:00 PM - 9:30 PM
Campus RHNS: Emergency Security Maintenance
Service: Campus Red Hat Network Satellite (RHNS)
Description: Campus RHNS will undergo emergency disruptive maintenance to address a security issue. Service will be unavailable during the maintenance event.
12:01 PM - 1:00 PM
CTL's Credit by Exam system maintenance
Description: CTL's (the Center for Teaching and Learning's) Credit by Exam system will undergo maintenance. Users may experience a momentary outage.
6:00 PM - 12:00 AM
Austin Domain Controller Refresh
Service: Austin Active Directory
Description: An Austin Domain Controller will be refreshed to new hardware. No customer impact is expected due to the redundant architecture of the service.
10:00 PM - 11:59 PM
SharePoint Maintenance (Fri)
Service: SharePoint
Description: Regularly scheduled SharePoint maintenance each Tuesday and Friday 10PM to midnight. This maintenance may be minor and non-disruptive or may consist of component or service resets which will ... (more)
7:00 AM - 10:00 AM
EWDE Maintenance
Service: Enterprise Whole Disk Encryption
Description: Enterprise Whole disk Encryption serviece (SecureDoc) maintenance
7:00 AM - 12:00 PM
Footprints weekly maintenance for OS patching
Service: Footprints Incident Tracking System
Description: Reserved window for weekly maintenance events -- mostly OS patching.
8:00 AM - 11:59 AM
Web Central Monthly Scheduled Maintenance
Service: Web Central
Description: The servers and software associated with www.utexas.edu, custom websites hosted on Web Central, and Web publishing on UNIX (UTS, uts.cc.utexas.edu) will undergo scheduled maintenance. During this ... (more)
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: This window is for weekly planned maintenance, disruptive and non-disruptive, and may include OS patching for application servers or infrastructure dependencies, as well as database or application ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
9:00 AM - 10:00 AM
PROD uTexas Identity Manager (TIM) Non-disruptive Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine maintenance on the TIM PROD System. No disruption to services is expected.
8:00 PM - 2:00 AM
VoIP System Patch Application
Service: Voice Services (VoIP)
Description: Our vendor will be applying a patch to the VoIP system core. We expect no disruption of service.
6:30 AM - 7:00 AM
PROD uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine maintenance on the TIM PROD system. Users of the EID Administrative Application or the EID Self Help Application may experience connection resets during the maintenance ... (more)
7:00 AM - 8:00 AM
Pype WPA upgrade
Service: Python Production Environment (PyPE)
Description: The newest UTLogin WPA will be installed on pype.its.utexas.edu to resolve logout issues.
7:00 AM - 7:30 AM
Emergency Information Security Maintenance for MSSQL SQL01
Service: Microsoft SQL Server
Description: SQL01 cluster will undergo emergency maintenance to replace an SSL certificate. Service will be unavailable during the maintenance.
8:00 AM - 5:00 PM
Austin AD Name Server Refresh
Service: Austin Active Directory
Description: An Austin AD Name Server will be refreshed to new hardware. No customer impact is expected due to the redundant architecture of the service.
9:00 AM - 10:00 AM
Natclipse server maintenance
Description: The natclipse servers will undergo regular operating system (OS) maintenance on the third Tuesday of every third month. No user disruption is expected due to service architecture.
9:00 AM - 10:00 AM
QUAL uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine maintenance on the TIM QUAL system.
6:00 PM - 10:00 PM
University Wiki Service Monthly Maintenance
Service: University Wiki Service
Description: Scheduled maintenance for the University Wiki Service occurs the third Tuesday of the month from 6 p.m. - 10 p.m. To the maximum extent possible, installation of service, application and security ... (more)
8:00 PM - 11:55 PM
Web Central planned maintenance: UT Login transition for protected pages
Service: Web Central
Description: The Web servers hosting www.utexas.edu, UTS (uts.cc.utexas.edu), and associated virtual Web hosting sites will be reconfigured to employ the Transitional Fat Cookie, a UTLogin-based authentication ... (more)
8:00 PM - 2:00 AM
VoIP System Patch Application
Service: Voice Services (VoIP)
Description: Our vendor will be applying a patch to the VoIP system core. We expect no disruption of service.
7:00 AM - 7:30 AM
Shibboleth (PROD) Maintenance - Expedited Non-Disruptive
Service: Shibboleth
Description: Shibboleth will undergo maintenance during this time. This maintenance should cause no disruptions to the Shibboleth production service (idp.its.utexas.edu).
8:00 AM - 8:30 AM
Activate Outbreak Filters on our IronPort appliances
Service: Mail Filtering Service
Description: The Outbreak Filters feature will be activated on our IronPort appliances. This feature detects virus and phishing outbreaks based on broad message characteristics and mail flow patterns rather than ... (more)
8:00 AM - 9:00 AM
Campus VPN Maintenance - Non-Disruptive
Service: Virtual Private Network
Description: Networking will be conducting maintenance on the campus VPN system to install fixes for recently announced security vulnerabilities. VPN servers are configured in a redundant pair, and maintenance ... (more)
8:00 AM - 9:00 AM
Campus Network Maintenance - Non-Disruptive
Service: Departmental Networks
Description: Networking will be conducting maintenance on the campus facilities network firewalls to install fixes for recently announced security vulnerabilities. The firewalls are configured in a redundant pair,... (more)
9:30 AM - 10:30 AM
Javamail, FTPMail PROD host patching
Service: Mainframe Email
Description: Quarterly OS and JVM patching of the Linux hosts that handle email from the mainframe (PROD environment).
3:30 PM - 4:00 PM
Javamail/FTPMail - expedited. Update sendmail config
Service: Mainframe Email
Description: The Javamail/FTPMail PROD hosts will have their sendmail max load settings updated.

This is a non-disruptive maintenance, which is urgently required to address an issue seen earlier today.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Thursdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
8:00 PM - 10:00 PM
Expedited Legacy VoIP Repair
Service: Telephone Service (Retirement in Progress)
Description: We will be applying the vendor's fix for the problem which caused the outage and configuration freeze on the legacy VoIP phones. We expect no service to be affected.
6:00 PM - 12:00 AM
Austin Domain Controller Refresh
Service: Austin Active Directory
Description: An Austin Domain Controller will be refreshed to new hardware. No customer impact is expected due to the redundant architecture of the service.
10:00 PM - 11:59 PM
SharePoint Maintenance (Fri)
Service: SharePoint
Description: Regularly scheduled SharePoint maintenance each Tuesday and Friday 10PM to midnight. This maintenance may be minor and non-disruptive or may consist of component or service resets which will ... (more)
7:00 AM - 10:00 AM
EWDE Maintenance
Service: Enterprise Whole Disk Encryption
Description: Enterprise Whole disk Encryption serviece (SecureDoc) maintenance
7:00 AM - 12:00 PM
Weekly planned maintenance for OS patching
Service: Footprints Incident Tracking System
Description: Reserved window for weekly maintenance events -- mostly OS patching.
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: This window is for weekly planned maintenance, disruptive and non-disruptive, and may include OS patching for application servers or infrastructure dependencies, as well as database or application ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
7:00 AM - 8:00 AM
Shibboleth (PROD) Maintenance
Service: Shibboleth
Description: Shibboleth will undergo maintenance during this time. This maintenance should cause no disruptions to the Shibboleth production service.

Service Providers have been notified of this maintenance ... (more)
6:00 PM - 8:00 PM
Group E-Mail Planned Maintenance
Service: Group E-Mail
Description: The Group E-mail system will undergo regular maintenance on the third Monday of every month. This maintenance may be minor and non-disruptive or may consist of OS updates that would require a reboot ... (more)
6:00 PM - 11:59 PM
Expedited VoIP Patch Application
Service: Voice Services (VoIP)
Description: Vendor will apply patches to VoIP core to bring to current level. We expect no service disruption.
9:25 PM - 10:00 PM
CTL's Credit by Exam System maintenance
Description: Non-Disruptive maintenance of the Center for Teaching and Learning's Credit by Exam system.
7:00 AM - 8:00 AM
XML Gateway PROD - quarterly host OS patching
Service: XMLGateway
Description: XML Gateway service will be interrupted, for about 15 minutes, while the PROD host's OS receives quarterly patches.
7:00 AM - 7:30 AM
Shibboleth (PROD) Maintenance - Non-Disruptive
Service: Shibboleth
Description: Shibboleth will undergo maintenance during this time. This maintenance should cause no disruptions to the Shibboleth production service.
7:00 AM - 7:30 AM
Central Web Authentication Maintenance - Non-Disruptive
Service: Central Web Authentication (CWA)
Description: Central Web Authentication will undergo scheduled maintenance. Users should experience no interruption of service.
8:00 AM - 5:00 PM
Austin AD Name Server Refresh
Service: Austin Active Directory
Description: An Austin AD Name Server will be refreshed to new hardware. No customer impact is expected due to the redundant architecture of the service.
5:00 PM - 6:00 PM
CTL's Credit by Exam system maintenance
Description: The Center for Teaching and Learning's Test Registration system will undergo maintenance. Users may experience a momentary interruption in service.
10:00 PM - 11:59 PM
SharePoint Maintenance (Tue)
Service: SharePoint
Description: Regularly scheduled SharePoint maintenance each Tuesday and Friday 10PM to midnight. This maintenance may be minor and non-disruptive or may consist of component or service resets which will ... (more)
9:00 AM - 11:00 AM
Planned University Directory Maintenance
Service: University Directory (White Pages)
Description: Routine maintenance will take place on the University White Pages (WHIPS). No user impact is expected.
2:30 PM - 5:30 PM
Planned Disruptive TED Maintenance
Service: uTexas Enterprise Directory (TED)
Description: Routine maintenance will take place on the uTexas Enterprise Directory (TED). No user impact is expected between 2:30 and 5:00 PM. There will be a brief disruption to TED updates between 5:00 and 5:30... (more)
10:00 PM - 11:00 PM
UT Lists planned maintenance
Service: UT Lists
Description: The UT Lists mailing list service at utlists.utexas.edu will undergo routine service maintenance. List mail delivery and access to the Web interface at https://utlists.utexas.edu may be unavailable ... (more)
8:00 AM - 9:00 AM
UTForge monthly application maintenance
Service: UTForge
Description: The UTForge service will undergo application maintenance monthly on the fourth Thursday from 8 - 9 a.m. Subversion and Trac will be available throughout this maintenance event.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Thursdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
10:00 AM - 12:00 PM
DDN Storage maintenance
Description: Maintenance will be performed on DDN storage arrays in UDC-C and UDC-B. Power maintenance will be performed on Beryllium (UDC-B) starting at 10AM. Controller replacement will be performed on Lithium (... (more)
1:00 PM - 5:00 PM
DDN Storage Maintenance
Description: Vendor replacing failing hardware.
6:00 PM - 12:00 AM
Austin Domain Controller Refresh
Service: Austin Active Directory
Description: An Austin Domain Controller will be refreshed to new hardware. No customer impact is expected due to the redundant architecture of the service.
10:00 PM - 11:59 PM
SharePoint Maintenance (Fri)
Service: SharePoint
Description: Regularly scheduled SharePoint maintenance each Tuesday and Friday 10PM to midnight. This maintenance may be minor and non-disruptive or may consist of component or service resets which will ... (more)
7:00 AM - 10:00 AM
EWDE Maintenance
Service: Enterprise Whole Disk Encryption
Description: Enterprise Whole disk Encryption serviece (SecureDoc) maintenance
7:00 AM - 12:00 PM
Footprints planned maintenance for OS patching
Service: Footprints Incident Tracking System
Description: Reserved window for weekly maintenance events -- mostly OS patching.
10:00 PM - 11:00 PM
Upgrade to UTD development, shared storage filer
Service: UT Direct development environment
Description: We will be switching from our netapps filer to the HNAS filer

We Can Help

Get help from an expert:

* ITS Help and Service Desk

* Call us at 512-475-9400

* Submit a help request online

We also have a walk-in service in the first floor lobby of the Flawn Academic Center (FAC). Stop by and let us help you!