The University of Texas at Austin

ITS Services Status

Current Service Interruptions

7/22/2014
4:24 PM
RESOLVED: UT-V Host Storage issue
Service Restored

All VMs that were running on the affected host have been powered back on. We continue to work with vendors to identify the cause of the recent service instability.


The host in the UT-V environment that has been having issues will need to be rebooted. We have been contacting affected customers and asking for their VMs to be shutdown gracefully. We plan to reboot the UT-V host close to 3:50pm. The outage may last up to 30 minutes. We plan to have the customer VMs powered on by 4:30pm.


UT-V staff continue to work with VMware critical support to resolve the issue.


The issue with the a host in the virtual server environment (UT-V) is still under investigation.


A host in the UT-V environment appears to be having storage issues with a particular array. ITS Systems staff are investigating.

7/22/2014
3:58 PM
Message Waiting Indicator and other VoIP problem
Unplanned Maintenance

ITS will be performing emergency maintenance on the VoIP system from 6:30 to 7:00pm today. 
Customers may experience trouble originating calls for one minute during this time.  No other interruptions are expected.
Our next update will be at 7:00pm.


We have become aware that certain services on the new VoIP system are not functioning properly.
1. Customers may not see a visual voice mail message indicator on their phones when a caller leaves them a voice mail message.
2. Other customers who have keys programmed on their VoIP phones that allow them to monitor the status of a co-worker’s phone line may discover this “busy lamp” does not function.
ITS Voice Services continues to investigate.

7/22/2014
1:29 PM
RESOLVED:  Non CAT-I MySQL problem
Service Restored

The affected non cat-1 MySQL service has been restored.  The ITS alerts page was transferred to the emergency page due to the MySQL issues. It was delayed in its return to service due to issues with Expression Engine that ITS Apps has resolved & came back up around 1:00 PM. 


12:50 PM
UT Lists back in service.

12:34 PM Resolved
Non-cat1 mysql service has been restored.
Systems staff continue to monitor but we believe the issue is resolved.

12:32 PM
Currently there are issues with the virtual server environment (UT-V) and MySQL. ITS Systems staff are investigating both but at this time they appear to be unrelated.

12:27 PM
The UT Lists mailing list service is currently unavailable due to the already reported non Cat 1 MySQL database access issues.

12:25 PM
Non CAT-I MySQL is currently having issues with accepting user connections.  ITS staff is currently investigating.

12:23 PM
We have been receiving calls about multiple University websites being down including the ITS Public Pages, the registrar’s website, and bealonghorn. We are investigating a possible large-scale disruption of database services. Here is the error message we the websites are showing:

Warning: mysql_connect() [function.mysql-connect]: Too many connections in/export/httpd/data/its/events/includes/mysql_connect_calendar.phpon line 19
We’re sorry—an error occurred and a connection to the database could not be established.


12:22 PM
Several sites across campus are similarly affected. The common thread appears to be MySQL.

12:21 PM
There is an issue with non-Cat1 MySQL. It has taken down the entire ITS website:

www.utexas.edu/its

and other sites.


Currently there are issues with the virtual server environment.  ITS Systems is investigating.

7/22/2014
9:50 AM
RESOLVED:  WorldSpace Taken Down
Service Restored

The WorldSpace service has been restored.


WorldSpace has been taken down to address a backend issue. Service should be restored once the underlying issue is addressed.

7/21/2014
11:08 PM
RESOLVED: MSSQL SQL01 cluster: Emergency Outage
Service Restored

This emergency maintenance is now concluded.


Event Title: MSSQL SQL01 cluster Emergency: Outage Maintenance
Description: MSSQL SQL01 cluster will undergo an emergency failover from DB01 to DB02 to address tempdb disk space issue.
Start Date: Monday, July 21, 2014
End Date: Monday, July 21, 2014
Start Time: 11:00 PM
End Time: 11:05 PM
Contact Name: ITS Database team
Contact Email: ITS-Database

Past Service Interruptions

Upcoming Maintenance

<<< 08/25/2013 - 09/14/2013 >>>
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: Weekly maintenance event for Blackboard (courses.utexas.edu).

The service may be degraded or down during this time.
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
8:00 AM - 11:00 AM
Campus Network Maintenance
Service: Campus Network
Maintenance blackout window
Description: Networking will be performing maintenance on the campus network. During this time, portions of the campus network may be intermittently unavailable. Hosts and services connected to the campus network ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 PM - 11:00 PM
Central Web Authentication Expedited Non-Disruptive Mainenance
Service: Central Web Authentication (CWA)
Description: Central Web authentication will undergo an expedited, non-disruptive maintenance. There should be no interruption of service during this maintenance.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 8:00 AM
Planned Outage for TRAC and SDS
Service: Technical Resource Account Control (TRAC)
Description: Regular quarterly OS security patching will be performed resulting in a brief service interruption. The duration of the expected downtime will be 5 - 10 minutes.

Additionally, the Departmental ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 11:00 AM
QUAL uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine TIM QUAL maintenance. There will be one 1 hour outage during the maintenance period.
1:00 PM - 5:00 PM
WSUS Server OS Upgrade
Service: Windows Software Update Service (WSUS)
Description: The Campus WSUS service will be migrated to a modern operating system and SQL server.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
uTexas Enterprise Directory (TED) routine maintenance
Service: uTexas Enterprise Directory (TED)
Description: Routine OS maintenance on the TED (The uTexas Enterprise Directory) servers will be done at this time. No interruption of service is anticipated.
12:00 PM - 4:00 PM
Blog Service maintenance
Service: University Blog Service
Description: The Blog Service will undergo maintenance at 12:00 p.m. on Wednesday, August 28. No interruption in service is expected.
1:00 PM - 5:00 PM
AEMS software upgrade
Service: Austin Exchange Messaging Service
Description: A software update will be applied to AEMS to facilitate easier interactions with Office 365.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 10:00 AM
Shibboleth regular maintenance
Service: Shibboleth
Description: Routine OS maintenance on the Shibboleth Identity Provider servers will be done at this time. No interruption of service is anticipated.
6:00 PM - 11:00 PM
SBC Configuration Testing
Service: Voice Services (VoIP)
Description: We will be working with the vendor to test configuration changes associated with fully enabling secure communications on the new VoIP system. There should be no disruption to voice services on the ... (more)
6:30 AM - 8:00 AM
ITS MySQL Service Maintenance
Service: MySQL
Description: required maintenance for ITS CAT1 and non-CAT1 MySQL. There may be a short service outage during this maintenance interval.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 10:00 AM
SecureDoc service and server maintenance
Service: Enterprise Whole Disk Encryption
Description: Recurring maintenance window for SecureDoc services.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 2:00 PM
UTLogin routine maintenance
Service: UTLogin
Description: ITS Applications will be conducting maintenance on the UTLogin system that will result in a partial system outage.

Date: 8/31/2013
Start time: 9:00 AM
End time: 2:00PM

Impact: This ... (more)
12:00 AM - 1:00 AM
Mainframe maintenance window
Service: Mainframe
Description: The UT Austin mainframe will undergo planned maintenance early Sunday morning beginning shortly after 12:00 AM midnight and lasting approximately 1 hour into Sunday morning. UT Direct, applytexas.org,... (more)
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
10:30 AM - 11:30 AM
DEFINE Internals/Enterprise Workflow Non-Disruptive Maintenance
Service: DEFINE Internals/Enterprise Workflow
Description: *DEFINE Internals/Enterprise Workflow will be performing non-disruptive maintenance to deploy user-requested enhancements. Users should not experience any interruption in service.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 8:00 AM
Monthly JIRA Application Maintenance
Service: Jira
Description: JIRA will undergo application maintenance every 1st Tuesday monthly.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
4:00 PM - 5:00 PM
ERP Web Infrastructure Maintenance Window
Service: ERP UI Web Infrastructure
Description: ERP UI, ERP Application Registry, ERP UI Site generator application upgrades occur during this time. Minimal impact on users should be expected.
5:00 PM - 5:30 PM
UT Direct Planned Maintenance
Service: UT Direct
Description: UT Direct will be performing planned maintenance to deploy user-requested enhancements. Users may experience a very limited interruption in service.
6:00 AM - 8:00 AM
UTLogin routine maintenance
Service: UTLogin
Description: ITS Applications will be conducting maintenance on the UTLogin system that will result in a partial system outage.

Date: 9/4/2013
Start time: 6:00 AM
End time: 8:00 AM

Impact: This ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
2:00 PM - 5:00 PM
Ongoing non-disruptive Exchange upgrades
Service: Austin Exchange Messaging Service
Description: More of the ongoing software upgrades on AEMS. No customer visibility is expected
5:00 PM - 7:00 PM
DEFINE Internals/Enterprise Workflow Planned Maintenance
Service: DEFINE Internals/Enterprise Workflow
Description: *DEFINE Internals/Enterprise Workflow will be performing planned maintenance to deploy user-requested enhancements and bug fixes. Users should not experience any interruption in service.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
Install two StarLine modules into live buss
Service: University Data Center
Description: Planned - Non-Disruptive: UDC-FAC Will be installing two 20amp StarLine modules into the StarLine A&B busses in NOC-B.
This work is not expected to have any impact on
exisiting devices on the ... (more)
10:00 AM - 4:00 PM
Non-distruptive software upgrade on AEMS
Service: Austin Exchange Messaging Service
Description: The ongoing process to upgrade AEMS to Exchange 2010 SP3 continues.
4:00 AM - 7:00 AM
Rebuild Blackboard's passive standby database
Service: Blackboard
Description: We need to rebuild Blackboard's standby database. This doesn't modify the active production environment at all, but does load down the production database so needs to be done after prime-time service ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
10:30 AM - 12:00 PM
Expedited non-distruptive software upgrade on AEMS
Service: Austin Exchange Messaging Service
Description: The rolling upgrade of all AEMS servers to Exchange 2010 SP3 continues. This update covers the DR mailbox servers, which are not serving customers.
2:00 PM - 3:00 PM
utdirect qual change to pype proxy
Service: UT Direct Q/A environment
Description: We will be changing how we proxy requests to the qual pype applications behind utdirect qual

Rolling restart, with no visible interruption in service
6:00 AM - 11:00 AM
Footprints Weekly Maintenance
Service: Footprints Incident Tracking System
Description: Application or OS patching and updates.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: Weekly maintenance event for Blackboard (courses.utexas.edu).

The service may be degraded or down during this time.
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 7:30 AM
MSSQL Maintenance for SQL01
Service: Microsoft SQL Server
Description: A failover is required for MSSQL service on SQL01
This will result in a disruption in service for connecting clients during some portion of this maintenance window.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
3:30 PM - 5:00 PM
PyPE OS Security Patching - Test & Qual
Service: Python Production Environment (PyPE)
Description: Apply OS Patch Stream to PyPE Test and Qual environments. Servers are paired and will be updated in sequence, so PyPE-based web applications will continue to run with diminished capacity but no ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
6:00 PM - 8:00 PM
SBC Patch implementation
Service: Voice Services (VoIP)
Description: The vendor for the new VoIP system will be applying a patch to the Session Border Controller. No service should be affected.
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #1 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #2 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
12:00 PM - 4:00 PM
Blog Service Maintenance
Service: University Blog Service
Description: The Blog Service will undergo maintenance at 12:00 p.m. on Thursday, September 12. No interruption in service is expected.
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #3 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
4:30 PM - 5:00 PM
DirSync server maintenance
Service: Office 365
Description: The DirSync VM will be upgraded to more CPU and memory. The SQL instance will be upgraded to Enterprise.

No customers will be impacted by this maintenance.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
PROD uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine TIM PROD maintenance. There will be two 10 minute outages during the maintenance period.

We Can Help

Get help from an expert:

* ITS Help and Service Desk

* Call us at 512-475-9400

* Submit a help request online

We also have a walk-in service in the first floor lobby of the Flawn Academic Center (FAC). Stop by and let us help you!