The University of Texas at Austin

ITS Services Status

Current Service Interruptions

10/20/2014
2:46 PM
RESOLVED:Phone and email support for Canvas down
Service Restored

2:45
Canvas Status Update
RESOLVED - Help request submission to Canvas Support functional via all methods again - 10/20/14
Email support is up and functional again. We have begun receiving email communication from Canvas users again and our own tests confirm functionality as well. All supported methods of help request submission are functioning as expected. We apologize for any frustration this caused your users.

Please don’t hesitate to contact us if you continue to experience an issue with any method of submitting a help request to Canvas Support.


2:05pm
Canvas Status Update
Users still unable to contact Canvas Support via email, works intermittently - 10/20/14
Zendesk is continuing to experience an issue with email processing causing issues with reaching Canvas Support via email. We have seen some emails make it through though it is still very intermittent at this time. We’re continuing to investigate the problem with Zendesk and will provide more information in the next 30 minutes.


1:32
Phone lines, webform help submissions and LiveChat support (for schools with chat support) remain functional; however, email support remains down. We’re continuing to investigate the problem with Zendesk and will provide more information in the next 30 minutes.


1:15
Phones back online; Users still unable to contact Canvas Support via email - 10/20/14
Phone lines are back up and functioning though email support is still down. Help submissions via the built-in help menu webform and LiveChat (for schools with chat support) are still functioning. We’re continuing to investigate the problem with Zendesk and will provide more information in the next 15 minutes


12:54
We just became aware of a Zendesk issue that is preventing users from reaching Canvas Support via the support phone lines or via email. Help submissions via the built-in help menu webform and LiveChat (for schools with chat support) are still functioning. We’re investigating the problem with Zendesk and will provide more information in the next 15 minutes.

10/18/2014
1:41 PM
Canvas Status Update: Request timeouts and severe slowness 10-15-14
Under Investigation

1:40
Since the release this morning, we’ve seen reports from some Chrome users that they’re unable to view discussion responses, see a list of files in a course’s Files section, edit / view pages, etc. In every case reported to us so far, clearing browser cache once has solved the problem entirely, for all Canvas content. The issue only seems to affect some Chrome users, not all. It does not seem to matter which version of Chrome the user is using.

Please encourage users who contact you with these symptoms (Chrome, can’t see certain content) to try clearing their cache. We’ve updated the greeting message on our phone lines to suggest this tip to callers, too.

We’ve reported this problem to our engineering team. Ideally, they’ll be able to push a global fix—but we haven’t identified a root cause yet, and this might prove to be an issue that can’t be addressed for all users from here. If we learn of cases where clearing cache does *not* solve this problem, we’ll provide an update right away.


1:58
Canvas response times have returned to normal levels and all should be functional again for your users. We apologize for any inconvenience this caused.  Please contact us if you are continuing to experience any issues.


We just became aware of an issue that is affecting many Canvas users, causing timeouts and lack of response to requests. We’re investigating the problem and will provide more information in the next 15 minutes.

10/16/2014
1:30 PM
RESOLVED: UT Forge SVN downtime
Service Restored

13:28
EXTERNAL NOTIFICATION:
While UT Forge SVN service is fully functional right now, this message serves to notify campus of a period of downtime our SVN service experienced earlier today in case anyone noticed a problem.

A very unusual problem with file handling blocked access to SVN repositories at 11:41 AM.
The issue was resolved at 12:05 PM.

If you have any trouble connecting to SVN now, please notify stewards as per normal at utforge-admin@utlists.utexas.edu

10/15/2014
11:27 AM
RESOLVED: UT Lists message delivery interruption
Service Restored

11:21
UT Lists mail delivery is restored and all outstanding mail is delivered.

ITS Systems staff have identified the root cause and will identify methods to avoid this issue in the future.


11:06
UT Lists mail service is experiencing delays in mail delivery. ITS systems staff are working on the problem.

Past Service Interruptions

Upcoming Maintenance

<<< 08/25/2013 - 09/14/2013 >>>
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: Weekly maintenance event for Blackboard (courses.utexas.edu).

The service may be degraded or down during this time.
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
8:00 AM - 11:00 AM
Campus Network Maintenance
Service: Campus Network
Maintenance blackout window
Description: Networking will be performing maintenance on the campus network. During this time, portions of the campus network may be intermittently unavailable. Hosts and services connected to the campus network ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 PM - 11:00 PM
Central Web Authentication Expedited Non-Disruptive Mainenance
Service: Central Web Authentication (CWA)
Description: Central Web authentication will undergo an expedited, non-disruptive maintenance. There should be no interruption of service during this maintenance.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 8:00 AM
Planned Outage for TRAC and SDS
Service: Technical Resource Account Control (TRAC)
Description: Regular quarterly OS security patching will be performed resulting in a brief service interruption. The duration of the expected downtime will be 5 - 10 minutes.

Additionally, the Departmental ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 11:00 AM
QUAL uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine TIM QUAL maintenance. There will be one 1 hour outage during the maintenance period.
1:00 PM - 5:00 PM
WSUS Server OS Upgrade
Service: Windows Software Update Service (WSUS)
Description: The Campus WSUS service will be migrated to a modern operating system and SQL server.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
uTexas Enterprise Directory (TED) routine maintenance
Service: uTexas Enterprise Directory (TED)
Description: Routine OS maintenance on the TED (The uTexas Enterprise Directory) servers will be done at this time. No interruption of service is anticipated.
12:00 PM - 4:00 PM
Blog Service maintenance
Service: University Blog Service
Description: The Blog Service will undergo maintenance at 12:00 p.m. on Wednesday, August 28. No interruption in service is expected.
1:00 PM - 5:00 PM
AEMS software upgrade
Service: Austin Exchange Messaging Service
Description: A software update will be applied to AEMS to facilitate easier interactions with Office 365.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 10:00 AM
Shibboleth regular maintenance
Service: Shibboleth
Description: Routine OS maintenance on the Shibboleth Identity Provider servers will be done at this time. No interruption of service is anticipated.
6:00 PM - 11:00 PM
SBC Configuration Testing
Service: Voice Services (VoIP)
Description: We will be working with the vendor to test configuration changes associated with fully enabling secure communications on the new VoIP system. There should be no disruption to voice services on the ... (more)
6:30 AM - 8:00 AM
ITS MySQL Service Maintenance
Service: MySQL
Description: required maintenance for ITS CAT1 and non-CAT1 MySQL. There may be a short service outage during this maintenance interval.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 10:00 AM
SecureDoc service and server maintenance
Service: Enterprise Whole Disk Encryption
Description: Recurring maintenance window for SecureDoc services.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 2:00 PM
UTLogin routine maintenance
Service: UTLogin
Description: ITS Applications will be conducting maintenance on the UTLogin system that will result in a partial system outage.

Date: 8/31/2013
Start time: 9:00 AM
End time: 2:00PM

Impact: This ... (more)
12:00 AM - 1:00 AM
Mainframe maintenance window
Service: Mainframe
Description: The UT Austin mainframe will undergo planned maintenance early Sunday morning beginning shortly after 12:00 AM midnight and lasting approximately 1 hour into Sunday morning. UT Direct, applytexas.org,... (more)
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
10:30 AM - 11:30 AM
DEFINE Internals/Enterprise Workflow Non-Disruptive Maintenance
Service: DEFINE Internals/Enterprise Workflow
Description: *DEFINE Internals/Enterprise Workflow will be performing non-disruptive maintenance to deploy user-requested enhancements. Users should not experience any interruption in service.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 8:00 AM
Monthly JIRA Application Maintenance
Service: Jira
Description: JIRA will undergo application maintenance every 1st Tuesday monthly.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
4:00 PM - 5:00 PM
ERP Web Infrastructure Maintenance Window
Service: ERP UI Web Infrastructure
Description: ERP UI, ERP Application Registry, ERP UI Site generator application upgrades occur during this time. Minimal impact on users should be expected.
5:00 PM - 5:30 PM
UT Direct Planned Maintenance
Service: UT Direct
Description: UT Direct will be performing planned maintenance to deploy user-requested enhancements. Users may experience a very limited interruption in service.
6:00 AM - 8:00 AM
UTLogin routine maintenance
Service: UTLogin
Description: ITS Applications will be conducting maintenance on the UTLogin system that will result in a partial system outage.

Date: 9/4/2013
Start time: 6:00 AM
End time: 8:00 AM

Impact: This ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
2:00 PM - 5:00 PM
Ongoing non-disruptive Exchange upgrades
Service: Austin Exchange Messaging Service
Description: More of the ongoing software upgrades on AEMS. No customer visibility is expected
5:00 PM - 7:00 PM
DEFINE Internals/Enterprise Workflow Planned Maintenance
Service: DEFINE Internals/Enterprise Workflow
Description: *DEFINE Internals/Enterprise Workflow will be performing planned maintenance to deploy user-requested enhancements and bug fixes. Users should not experience any interruption in service.
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
Install two StarLine modules into live buss
Service: University Data Center
Description: Planned - Non-Disruptive: UDC-FAC Will be installing two 20amp StarLine modules into the StarLine A&B busses in NOC-B.
This work is not expected to have any impact on
exisiting devices on the ... (more)
10:00 AM - 4:00 PM
Non-distruptive software upgrade on AEMS
Service: Austin Exchange Messaging Service
Description: The ongoing process to upgrade AEMS to Exchange 2010 SP3 continues.
4:00 AM - 7:00 AM
Rebuild Blackboard's passive standby database
Service: Blackboard
Description: We need to rebuild Blackboard's standby database. This doesn't modify the active production environment at all, but does load down the production database so needs to be done after prime-time service ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
10:30 AM - 12:00 PM
Expedited non-distruptive software upgrade on AEMS
Service: Austin Exchange Messaging Service
Description: The rolling upgrade of all AEMS servers to Exchange 2010 SP3 continues. This update covers the DR mailbox servers, which are not serving customers.
2:00 PM - 3:00 PM
utdirect qual change to pype proxy
Service: UT Direct Q/A environment
Description: We will be changing how we proxy requests to the qual pype applications behind utdirect qual

Rolling restart, with no visible interruption in service
6:00 AM - 11:00 AM
Footprints Weekly Maintenance
Service: Footprints Incident Tracking System
Description: Application or OS patching and updates.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
12:00 AM - 6:00 AM
Blackboard Weekly Maintenance
Service: Blackboard
Description: Weekly maintenance event for Blackboard (courses.utexas.edu).

The service may be degraded or down during this time.
12:00 AM - 6:00 AM
Austin Exchange Message Service (AEMS) Planned Maintenance
Service: Austin Exchange Messaging Service
Description: This maintenance includes any or all of the following maintenance tasks:

* Installation of security updates and hotfixes.

* Moving of user mailboxes to different mailbox databases to better ... (more)
12:00 AM - 6:00 AM
Austin Disk Services Planned Maintenance Window
Service: Austin Disk Services
Description: Customers utilizing the following dependent services may be affected:

* Austin Disk shares (user home directories and departmental shares)
* Stat Apps Server (user profiles, redirected documents ... (more)
12:01 AM - 6:00 AM
SharePoint 2010 Maintenance
Service: SharePoint
Description: During the weekly maintenance window, SharePoint 2010 farm will have SharePoint updates (product updates and security updates) installed.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
7:00 AM - 7:30 AM
MSSQL Maintenance for SQL01
Service: Microsoft SQL Server
Description: A failover is required for MSSQL service on SQL01
This will result in a disruption in service for connecting clients during some portion of this maintenance window.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
3:30 PM - 5:00 PM
PyPE OS Security Patching - Test & Qual
Service: Python Production Environment (PyPE)
Description: Apply OS Patch Stream to PyPE Test and Qual environments. Servers are paired and will be updated in sequence, so PyPE-based web applications will continue to run with diminished capacity but no ... (more)
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
6:00 PM - 8:00 PM
SBC Patch implementation
Service: Voice Services (VoIP)
Description: The vendor for the new VoIP system will be applying a patch to the Session Border Controller. No service should be affected.
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #1 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
5:00 PM - 10:00 PM
Blog Service Weekly Maintenance
Service: University Blog Service
Description: Scheduled maintenance may occur weekly on Wednesdays between 5 p.m. and 10 p.m. To the maximum extent possible, installation of service, application, and security updates will be performed during ... (more)
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #2 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
7:00 AM - 5:00 PM
NOC-A Rack Power Audit
Service: University Data Center
Description: UDC-FAC will be performing a power audit for all racks and cabinets in NOC-A. We will have electrical panels open from time to time but the dead fronts will remain in place so no electrical hazards ... (more)
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
12:00 PM - 4:00 PM
Blog Service Maintenance
Service: University Blog Service
Description: The Blog Service will undergo maintenance at 12:00 p.m. on Thursday, September 12. No interruption in service is expected.
6:00 AM - 7:00 AM
AEMS mailbox server failover
Service: Austin Exchange Messaging Service
Description: AEMS mailbox server #3 will be failed over to its standby servers in preparation for upgrading it to SP3. No user impact is anticipated.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
4:30 PM - 5:00 PM
DirSync server maintenance
Service: Office 365
Description: The DirSync VM will be upgraded to more CPU and memory. The SQL instance will be upgraded to Enterprise.

No customers will be impacted by this maintenance.
9:00 AM - 5:00 PM
VM storage migrations to permit SAN OS upgrades
Service: Virtual Servers
Description: VMs will be migrated to other storage locations to permit evacuation of 2 SANs to a new firmware revision which cannot be done with the SAN online.

No VM downtime is anticipated. There is a ... (more)
9:00 AM - 12:00 PM
PROD uTexas Identity Manager (TIM) Routine Maintenance
Service: uTexas Identity Manager (TIM)
Description: We will be conducting routine TIM PROD maintenance. There will be two 10 minute outages during the maintenance period.

We Can Help

Get help from an expert:

* ITS Help and Service Desk

* Call us at 512-475-9400

* Submit a help request online

We also have a walk-in service in the first floor lobby of the Flawn Academic Center (FAC). Stop by and let us help you!