The University of Texas at Austin
As part of the Web Central Services Retirement project, the ITS website will be retired. Information about IT services will be replaced by two new sites, IT@UT and UT ServiceNow, and ITS departmental information will be migrated to a new location. All changes will be completed by 7/28/2016.

ITS Services Status

RESOLVED: ITS Oracle Central Real Application Cluster unavailable
Service Restored

UPDATE 8/20/2013 at 4:24 p.m.
ITS Systems has worked with the vendor to identify the root cause of the failure and will be documenting the incident in a failure report to be shared with campus via it-updates and Tech Staff Forums per the ITS Incident Communication Policy.

UPDATE 1:06pm
Systems staff believe they have identified the application causing excessive processes to be created in the ITS Central RAC Oracle database environment resulting in service unavailability.

At this time all database schemas in that environment should be available. 

ITS Systems staff will continue to monitor the situation.

Oracle support has been contacted and a case has been opened at the highest level of urgency to assist in resolving this problem.  The instability on one node has caused other nodes instability as well.  FIS has been affected.  Updates to follow at 1:00 or sooner depending on activities and resolution.

ITS Systems continues to work on resolving the problem. 

Further details:

36 databases are available, responding (never impacted)
14 databases are unavailable (on node being overloaded). 

Customers affected


Systems staff were alerted via automated monitoring that a node within the ITS Central RAC service became unavailable at 10:34.  The Oracle environment has a connection limit set to stop denial of service attacks.  This limit has not been exceeded in the past, however Fall activities may have caused the limit to be exceeded, resulting in database unavailability.  The Oracle DBAs are increasing and monitoring the connection limit in the Central RAC pool.  This will require a reload of the Oracle databases on all 3 nodes in the cluster, which may result in additional outages. 

An update will be provided at 11:30 or earlier depending on problem resolution.

At 10:34 one of the clustered nodes in the ITS Oracle Central RAC became unavailable. Systems staff are investigating. An update will be issued at 10:45.

Last updated on Aug 20, 2013 4:26 PM

We Can Help

Get help from an expert:

* UT Service Desk

* Call us at 512-475-9400

* Submit a help request online

We also have a walk-in service in the first floor lobby of the Flawn Academic Center (FAC). Stop by and let us help you!