[{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z0000004E5ZUAU"},"Id":"a9C0Z0000004E5ZUAU","Duration__c":0,"Log__c":"Resolved: On June 6th, beginning at 5:12am PDT, Okta experienced elevated CPU processing on application servers across all cells triggering automated alerts. Given the quantity of servers with increased CPU processing, customer impact was a possibility and hence the determination was made to post proactively to the [https://trust.okta.com](https://trust.okta.com) page. The increase in processing levels however was sustainable by the infrastructure and thus customer impact through the duration of the incident remained negligible. The increase in CPU processing levels ended at 5:59am PDT when an operational script, related to edge service protection, was terminated. The script has been updated to avoid a recurrence of the increase to CPU processing levels.\r\n<br><br>\r\nEvent Root Cause Analysis details can be found [here](\thttps://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Alert-06-06-2018).","Status__c":"Resolved","Start_Date__c":"2018-06-07","Last_Updated__c":"2018-06-11T03:15:36.000+0000","LastModifiedDate":"2018-06-11T03:15:36.000+0000","Category__c":"Service Degradation","Size__c":"Small","Incident_Title__c":"Service Alert - Increased CPU utilization triggered monitoring alerts.","Impacted_Cells__c":"EU1;OK1;OK2;OK3;OK4;OK5;OK6;Preview","Service_Feature__c":"Core Service","CreatedDate":"2018-06-07T12:38:59.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z0000004E5UUAU"},"Id":"a9C0Z0000004E5UUAU","Duration__c":33,"Log__c":"An issue impacting network connectivity to US Cell 6 was experienced and has now been resolved. Root cause analysis will be posted here within 48 hours.\r\n\r\n=================================\r\n\r\nResolved: On May 31st, beginning at 12:13am PDT, Okta experienced a broad service disruption to US Cell 6. The disruption triggered Okta's automated monitoring, alerting the Engineering team who determined that both the application and its underlying cloud computing infrastructure was unreachable. This pointed to a multi-availability zone outage in Okta's cloud infrastructure and network provider. This was confirmed by our provider, and the decision was made to fail over to the cell's Disaster Recovery (DR) instance and the process was initiated. However before the DR failover process completed, network connectivity was restored and within approximately 5 minutes, automated system recovery processes had returned the cell to normal performance levels; ending the disruption at 12:46am PDT.\r\n\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-05312018).","Status__c":"Resolved","Start_Date__c":"2018-05-31","End_Date__c":"2018-05-31","Last_Updated__c":"2018-06-06T23:38:38.000+0000","LastModifiedDate":"2018-06-06T23:38:38.000+0000","Category__c":"Service Disruption","Size__c":"Medium","Impacted_Cells__c":"okta.com:6","Impacted_Audience__c":"Admin;API Products;End user","Service_Feature__c":"Core Service","Start_Time__c":"2018-05-31T07:13:00.000+0000","CreatedDate":"2018-05-31T07:35:01.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z000000TNhVUAW"},"Id":"a9C0Z000000TNhVUAW","Duration__c":0,"Log__c":"Resolved: 1:40pm PDT. The issue impacting e-mail delivery to 'support@okta.com' and 'developer@okta.com' has been resolved.\r\n\r\n=======================\r\n\r\nCustomer Advisory: Okta is currently experiencing issues with receiving customer e-mails to 'support@okta.com' and 'developer@okta.com'. This does not impact the Okta service availability or any e-mails sent from your Okta tenant.\r\n\r\nIf you need assistance with a new or existing Okta customer support incident, please call Okta at (800) 219-0964. Additional international support numbers may be found at [Okta Support] (https://support.okta.com/help).","Status__c":"Resolved","Start_Date__c":"2018-05-22","Last_Updated__c":"2018-05-22T20:45:00.000+0000","LastModifiedDate":"2018-05-22T20:45:00.000+0000","Category__c":"Service Degradation","Size__c":"Small","Impacted_Audience__c":"Admin","Service_Feature__c":"Third Party","CreatedDate":"2018-05-22T17:54:46.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z000000TNgDUAW"},"Id":"a9C0Z000000TNgDUAW","Duration__c":51,"Log__c":"An issue impacting authentication and user interactive sessions in US Cell 6 is being investigated. End-Users and Admins may experience HTTP 500/503 errors while attempting to login. We are actively working to mitigate the issue and return the service to normal as quickly as possible\r\n\r\n--------------------------\r\n\r\nResolved: On May 17th, beginning at 11:28am PDT, Okta experienced a service disruption in US Cell 6. End-User and Administrators attempting to authenticate to their Okta tenant may have experienced HTTP 5xx errors. Through the duration of the incident, approximately 30% of US Cell 6 users attempting primary or multi-factor authentication encountered errors and would have needed to retry. Other requests, and End-Users and Administrators who already had an active session did not experience any impact.\r\n\r\nThe issue surfaced when the cell's session token management cluster became overwhelmed by a sudden increase in the number of active sessions. Automated monitoring failed to effectively alert before the cluster was nearing its maximum capacity.\r\n\r\nThe issue was resolved by 12:19pm PDT after operational actions were taken to manage the session count while capacity was added to the cluster. Immediately following the incident, Okta corrected the monitoring gap to prevent a future recurrence. Architectural design work is being initiated to better manage session counts and their expiry.\r\n\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-05182018).","Status__c":"Resolved","Start_Date__c":"2018-05-17","End_Date__c":"2018-05-17","Last_Updated__c":"2018-05-22T02:03:34.000+0000","LastModifiedDate":"2018-05-22T02:03:34.000+0000","Category__c":"Service Disruption","Size__c":"Large","Impacted_Cells__c":"okta.com:6","Impacted_Audience__c":"Admin;End user","Service_Feature__c":"Core Service","Start_Time__c":"2018-05-17T18:28:00.000+0000","CreatedDate":"2018-05-17T18:49:34.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z000000TNfAUAW"},"Id":"a9C0Z000000TNfAUAW","Duration__c":42,"Log__c":"Resolved: Okta experienced a service degradation in US Cell 6 between 7:03pm and 7:45pm PDT due to a hardware failure and failover to secondary database infrastructure. Administrative functions like user creation, modification, and deletion may have experienced a period of [Read-Only mode] (https://support.okta.com/help/Documentation/Knowledge_Article/Read-only-Mode) during this time as corrective actions were taken.\r\n\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-05062018).","Status__c":"Resolved","Start_Date__c":"2018-05-06","Last_Updated__c":"2018-05-10T05:55:41.000+0000","LastModifiedDate":"2018-05-10T05:55:41.000+0000","Category__c":"Service Degradation","Size__c":"Medium","Impacted_Cells__c":"OK6","Impacted_Audience__c":"Admin;API Products","Service_Feature__c":"Core Service","Start_Time__c":"2018-05-07T02:03:00.000+0000","CreatedDate":"2018-05-07T02:20:37.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z000000TNeqUAG"},"Id":"a9C0Z000000TNeqUAG","Duration__c":55,"Log__c":"Resolved: On April 24th, at 7:53am PDT, Okta experienced a broad service disruption to US Cell 2. End users in US Cell 2 attempting to reach Okta received HTTP 500 errors, and customer integrations attempting to reach Okta API endpoints in US Cell 2 encountered elevated response times and errors. Operational mitigation steps commenced immediately at 7:53am. The greatest frequency of errors was a 14 minute period between 7:53am and 8:07am. The success rate began to gradually improve from 8:07am, and by 8:25am approximately 80% of requests were successfully returned. The cell was fully restored by 8:48am. \r\n<br><br>\r\nRoot cause was traced to a combination of a procedural error and an automation bug while security patching infrastructure within US Cell 2. The procedural error targeted the security patching to a high usage cache cluster. The automation used to apply the patch disrupted the cluster’s ability to failover across nodes. \r\n<br><br>\r\nTo prevent recurrence of this type of issue in the future, Engineering has immediately implemented additional safeguards to review and confirm operational patching procedures. Additionally, Engineering has prioritized a deep technical assessment to strengthen the patching automation for cache clusters.\r\n\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-04242018).","Status__c":"Resolved","Start_Date__c":"2018-04-24","End_Date__c":"2018-04-24","Last_Updated__c":"2018-05-01T22:59:56.000+0000","LastModifiedDate":"2018-05-01T22:59:56.000+0000","Category__c":"Service Disruption","Size__c":"Large","Impacted_Cells__c":"OK2","Impacted_Audience__c":"Admin;API Products;End user","Service_Feature__c":"Core Service","Start_Time__c":"2018-04-24T15:07:00.000+0000","CreatedDate":"2018-04-24T15:08:06.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C0Z000000TNelUAG"},"Id":"a9C0Z000000TNelUAG","Duration__c":339,"Log__c":"On April 23, at 9:04am PDT, Okta initiated steps to rate limit the Events API endpoint across all preview and production cells so that a fix could be applied. While the fix was in progress, customer integrations attempting to reach the /api/v1/events endpoint would have received a 429 error response. By 2:43pm PDT, the fix had been fully applied across all cells.","Status__c":"Resolved","Start_Date__c":"2018-04-23","End_Date__c":"2018-04-23","Last_Updated__c":"2018-05-01T18:20:55.000+0000","LastModifiedDate":"2018-05-01T18:20:55.000+0000","Category__c":"Service Degradation","Size__c":"Large","Impacted_Cells__c":"EU1;OK1;OK2;OK3;OK4;OK5;OK6;Preview;Preview2","Impacted_Audience__c":"API Products","Service_Feature__c":"Core Service","Start_Time__c":"2018-04-23T16:18:00.000+0000","CreatedDate":"2018-04-23T16:18:41.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmK1UAI"},"Id":"a9C2A000000bmK1UAI","Duration__c":323,"Log__c":"An issue impacting IDP-Initiated Office 365 Office Portal SSO for a subset of end-users in all cells was investigated with Microsoft. Customers may have seen page load failures for portal.microsoftonline.com. As a workaround, customers were able to utilize any of the app-specific chiclets to access O365, then navigate to the O365 Portal from that location.\r\n\r\nResolved: On March 30 at 4:22AM PDT, Okta experienced an issue impacting IDP-Initiated Office 365 Portal SSO for a subset of end-users, specifically those with IPV4 addresses. Users attempting to use the Office 365 Portal chiclet during the incident experienced page load failures. SP-Initiated SSO to the Office 365 Portal, as well as all other Okta Microsoft chiclets, continued to work normally throughout the incident. After it was determined that the issue appeared to be on the application vendor side, Okta immediately reported the matter and worked with Microsoft on potential workarounds and resolution. By 9:45 AM PDT, the problem had been resolved. Root cause analysis and next steps are provided in Microsoft incident MO133118 via the Microsoft Admin Center. Okta will be enhancing monitoring to detect similar Office 365 Portal issues faster in the future to be able to report them Microsoft as early as possible.","Status__c":"Resolved","Start_Date__c":"2018-03-30","Last_Updated__c":"2018-04-03T01:12:53.000+0000","LastModifiedDate":"2018-04-03T01:12:53.000+0000","Category__c":"Service Degradation","Size__c":"Large","Impacted_Cells__c":"EU1;OK1;OK2;OK3;OK4;OK5;OK6;Preview","Impacted_Audience__c":"End user","Service_Feature__c":"Third Party","CreatedDate":"2018-03-30T14:36:52.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A0000004CSnUAM"},"Id":"a9C2A0000004CSnUAM","Duration__c":3300,"Log__c":"Okta is currently investigating an issue with Provisioning Setup and IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP-Initiated Single-Sign-On is not affected. Please contact support if you are having difficulty setting up provisioning and we will assist with implementation of an applicable workaround as we investigate further.","Status__c":"Resolved","Start_Date__c":"2018-03-20","End_Date__c":"2018-03-21","Last_Updated__c":"2018-03-22T21:43:38.000+0000","LastModifiedDate":"2018-03-22T21:43:38.000+0000","Category__c":"Feature Disruption","Size__c":"Large","Impacted_Cells__c":"EU1;OK1;OK2;OK3;OK4;OK5;OK6;Preview","Impacted_Audience__c":"Admin;End user","Service_Feature__c":"Core Service","Start_Time__c":"2018-03-20T22:15:00.000+0000","CreatedDate":"2018-03-20T22:11:19.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A0000004CSTUA2"},"Id":"a9C2A0000004CSTUA2","Duration__c":121,"Log__c":"Okta is currently experiencing an issue in US Cell 6. Administrators will not be able to see up to date user / group information within their Okta tenant. No authentication impact for existing users. Our TechOps and Engineering teams are actively investigating this issue.","Status__c":"Resolved","Start_Date__c":"2018-03-16","End_Date__c":"2018-03-16","Last_Updated__c":"2018-03-21T14:14:35.000+0000","LastModifiedDate":"2018-03-21T14:14:35.000+0000","Category__c":"Service Degradation","Size__c":"Large","Impacted_Cells__c":"OK6","Impacted_Audience__c":"Admin","Service_Feature__c":"Core Service","Start_Time__c":"2018-03-16T17:11:00.000+0000","CreatedDate":"2018-03-16T17:12:33.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBikUAG"},"Id":"a9C2A000000PBikUAG","Duration__c":352,"Log__c":"Okta is currently experiencing an issue with the API Access Management feature in our US Preview Cell. End-users attempting to access endpoints for this feature may receive an HTTP 500 error. Okta is currently working to resolve the issue and we will post an update shortly.","Status__c":"Resolved","Start_Date__c":"2018-03-07","Last_Updated__c":"2018-03-10T00:16:29.000+0000","LastModifiedDate":"2018-03-10T00:16:29.000+0000","Category__c":"Service Disruption","Size__c":"Large","Impacted_Cells__c":"oktapreview.com:1","Impacted_Audience__c":"End user","Service_Feature__c":"Core Service","CreatedDate":"2018-03-07T18:00:08.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBipUAG"},"Id":"a9C2A000000PBipUAG","Duration__c":53,"Log__c":"Okta is currently experiencing an issue in US Cell 6 whereby users attempting to login to Okta are experiencing slowness, timeouts, or HTTP 500 errors when attempting to login or navigate their Okta tenant.","Status__c":"Resolved","Start_Date__c":"2018-03-07","Last_Updated__c":"2018-03-09T23:40:34.000+0000","LastModifiedDate":"2018-03-09T23:40:34.000+0000","Category__c":"Service Disruption","Size__c":"Large","Impacted_Cells__c":"okta.com:6","Impacted_Audience__c":"Admin;API Products;End user","Service_Feature__c":"Core Service","CreatedDate":"2018-03-08T01:24:58.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBiBUAW"},"Id":"a9C2A000000PBiBUAW","Duration__c":57,"Log__c":"On February 25th, Okta experienced an issue in US Preview cell beginning at 9:00am PST which resulted in approximately 2.3% of interactive requests for end-users and administrators receiving HTTP 500 or 504 errors. Okta Engineering's investigation found that an outbound internet gateway high availability solution for one of the three availability zones in the US Preview cell had failed. Following a manual fail-over, the issue was mitigated by 9:33am for all services except Syslog v2 which was fully restored by 9:57am PST. To mitigate future impact, improvements are planned for the high availability infrastructure which manages outbound internet traffic.","Status__c":"Resolved","Start_Date__c":"2018-02-25","End_Date__c":"2018-02-25","Last_Updated__c":"2018-02-28T06:38:35.000+0000","LastModifiedDate":"2018-02-28T06:38:35.000+0000","Category__c":"Service Disruption","Size__c":"Large","Impacted_Cells__c":"oktapreview.com:1","Impacted_Audience__c":"Admin;End user","Service_Feature__c":"Core Service","Start_Time__c":"2018-02-25T17:30:00.000+0000","CreatedDate":"2018-02-25T17:30:36.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBhNUAW"},"Id":"a9C2A000000PBhNUAW","Duration__c":307,"Log__c":"On February 15th, Okta experienced a feature disruption to Office 365 provisioning functionality starting at 12:58pm PST. Okta Engineering's investigation found errors being returned in response to Okta's connection requests to the Microsoft Online Provisioning API. These errors caused all Office 365 provisioning sync tasks to fail. An escalation was raised to Microsoft, who was already aware of the issue, and by 6:05pm the issue was resolved and the expected response codes were being returned. Impacted customers were then advised by Okta to retry any failed provisioning tasks as they would successfully complete. Diagnostic logging for Office 365 requests and responses is being enhanced to provide greater granularity and expedite troubleshooting for this type of issue in the future.","Status__c":"Resolved","Start_Date__c":"2018-02-15","End_Date__c":"2018-02-15","Last_Updated__c":"2018-02-17T23:10:28.000+0000","LastModifiedDate":"2018-02-17T23:10:28.000+0000","Category__c":"Service Degradation","Size__c":"Large","Impacted_Cells__c":"okta-emea.com:1;okta.com:1;okta.com:2;okta.com:3;okta.com:4;okta.com:5;okta.com:6;okta.com:7;oktapreview.com:1;oktapreview.com:2","Impacted_Audience__c":"Admin","Service_Feature__c":"Third Party","Start_Time__c":"2018-02-16T00:10:00.000+0000","CreatedDate":"2018-02-16T00:14:24.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000KzXkUAK"},"Id":"a9C2A000000KzXkUAK","Duration__c":80,"Log__c":"On February 1st, between 7:57am - 9:17am PST, Okta observed a noticeable increase in the volume of SMS errors returned by one of our SMS providers which impacted all cells. Okta automatically retries all failed or slow SMS requests with an alternate SMS provider. As a result of this issue, users leveraging SMS for Multifactor Authentication or Account Recovery may have experienced a slower than usual SMS delivery time. Users relying on voice based second factor authentication, an EA feature, might have experienced delivery failures during the incident. All other authentication factors, such as Okta Verify, Duo, Yubikey, Google Authenticator, or Security Question were not affected.\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-SMS-Voice-Factor-Feature-Degradation).","Status__c":"Resolved","Start_Date__c":"2018-02-01","End_Date__c":"2018-02-01","Last_Updated__c":"2018-02-09T08:43:38.000+0000","LastModifiedDate":"2018-02-09T08:43:38.000+0000","Category__c":"Feature Disruption","Size__c":"Large","Impacted_Cells__c":"EU1;OK1;OK2;OK3;OK4;OK5;OK6;Preview","Impacted_Audience__c":"End user","Service_Feature__c":"Third Party","CreatedDate":"2018-02-01T17:01:35.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000KzYJUA0"},"Id":"a9C2A000000KzYJUA0","Duration__c":67,"Log__c":"On, February 2nd at 9:18am PST, Okta experienced an issue impacting Office 365 authentication in US Cell 1. Some end users attempting to authenticate to Office 365 received the following error:\r\n\r\n\"Sorry, but we’re having trouble signing you in. AADSTS50008: Unable to verify token signature. The signing key identifier does not match any valid registered keys.\"\r\n\r\nThe issue was found to be related to a recently deployed optimization intended to improve performance for Office 365 authentication flows. The change unexpectedly caused SAML assertion validation failures for approximately 5% of customers with Office 365. Only customers in US Cell 1 who created new Office 365 application instances using WS-Federation prior to a 2015 signing cert key pair upgrade were affected.\r\n\r\nThe issue was resolved by reverting the optimization, which began at 9:52am and was completed at 10:25am. Longer term remediation includes broadening test coverage for various signing cert key pairs.","Status__c":"Resolved","Start_Date__c":"2018-02-02","End_Date__c":"2018-02-02","Last_Updated__c":"2018-02-09T08:43:00.000+0000","LastModifiedDate":"2018-02-09T08:43:00.000+0000","Category__c":"Feature Disruption","Size__c":"Large","Impacted_Cells__c":"OK1","Impacted_Audience__c":"End user","Service_Feature__c":"Core Service","CreatedDate":"2018-02-02T17:48:51.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000Kz15UAC"},"Id":"a9C2A000000Kz15UAC","Duration__c":22,"Log__c":"Okta experienced a service disruption in US Cell 4, between 12:34pm - 12:56pm PST following a temporary surge in the volume of requests and failure to correctly redistribute load. The increase in request volume was traced to an inefficient legacy API endpoint. Requests initiated by end users, excluding O365, and API integrations would have experienced intermittent 500 error responses. The mean error rate was 4% and peaked at 7% at approximately 12:50pm PST. The issue was resolved by blocking the legacy API endpoint traffic, and subsequently a code fix has been deployed for the problematic endpoint. Additional investigation is in progress to ensure proper load redistribution going forward.\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-11-06-2017).","Status__c":"Resolved","Start_Date__c":"2017-11-06","Last_Updated__c":"2017-11-16T02:32:14.000+0000","LastModifiedDate":"2017-11-16T02:32:14.000+0000","Category__c":"Minor Service Disruption","Size__c":"Medium","Impacted_Cells__c":"OK4","Impacted_Audience__c":"API Products;End user","CreatedDate":"2017-11-10T23:54:33.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000Kz0WUAS"},"Id":"a9C2A000000Kz0WUAS","Duration__c":18,"Log__c":"Okta experienced a service disruption between 6:00am - 6:18am PDT following a hardware failure impacting a read replica database in US Cell 2 that was being used to shed load off of the primary. During this window, system response times increased and a subset of US Cell 2 requests that queried this database encountered timeouts or failures. The error rates in US Cell 2 averaged around 4% and peaked just below 10% for one minute at 6:15am. These errors intermittently caused the Okta home page to load incompletely and in some cases SSO to timeout for SWA apps when clicked by an end user. There was no impact to customers accessing Okta via APIs, or to end users signing into O365 or other SAML apps. Configuration changes are being implemented to prevent similar app request failures following this type of DB failure.\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-10-25-2017).","Status__c":"Resolved","Start_Date__c":"2017-10-25","Last_Updated__c":"2017-10-28T01:05:54.000+0000","LastModifiedDate":"2017-10-28T01:05:54.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","Incident_Title__c":"Root Cause Analysis - Service Disruption - 10/25/2017","Impacted_Cells__c":"OK2","Impacted_Audience__c":"End user","CreatedDate":"2017-10-25T13:24:11.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000Kz0CUAS"},"Id":"a9C2A000000Kz0CUAS","Duration__c":97,"Log__c":"Between 7:13am - 7:43am PDT and 8:22am - 9:30am PDT, Okta observed a noticeable increase in the volume of SMS retries across all Cells except US Cell 3. An increase in the volume of SMS retries indicates delays in SMS message delivery for customers. As such, customers leveraging SMS for Multifactor Authentication or Account Recovery may not have received the SMS message and would have been prompted to retry. Upon retry, automated fail-over to Okta's other SMS vendor occurred and SMS responses were successfully delivered which minimized impact. All other authentication factors, such as Okta Verify, Voice call, Duo, Yubikey, Google Authenticator, or Security Question were not affected.\r\n<br><br> \r\nReview the root cause analysis [here]( https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-SMS-Service-Degradation-10-19-2017) for this event for greater details about the issues and the changes being enacted to mitigate risks to user flows when new features are released.","Status__c":"Resolved","Start_Date__c":"2017-10-19","Last_Updated__c":"2017-10-23T00:03:45.000+0000","LastModifiedDate":"2017-10-23T00:03:45.000+0000","Category__c":"Feature Disruption","Size__c":"Large","Impacted_Cells__c":"EU1;OK1;OK2;OK4;OK5;OK6;Preview","Impacted_Audience__c":"End user","CreatedDate":"2017-10-19T17:04:56.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000KyxrUAC"},"Id":"a9C2A000000KyxrUAC","Duration__c":323,"Log__c":"Following the release 2017.38, Okta experienced a feature disruption whereby a small subset of customers experienced javascript errors when signing-in to Skype for Business and Oracle Right Now. The errors occurred in oktapreview, US Cell1 and EU Cell1. Following the first customer reports at 6:17AM PDT, a work around was provided to customers by reverting them to the previous generation Okta sign-in experience. A fix was deployed across all impacted cells between 10:09AM and 11:40AM. The root cause found to be a JavaScript incompatibility between a new version of Okta's client side sign-in code (aka widget) and the embedded browsers that run in the impacted applications on Windows devices.\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Root-Cause-Analysis-Javascript-error-launching-Skype-for-Business-or-Oracle-09-26-2017) for this event for greater details about the issues and the changes being enacted to mitigate risks to user flows when new features are released.","Status__c":"Resolved","Start_Date__c":"2017-09-26","Last_Updated__c":"2017-09-29T01:24:07.000+0000","LastModifiedDate":"2017-09-29T01:24:07.000+0000","Category__c":"Feature Disruption","Size__c":"Large","Incident_Title__c":"Root Cause Analysis - Javascript error launching Skype for Business or Oracle","Impacted_Cells__c":"EU1;OK1;Preview","Impacted_Audience__c":"End user","CreatedDate":"2017-09-26T13:16:54.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000KyvbUAC"},"Id":"a9C2A000000KyvbUAC","Duration__c":193,"Log__c":"Following the September 12 evening deployment of the 2017.36 weekly release, customers in all Cells began reporting that some of their users were locked out of Okta. Upon investigation, the enablement of a new password policy soft lock feature (for customers with the Universal Directory SKU) was identified as the root cause. \r\n<br><br>\r\nThe password policy soft lock feature enables access to Okta to be restricted when users' corresponding Windows accounts are locked, or when users exceed a specified threshold for failed login attempts to Okta. \r\nCustomer feedback following the release revealed that the feature led to greater than expected end user impact. The feature was immediately disabled for customers that reported the issue initially and at 10:40am PDT the feature was disabled for the rest of the customers that had the feature enabled as part of the 2017.36 release on September 12. \r\n<br><br>\r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Feature-Disruption-09-13-2017) for this event for greater details about the issues and the changes being enacted to mitigate risks to user flows when new features are released.","Status__c":"Resolved","Start_Date__c":"2017-09-13","Last_Updated__c":"2017-09-18T15:15:10.000+0000","LastModifiedDate":"2017-09-18T15:15:10.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-09-13T14:33:13.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000Kyv2UAC"},"Id":"a9C2A000000Kyv2UAC","Duration__c":130,"Log__c":"At approximately 8:35am PDT, Okta began experiencing delays in SMS message delivery to customers across US Cells. Customers leveraging SMS for Multifactor Authentication or Account Recovery may not have received the SMS message and were prompted to retry. Upon retry, automated fail-over to Okta’s secondary SMS vendor would have occurred. However SMS delays were experienced by both vendors, and as a result, messages for a subset of customers may not have been received. SMS delays had fully dissipated by 10:45am PDT. All other secondary authentication factors, such as Okta Verify, Voice call, Duo, Yubikey, Google Authenticator, or Security Question were not affected. \r\n<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-SMS-Delivery-Delays-08-31-2017).","Status__c":"Resolved","Start_Date__c":"2017-08-31","Last_Updated__c":"2017-09-07T19:23:46.000+0000","LastModifiedDate":"2017-09-07T19:23:46.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-08-31T17:37:43.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmDeUAI"},"Id":"a9C2A000000bmDeUAI","Duration__c":190,"Log__c":"Okta experienced an issue in US Cell 2 beginning at 4:55am PDT which increased database utilization beyond normal levels. An average of 10% of incoming requests to US Cell 2 experienced intermittent latency through to 8:05am, with peaks up to 40% of requests between 4:55am and 6:30am PDT and between 7:55am and 8:05am PDT. The impact of the issue was mitigated via an operational configuration change to further distribute incoming requests. Okta also implemented query optimizations and additional capacity to spread traffic and minimize database utilization. \r\n<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Okta-Performance-Issue-08-03-2017-08-04-2017).","Status__c":"Resolved","Start_Date__c":"2017-08-03","Last_Updated__c":"2017-09-07T02:09:52.000+0000","LastModifiedDate":"2017-09-07T02:09:52.000+0000","Category__c":"Performance Issue","Size__c":"Large","CreatedDate":"2017-08-03T12:31:20.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmESUAY"},"Id":"a9C2A000000bmESUAY","Duration__c":30,"Log__c":"Okta experienced an issue in US Cell 2 beginning at 5:30am PDT which, like the Aug 4th incident, increased database utilization beyond normal levels. An average of 20% of incoming requests to US Cell 2 experienced intermittent latency through to 6:00am, with a peak of 25% of requests. The window of impact was reduced by leveraging the operational configuration changes made the day before to further distribute incoming requests. Okta also deployed query optimizations and additional capacity to spread traffic and minimize database utilization. \r\n<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Okta-Performance-Issue-08-03-2017-08-04-2017).","Status__c":"Resolved","Start_Date__c":"2017-08-04","Last_Updated__c":"2017-09-07T02:08:57.000+0000","LastModifiedDate":"2017-09-07T02:08:57.000+0000","Category__c":"Performance Issue","Size__c":"Medium","CreatedDate":"2017-08-04T12:52:51.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmJDUAY"},"Id":"a9C2A000000bmJDUAY","Duration__c":390,"Log__c":"Okta experienced an issue which caused the Okta home page in US Cell 5 to be inaccessible for a small number of users beginning at 4am PDT. The root cause was traced to an operational procedural error which prevented the correct set of static files and artifacts from being accessible via Okta's CDN (Content Delivery Network) to a subset of users. Approximately 1% of end users in US Cell 5 who attempted to reach the Okta home page via a browser may have received a 404 error; all other customers in US Cell 5 who either accessed Okta via other methods (e.g. API, SAML, WSFED), or whose browser cache was available, were not impacted. \r\n<br><br>\r\nThe issue was resolved by 10:30am PDT by making the missing files accessible to the CDN servers. Operational procedures are being remedied to prevent a future re-occurrence, and alerting thresholds are being lowered for improved internal notification.\r\n<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-August-21-2017-US-Cell-5-Service-Degradation).","Status__c":"Resolved","Start_Date__c":"2017-08-21","Last_Updated__c":"2017-08-23T16:21:54.000+0000","LastModifiedDate":"2017-08-23T16:21:54.000+0000","Category__c":"Minor Service Disruption","Size__c":"Large","CreatedDate":"2017-08-21T17:36:29.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmHvUAI"},"Id":"a9C2A000000bmHvUAI","Duration__c":0,"Log__c":"Beginning at 3:22pm PDT, Okta was alerted to minor latency spikes on a disk volume within US Cell 2. The latency spikes minimally impacted system responsiveness. Upon investigation, customer impact was negligible.","Status__c":"Resolved","Start_Date__c":"2017-08-17","Last_Updated__c":"2017-08-21T23:32:18.000+0000","LastModifiedDate":"2017-08-21T23:32:18.000+0000","Category__c":"Performance Issue","Size__c":"Small","CreatedDate":"2017-08-17T23:04:30.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmBsUAI"},"Id":"a9C2A000000bmBsUAI","Duration__c":25,"Log__c":"Okta experienced a database utilization spike at 6:05am PDT. A subset of the application servers in US Cell 2 did not recover properly which resulted in reduced throughput capacity until the issue was resolved at 6:30am. The reduced throughput caused slowness for approximately 40% of requests while corrective actions were being taken. Customers may also have experienced intermittent AD real-time sync errors during this period. Office365 requests remained unaffected for the duration of the incident.\r\n<br><br>\r\nOkta has determined the root cause for the application servers not recovering properly to be a database driver bug. Application server configuration settings have been adjusted to mitigate future re-occurrence while we test and deploy an upgraded database driver to address the root cause.\r\n<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Performance-Issue-07-11-2017).","Status__c":"Resolved","Start_Date__c":"2017-07-11","Last_Updated__c":"2017-07-15T18:46:18.000+0000","LastModifiedDate":"2017-07-15T18:46:18.000+0000","Category__c":"Performance Issue","Size__c":"Medium","CreatedDate":"2017-07-11T13:24:31.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bmApUAI"},"Id":"a9C2A000000bmApUAI","Duration__c":528,"Log__c":"Okta Experienced a minor service disruption in US Cell 4 where a small number of customer tenants experienced intermittent deprovisioning of some Active Directory or LDAP mastered users. This issue was caused by a synchronization error between Okta Servers in US Cell 4 and an authoritative NTP service as a result of a recent network maintenance configuration change.  For the small number of impacted tenants, the subsequent server clock-drift resulted in intermittent import processing errors, including occasional user deprovisioning. While working to resolve the issue, Okta placed US Cell 4 into a Read-Only mode between 11:27pm and 12:10am PDT. Administrative updates via Okta Admin or the API would have been unavailable during this time. The issue was fully resolved at 6/27/2017 @ 12:10am PDT.\r\n<br> \r\n<br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-User-Unexpectedly-Deactivated-And-Attribute-Updates-Not-Occurring-On-Import-06-20-2017-06-27-2017).","Status__c":"Resolved","Start_Date__c":"2017-06-26","Last_Updated__c":"2017-06-29T23:00:22.000+0000","LastModifiedDate":"2017-06-29T23:00:22.000+0000","Category__c":"Minor Service Disruption","Size__c":"Large","CreatedDate":"2017-06-26T22:24:46.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bm9IUAQ"},"Id":"a9C2A000000bm9IUAQ","Duration__c":34,"Log__c":"Okta experienced a disruption between 8:34pm PST and 9:08pm PST in US Cell 2. A failure in the manual sequencing of a planned database maintenance procedure resulted in slightly elevated error rates. Admins as well as integrations making API update calls would have also experienced extended Read-Only mode while corrective actions were taken. Database maintenance scripts have been augmented to prevent a similar occurrence in the future\r\n<br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-06192017).","Status__c":"Resolved","Start_Date__c":"2017-06-19","Last_Updated__c":"2017-06-22T08:37:10.000+0000","LastModifiedDate":"2017-06-22T08:37:10.000+0000","Category__c":"Minor Service Disruption","Size__c":"Medium","CreatedDate":"2017-06-20T04:06:04.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000bm6BUAQ"},"Id":"a9C2A000000bm6BUAQ","Duration__c":159,"Log__c":"Beginning at 5:45pm PDT, Okta experienced intermittent availability of the Okta Mobile for Android app in the Google Play Store. The issue was due to an unexpected change to the Google Play Store. Okta worked with Google, and full availability of the application was restored at 8:24pm PDT. Users who had previously installed Okta Mobile on their devices were unaffected, as the application continued to work normally throughout the incident. We are continuing to work with Google to avoid similar issues in the future.\r\n<br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Okta-Mobile-Android-Unavailable-In-Google-Play-Store).","Status__c":"Resolved","Start_Date__c":"2017-06-13","Last_Updated__c":"2017-06-16T01:26:00.000+0000","LastModifiedDate":"2017-06-16T01:26:00.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-06-14T03:15:51.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000blruUAA"},"Id":"a9C2A000000blruUAA","Duration__c":38,"Log__c":"Okta experienced a service disruption at 6:01am with increased response times and a small number of authentication failures due to a drop in network throughput between hosts in US Cell 2. Corrective action was taken to address this condition and authentication times returned to normal levels by 6:39am.\r\n<br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-05152017).","Status__c":"Resolved","Start_Date__c":"2017-05-15","Last_Updated__c":"2017-05-18T00:47:21.000+0000","LastModifiedDate":"2017-05-18T00:47:21.000+0000","Category__c":"Minor Service Disruption","Size__c":"Medium","CreatedDate":"2017-05-15T13:19:44.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000blrzUAA"},"Id":"a9C2A000000blrzUAA","Duration__c":56,"Log__c":"Okta experienced a performance degradation of job processing as corrective actions were taken to restore service from an earlier incident. As an investigative step, job processing in US Cell 2 was paused from 6:38am to 7:34am PDT.\r\n<br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-05152017).","Status__c":"Resolved","Start_Date__c":"2017-05-15","Last_Updated__c":"2017-05-18T00:46:55.000+0000","LastModifiedDate":"2017-05-18T00:46:55.000+0000","Category__c":"Performance Issue","Size__c":"Large","CreatedDate":"2017-05-16T23:38:27.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000blcGUAQ"},"Id":"a9C2A000000blcGUAQ","Duration__c":16,"Log__c":"Okta experienced a service disruption between 9:55am PST and 10:11am PST following a database misconfiguration. Intermittent authentication failures may have been experienced by end users between 9:55am and 10:01am. In addition administrators as well as integrations making API update calls in US Cell 2 may have experienced a period of Read-Only mode during this time as corrective actions were taken. \r\n\r\n<br>\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-May-5-2017-Service-Disruption-Database-Failover).","Status__c":"Resolved","Start_Date__c":"2017-05-05","Last_Updated__c":"2017-05-09T20:59:31.000+0000","LastModifiedDate":"2017-05-09T20:59:31.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","CreatedDate":"2017-05-05T17:07:11.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000blcLUAQ"},"Id":"a9C2A000000blcLUAQ","Duration__c":1581,"Log__c":"Okta experienced an intermittent disruption to email delivery starting May 4th, at 8:26am PST. The issue was the result of a bug in a deployment automation script which resulted in an incomplete configuration being applied to one of the email relay servers which had to be relaunched due to hardware failure. The issue was resolved by correcting the server's configuration settings on May 5th, at 10:47am PST. Okta is resolving the deployment script bug and adding additional server launch validation steps to prevent any future re-occurrence of this issue.\r\n\r\n<br>\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-May-5-2017-Email-Feature-Disruption).","Status__c":"Resolved","Start_Date__c":"2017-05-05","Last_Updated__c":"2017-05-09T20:57:38.000+0000","LastModifiedDate":"2017-05-09T20:57:38.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-05-05T17:48:13.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZsoUAG"},"Id":"a9C2A000000XZsoUAG","Duration__c":95,"Log__c":"Starting at 10:15am PDT Okta experienced delays in delivering SMS messages to customers because of a failure with one of our redundant SMS vendors. Messages sent via our secondary vendor were also delayed due to a significant increase in volume. Service was restored at 11:45am PDT and all delayed SMSs were delivered by then. Okta will be working with our messaging vendors to root cause the incident and prevent this from happening in the future. Event Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Feature-Disruption-04-18-2017).","Status__c":"Resolved","Start_Date__c":"2017-04-17","Last_Updated__c":"2017-04-20T00:46:23.000+0000","LastModifiedDate":"2017-04-20T00:46:23.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-04-17T18:16:15.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZl4UAG"},"Id":"a9C2A000000XZl4UAG","Duration__c":47,"Log__c":"Okta experienced a service disruption in US Cell 5 beginning at 7:49pm PDT following a failure in the infrastructure network layer. The failure was the result of a configuration problem that was preventing hosts from establishing new connections as connections needed to be refreshed. While corrective actions were being taken and connections re-established, processing of web and API authentication requests was affected. The cell returned to normal operations by 8:36pm PDT. The issue was traced to a failure of our validation procedure for network infrastructure changes that will be corrected to prevent, detect and promptly repair similar issues in the future.","Status__c":"Resolved","Start_Date__c":"2017-03-20","Last_Updated__c":"2017-03-23T00:12:47.000+0000","LastModifiedDate":"2017-03-23T00:12:47.000+0000","Category__c":"Minor Service Disruption","Size__c":"Medium","CreatedDate":"2017-03-21T03:00:43.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZkGUAW"},"Id":"a9C2A000000XZkGUAW","Duration__c":41,"Log__c":"Okta experienced an issue in US Cell 2 starting at 1:40pm PST when two edge IP addresses were erroneously reassigned from the pool of active IPs. Root cause was traced to an outdated configuration file. While correction actions were in progress, a small percentage of customers may have experienced sporadic connection timeouts. US Cell 2 was returned to normal operations by 2:21pm PST.\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-March-2-2017-Performance-Issue).","Status__c":"Resolved","Start_Date__c":"2017-03-02","Last_Updated__c":"2017-03-15T19:03:27.000+0000","LastModifiedDate":"2017-03-15T19:03:27.000+0000","Category__c":"Performance Issue","Size__c":"Medium","CreatedDate":"2017-03-02T22:16:34.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZiUUAW"},"Id":"a9C2A000000XZiUUAW","Duration__c":16,"Log__c":"Okta experienced a feature disruption between 8:06am PST and 8:22am PST following a database memory management failure. Admins as well as integrations making API update calls in US Cell 1 may have experienced a period of Read-Only mode during this time as corrective actions were taken.","Status__c":"Resolved","Start_Date__c":"2017-02-15","Last_Updated__c":"2017-02-17T02:30:45.000+0000","LastModifiedDate":"2017-02-17T02:30:45.000+0000","Category__c":"Feature Disruption","Size__c":"Small","CreatedDate":"2017-02-15T16:29:09.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZfGUAW"},"Id":"a9C2A000000XZfGUAW","Duration__c":124,"Log__c":"On Thursday, February 2, 2017, between 4:16am and 6:20am PST, Okta experienced a service disruption in US Cell 2 in which end-users experienced latency and errors while accessing Office 365. Between 4:16am and 5:05am PST end-users in US Cell 2 experienced an average 25% error rate connecting to Office 365. Error rates increased between 5:06am and 6:20am PST, and peaked as high as 95% at 6:01am PST. During this time, users may also have experienced latency or errors when connecting to other applications.\r\n<br><br>\r\nFrom 5:30am and 6:05am, end-users in US Cell 1 - 4 also experienced sporadic latency and timeouts, with latency peaking at 40%, while error and timeouts remained below 10% of requests for interactive user sessions. This degradation was mitigated and service returned to normal at approximately 6:20am PST.\r\n<br><br>\r\nThe service disruption was triggered by an anomalous spike in Office 365 authentication requests which were not correctly rate-limited. Okta is investigating the source of the spike in Office 365 authentication requests. Okta has also corrected the rate-limit configuration and added additional capactiy and tuning improvements to prevent this issue from occurring in the future.\r\n<br><br>\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-02022017).","Status__c":"Resolved","Start_Date__c":"2017-02-02","Last_Updated__c":"2017-02-07T01:14:22.000+0000","LastModifiedDate":"2017-02-07T01:14:22.000+0000","Category__c":"Major Service Disruption","Size__c":"Large","CreatedDate":"2017-02-02T12:57:47.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZewUAG"},"Id":"a9C2A000000XZewUAG","Duration__c":127,"Log__c":"Okta experienced a feature disruption in our SAML documentation framework at 11:08am PST as the result of a documentation release framework bug. During this time, administrators who attempted to add SAML applications or view existing SAML setup instructions were unable to do so as the setup instructions were not properly rendered. The issue was resolved by correcting the documentation package bug. The SAML application setup instructions were restored by 1:15pm PST.","Status__c":"Resolved","Start_Date__c":"2017-01-31","Last_Updated__c":"2017-02-02T06:09:47.000+0000","LastModifiedDate":"2017-02-02T06:09:47.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2017-01-31T21:03:34.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZeNUAW"},"Id":"a9C2A000000XZeNUAW","Duration__c":14,"Log__c":"Okta experienced an issue impacting the application router infrastructure which led to timeout and connection failures for customers in US Cells 1, 2, 3 and 4 beginning at 11:28am PST. Root cause was traced to a specific error handling bug in the router infrastructure. Once identified, the bug was bypassed via a config change to restore service across each of the impacted Cells by 11:42am PST.\r\n\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-January-17-2017-Service-Disruption). Login Required.","Status__c":"Resolved","Start_Date__c":"2017-01-17","Last_Updated__c":"2017-01-20T02:05:49.000+0000","LastModifiedDate":"2017-01-20T02:05:49.000+0000","Category__c":"Major Service Disruption","Size__c":"Small","CreatedDate":"2017-01-17T19:34:18.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZe3UAG"},"Id":"a9C2A000000XZe3UAG","Duration__c":780,"Log__c":"Okta experienced a degradation to async processing in US Cell 2 starting at 8:30am PST. This resulted in a delay to job and system log event processing. The start time for import jobs was delayed an average of 3 hours between 8:45am PST and 7:30pm PST. Event processing delays resulted in system log lags up to 5 hours. The degradation was the result of an unintended increase in the volume of jobs and events, which was caused by a backend change to the profile sync functionality. By 9:30pm PST all async processing was at normal levels, and system event log information was current.","Status__c":"Resolved","Start_Date__c":"2017-01-11","Last_Updated__c":"2017-01-14T01:36:45.000+0000","LastModifiedDate":"2017-01-14T01:36:45.000+0000","Category__c":"Performance Issue","Size__c":"Large","CreatedDate":"2017-01-11T17:10:13.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZdeUAG"},"Id":"a9C2A000000XZdeUAG","Duration__c":58,"Log__c":"Okta experienced an unexpected increase in load on the US Cell 1 load balancers beginning at 6:07am PST. The increase was traced to recently updated back-end agent request error handling logic. Approximately 9% of web and API authentication requests intermittently failed while operational actions were taken to rollback the updated agent request error handling logic. Processing of web and API authentication requests returned to normal levels at 7:05am PST. Additional capacity has since been added to the load-balancers and the updated logic has been rolled back in all cells.<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-January-9-2017-Service-Degradation)","Status__c":"Resolved","Start_Date__c":"2017-01-09","Last_Updated__c":"2017-01-13T00:46:55.000+0000","LastModifiedDate":"2017-01-13T00:46:55.000+0000","Category__c":"Minor Service Disruption","Size__c":"Large","CreatedDate":"2017-01-09T16:12:20.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZdjUAG"},"Id":"a9C2A000000XZdjUAG","Duration__c":17,"Log__c":"Okta experienced an unexpected increase in load on the US Cell 3 load balancers beginning at 7:59am PST. The increase was traced to recently updated back-end agent request error handling logic. Approximately 6% of web and API authentication requests intermittently failed while operational actions were taken to rollback the updated agent request error handling logic. Processing of web and API authentication requests returned to normal levels at 8:16am PST. Additional capacity has since been added to the load-balancers and the updated logic has been rolled back in all cells.<br><br> \r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-January-9-2017-Service-Degradation)","Status__c":"Resolved","Start_Date__c":"2017-01-09","Last_Updated__c":"2017-01-13T00:46:36.000+0000","LastModifiedDate":"2017-01-13T00:46:36.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","CreatedDate":"2017-01-09T16:18:13.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZcgUAG"},"Id":"a9C2A000000XZcgUAG","Duration__c":25,"Log__c":"Okta experienced an unexpected database connection spike in US Cell 1 beginning at 5:50am PST following the initiation of an database transaction that did not perform as expected. The spike impacted the successful processing of a subset of web and API authentication requests as well as intermittent failure of administrative functions. Between 6:06am and 6:10am a peak of 10% of web and API authentication requests failed. Administrative functions would have seen intermittent failures while operational actions were taken to return the service to a healthy state at 6:15am.","Status__c":"Resolved","Start_Date__c":"2016-12-21","Last_Updated__c":"2016-12-23T17:36:48.000+0000","LastModifiedDate":"2016-12-23T17:36:48.000+0000","Category__c":"Feature Disruption","Size__c":"Medium","CreatedDate":"2016-12-21T17:20:30.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZdZUAW"},"Id":"a9C2A000000XZdZUAW","Duration__c":321,"Log__c":"Okta experienced a delay in running a subset of asynchronous jobs such as scheduled import in US Cell 1 as an unintended consequence of the database connection spike experienced earlier. Delays varied from customer to customer based on specific jobs scheduled from 05:50am to 11:11am PST.","Status__c":"Resolved","Start_Date__c":"2016-12-21","Last_Updated__c":"2016-12-23T17:34:39.000+0000","LastModifiedDate":"2016-12-23T17:34:39.000+0000","Category__c":"Performance Issue","Size__c":"Large","CreatedDate":"2016-12-23T17:34:39.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZb9UAG"},"Id":"a9C2A000000XZb9UAG","Duration__c":8,"Log__c":"Okta experienced an unexpected database connection spike in US Cell 2 beginning at 6:36am PST following the initiation of an operational script to address a failure in our caching infrastructure. The spike impacted the successful processing of a subset of web and API authentication requests. Approximately 11% of web and API authentication requests failed intermittently while operational actions were taken to return the service to a healthy state. Processing of web and API authentication requests returned to normal levels at 6:44am PST.","Status__c":"Resolved","Start_Date__c":"2016-12-16","Last_Updated__c":"2016-12-21T21:57:32.000+0000","LastModifiedDate":"2016-12-21T21:57:32.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","CreatedDate":"2016-12-16T14:50:00.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZclUAG"},"Id":"a9C2A000000XZclUAG","Duration__c":35,"Log__c":"Following a database server failure at 6:36am PST Okta experienced a service degradation in US Cell 2 where administrative functions were intermittently disabled while operational actions were taken to resolve the issue. Service was returned to normal at 07:11am PDT.","Status__c":"Resolved","Start_Date__c":"2016-12-16","Last_Updated__c":"2016-12-21T21:56:38.000+0000","LastModifiedDate":"2016-12-21T21:56:38.000+0000","Category__c":"Feature Disruption","Size__c":"Medium","CreatedDate":"2016-12-21T21:56:38.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZYPUA4"},"Id":"a9C2A000000XZYPUA4","Duration__c":94,"Log__c":"Okta experienced a cache infrastructure failure in US Cell 2 beginning at 10:10am PST. This affected the successful processing of a subset of web and API authentication requests, except those from O365 native clients. Approximately 13% of web and API authentication requests failed intermittently while operational actions were taken to return the cache to a healthy state. Processing of web and API authentication requests returned to normal levels at 11:44am PST.","Status__c":"Resolved","Start_Date__c":"2016-11-30","Last_Updated__c":"2016-12-02T23:27:03.000+0000","LastModifiedDate":"2016-12-02T23:27:03.000+0000","Category__c":"Minor Service Disruption","Size__c":"Large","CreatedDate":"2016-11-30T19:10:07.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZYKUA4"},"Id":"a9C2A000000XZYKUA4","Duration__c":9,"Log__c":"Okta experienced an issue starting at 4:51pm PST when monitoring alerts surfaced a minor database configuration issue. The misconfiguration impacted the Okta usage count displayed on the reports dashboard for a small number of Admins in US Cell 1. System event logging throughput was reduced for approximately 9 minutes as the issue was addressed.","Status__c":"Resolved","Start_Date__c":"2016-11-29","Last_Updated__c":"2016-12-01T17:28:41.000+0000","LastModifiedDate":"2016-12-01T17:28:41.000+0000","Category__c":"Performance Issue","Size__c":"Small","CreatedDate":"2016-11-30T01:02:28.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZXbUAO"},"Id":"a9C2A000000XZXbUAO","Duration__c":26,"Log__c":"Okta experienced an automation failure with server updates in EMEA Cell 1 starting at 12:38pm PST . This prevented the successful processing of web and API authentication requests, except those from O365 native clients, from customers in EMEA Cell 1. The underlying issue was corrected by returning the servers to the correct configuration, and service was restored at 1:03pm PST.","Status__c":"Resolved","Start_Date__c":"2016-11-15","Last_Updated__c":"2016-11-18T15:27:06.000+0000","LastModifiedDate":"2016-11-18T15:27:06.000+0000","Category__c":"Minor Service Disruption","Size__c":"Medium","CreatedDate":"2016-11-15T20:58:57.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZX2UAO"},"Id":"a9C2A000000XZX2UAO","Duration__c":4211,"Log__c":"Okta experienced a feature degradation to provisioning features with Angelpoints, DropboxBusiness, EventBoard, OrgWiki, Rally, Slack, SmartRecruiters and SuccessFactors in US Cell 2. The issue was traced to a configuration error introduced Nov 7th, 1:30pm PST. Because just one server was impacted, the app errors occurred sporadically; approximately 2% of customers received intermittent errors when leveraging provisioning features for the aforementioned apps. The issue was addressed by removing the problematic server and correcting the configuration. Additional validation steps and monitoring were added to the relevant systems to prevent similar issues from occurring in the future. The impacted apps were functioning normally for all customers by Nov 10th, 11:41am PST.","Status__c":"Resolved","Start_Date__c":"2016-11-10","Last_Updated__c":"2016-11-13T22:17:32.000+0000","LastModifiedDate":"2016-11-13T22:17:32.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2016-11-10T19:09:55.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZWTUA4"},"Id":"a9C2A000000XZWTUA4","Duration__c":272,"Log__c":"A small subset of customers continued to experience issues accessing Okta as a result of residual DNS caching issues following the Dyn DDoS event. Okta provided customers with instructions on how to best address any residual impact. In addition, a subset of customers also reported issues connecting to Okta from Verizon networks or devices. The issue was abated at approximately 1:17pm PDT. No remediation action was required by Okta\r\n<br><br>\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-Okta-DNS-Disruption-October-21st-2016).","Status__c":"Resolved","Start_Date__c":"2016-10-21","Last_Updated__c":"2016-10-27T23:19:41.000+0000","LastModifiedDate":"2016-10-27T23:19:41.000+0000","Category__c":"Minor Service Disruption","Size__c":"Large","CreatedDate":"2016-10-27T23:19:41.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000XZVuUAO"},"Id":"a9C2A000000XZVuUAO","Duration__c":275,"Log__c":"Beginning at 4:10am PDT, Okta's US service infrastructure experienced an elevated error rate and connection issues for users attempting to access Okta resources. Okta immediately began investigating the issue and at 5:40am PDT identified the root cause of the issue as a distributed denial-of-service (DDoS) attack against the Domain Name Service (DNS) provider Dyn. During this time the average error rate was 12.43%.\r\n<br><br>\r\nAt 6:18am PDT, Okta completed migration of all US DNS records to a secondary DNS provider unaffected by the DDoS attack and service was returned to normal for most customers by 7:11am PDT. Users experienced an average error rate of 8.4% during this time.\r\n<br><br>\r\nAt 7:12am PDT, requests to US Cells 1 & 2 experienced an average error rate of 9.28% This increase in errors was due to an usually high number of requests in flight following the restoration of DNS. Additional capacity was added to satisfy these requests which fully restored service by 8:45am PDT.\r\n<br><br>\r\nEvent Root Cause Analysis details can be found [here](https://support.okta.com/help/articles/Knowledge_Article/Root-Cause-Analysis-Okta-DNS-Disruption-October-21st-2016).","Status__c":"Resolved","Start_Date__c":"2016-10-21","Last_Updated__c":"2016-10-27T23:06:35.000+0000","LastModifiedDate":"2016-10-27T23:06:35.000+0000","Category__c":"Major Service Disruption","Size__c":"Large","CreatedDate":"2016-10-21T12:32:05.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBZwUAO"},"Id":"a9C2A000000PBZwUAO","Duration__c":3,"Log__c":"Okta experienced a service degradation from 10:54am - 10:57am PDT due to a database server misconfiguration, causing a low memory condition to be improperly handled in US Cell 1, which resulted in intermittent internal server errors for a subset of end user, admin, and API activity.","Status__c":"Resolved","Start_Date__c":"2016-10-04","Last_Updated__c":"2016-10-10T16:55:22.000+0000","LastModifiedDate":"2016-10-10T16:55:22.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","CreatedDate":"2016-10-04T18:05:36.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBaBUAW"},"Id":"a9C2A000000PBaBUAW","Duration__c":14,"Log__c":"Following a database server failure from 10:54am - 10:57am, Okta experienced a service degradation in US Cell 1. At 11:00am PDT, administrative functions were disabled while operational actions were taken to resolve the issue. Service was returned to normal at 11:11am PDT.","Status__c":"Resolved","Start_Date__c":"2016-10-04","Last_Updated__c":"2016-10-10T16:55:02.000+0000","LastModifiedDate":"2016-10-10T16:55:02.000+0000","Category__c":"Feature Disruption","Size__c":"Small","CreatedDate":"2016-10-10T16:49:59.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBZNUA4"},"Id":"a9C2A000000PBZNUA4","Duration__c":9,"Log__c":"Okta experienced a service degradation starting at 12:43pm PDT due to application server tier errors in US Cell 2 which resulted in intermittent internal server errors for a subset of end user, admin, and API activity. The error responses impacted 7% of traffic and occurred between 12:43pm and 12:45pm PDT, and 12:57pm and 1:04pm. Operational actions were taken and service was returned to normal at 1:04pm PDT.","Status__c":"Resolved","Start_Date__c":"2016-09-28","Last_Updated__c":"2016-10-03T02:02:47.000+0000","LastModifiedDate":"2016-10-03T02:02:47.000+0000","Category__c":"Minor Service Disruption","Size__c":"Small","CreatedDate":"2016-09-28T19:56:21.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBYeUAO"},"Id":"a9C2A000000PBYeUAO","Duration__c":28,"Log__c":"Okta experienced a brief feature disruption between 5:46am and 6:14am PDT due to a database infrastructure failure. API CRUD calls and Admins in US Cell 4 may have experienced a period of Read-Only mode during this time as corrective actions were taken.","Status__c":"Resolved","Start_Date__c":"2016-09-22","Last_Updated__c":"2016-09-25T06:00:23.000+0000","LastModifiedDate":"2016-09-25T06:00:23.000+0000","Category__c":"Feature Disruption","Size__c":"Medium","CreatedDate":"2016-09-22T13:12:00.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBYZUA4"},"Id":"a9C2A000000PBYZUA4","Duration__c":1100,"Log__c":"Okta experienced a feature disruption between 5am PDT and 11:20pm PDT Sep 21st. The issue impacted Okta user provisioning based on Google group application assignments. The issue was traced to a recurrence of the previous day's third party API change which affected approximately 1% of Okta customers - those using Google imports and nested groups for app assignments. Okta provisioning for all Google apps was confirmed to be functioning normally by 11:30pm PDT.","Status__c":"Resolved","Start_Date__c":"2016-09-21","Last_Updated__c":"2016-09-23T15:52:58.000+0000","LastModifiedDate":"2016-09-23T15:52:58.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2016-09-21T21:25:54.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9C2A000000PBYUUA4"},"Id":"a9C2A000000PBYUUA4","Duration__c":1297,"Log__c":"Okta experienced a feature disruption between 4:00am PDT Sep 19th and 1:37pm PDT Sep 20th. The issue impacted Okta user provisioning based on Google group application assignments, and was escalated by late morning. The issue was traced to a third party API change which affected approximately 1% of Okta customers - those using Google imports and nested groups for app assignments. Confirmation was received at 1:37pm PDT that the breaking API change had been reverted.","Status__c":"Resolved","Start_Date__c":"2016-09-20","Last_Updated__c":"2016-09-23T00:11:05.000+0000","LastModifiedDate":"2016-09-23T00:11:05.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2016-09-20T18:52:14.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9CF00000008P6PMAU"},"Id":"a9CF00000008P6PMAU","Duration__c":20,"Log__c":"Okta experienced a brief feature disruption between 4:40pm and 5:00pm PDT due to a database infrastructure failure. Admins in *.okta-emea.com may have experienced a period of Read-Only mode during this time as corrective actions were taken.","Status__c":"Resolved","Start_Date__c":"2016-07-28","Last_Updated__c":"2016-08-02T09:56:46.000+0000","LastModifiedDate":"2016-08-02T09:56:46.000+0000","Category__c":"Feature Disruption","Size__c":"Small","CreatedDate":"2016-07-28T23:59:57.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9CF00000008P5MMAU"},"Id":"a9CF00000008P5MMAU","Duration__c":108,"Log__c":"Okta experienced a feature disruption between 8:02 and 9:50am PDT with authenticating to Microsoft Office 365. An unexpected traffic pattern impacted downstream caching infrastructure and as a result, approximately 10% of requests to authenticate to O365 during this time encountered intermittent HTTP 500 errors. Due to mitigating actions to improve performance, Okta Admins may have observed delays in job processing as well. As the caching infrastructure was being restored, additional capacity was added to reduce impact as soon as possible.","Status__c":"Resolved","Start_Date__c":"2016-07-18","Last_Updated__c":"2016-07-20T23:42:31.000+0000","LastModifiedDate":"2016-07-20T23:42:31.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2016-07-18T15:38:50.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9CF00000008P4dMAE"},"Id":"a9CF00000008P4dMAE","Duration__c":5,"Log__c":"Okta experienced a Performance Degradation between 6:08am and 6:13am PDT as the result of an operational error which temporarily reduced service capacity for a subset of customers. Approximately 4% (peak) of requests resulted in sporadic HTTP 500 errors. The issue was quickly identified and resolved, though some users may have experienced intermittent errors beyond this time while Okta worked to restore full capacity.","Status__c":"Resolved","Start_Date__c":"2016-07-01","Last_Updated__c":"2016-07-08T18:58:54.000+0000","LastModifiedDate":"2016-07-08T18:58:54.000+0000","Category__c":"Performance Issue","Size__c":"Small","CreatedDate":"2016-07-08T18:58:54.000+0000","CurrencyIsoCode":"USD"},{"attributes":{"type":"Incident__c","url":"/services/data/v43.0/sobjects/Incident__c/a9CF00000008P3VMAU"},"Id":"a9CF00000008P3VMAU","Duration__c":656,"Log__c":"Okta experienced a feature disruption between 2:51am and 1:47pm PDT. Due to a data migration bug related to the roll-out of a feature enhancement, customers in the Okta Europe cell (okta-emea.com) had their Active Directory import configurations modified.  Immediately after the issue was identified, all Active Directory imports were paused in okta-emea.com to prevent widespread impact.  Affected customers may have observed delays in Active Directory Imports or Import Safeguard warnings.  Okta worked directly with three customers which experienced application assignment and provisioning issues, and corrected configuration changes to resolve the issue.","Status__c":"Resolved","Start_Date__c":"2016-07-01","Last_Updated__c":"2016-07-07T08:12:57.000+0000","LastModifiedDate":"2016-07-07T08:12:57.000+0000","Category__c":"Feature Disruption","Size__c":"Large","CreatedDate":"2016-07-01T09:50:21.000+0000","CurrencyIsoCode":"USD"}][{"year":2010, "uptime":99.98, "month":["100.000","100.000","100.000","100.000","99.955","100.000","100.000","99.933","99.928","99.960","100.000","100.000"]},{"year":2011, "uptime":99.96, "month":["99.973","99.980","100.000","99.977","99.969","99.954","100.000","99.917","99.889","99.964","100.000","99.953"]},{"year":2012, "uptime":99.9966, "month":["100.000","100.000","99.996","100.000","100.000","100.000","100.000","99.964","100.000","100.000","100.000","100.000"]},{"year":2013, "uptime":99.9994, "month":["99.993","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000"]},{"year":2014, "uptime":99.95, "month":["100.000","100.000","100.000","100.000","100.000","100.000","100.000","99.610","99.824","99.993","100.000","99.980"]},{"year":2015, "uptime":100.0000, "month":["100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000"]},{"year":2016, "uptime":99.95, "month":["100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","99.384","100.000","100.000"]},{"year":2017, "uptime":99.97, "month":["99.969","99.692","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000","100.000"]},{"year":2018, "uptime":100.0000, "month":["100.000","100.000","100.000","100.000","100.000","100.000","","","","","",""]}][{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XjOQXhQQO"},"Id":"0172A0000XjOQXhQQO","ParentId":"a9C2A000000XZX2UAO","CreatedDate":"2016-11-10T19:09:55.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XAa1hOQQR"},"Id":"0172A0000XAa1hOQQR","ParentId":"a9C2A000000PBZNUA4","CreatedDate":"2016-09-28T19:56:21.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YMaKHdQQN"},"Id":"0172A0000YMaKHdQQN","ParentId":"a9C2A000000XZdjUAG","CreatedDate":"2017-01-09T16:18:13.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XE7EB3QQN"},"Id":"0172A0000XE7EB3QQN","ParentId":"a9C2A000000PBZwUAO","CreatedDate":"2016-10-04T18:05:36.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000Y5q6tBQQQ"},"Id":"0172A0000Y5q6tBQQQ","ParentId":"a9C2A000000XZb9UAG","CreatedDate":"2016-12-16T14:50:00.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XuGYxRQQW"},"Id":"0172A0000XuGYxRQQW","ParentId":"a9C2A000000XZYKUA4","CreatedDate":"2016-11-30T01:02:28.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XGw8wXQQR"},"Id":"0172A0000XGw8wXQQR","ParentId":"a9C2A000000PBaBUAW","CreatedDate":"2016-10-10T16:49:59.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YcwVFkQQM"},"Id":"0172A0000YcwVFkQQM","ParentId":"a9C2A000000XZfGUAW","CreatedDate":"2017-02-02T12:57:47.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XWliV8QQJ"},"Id":"0172A0000XWliV8QQJ","ParentId":"a9C2A000000XZVuUAO","CreatedDate":"2016-10-21T12:32:05.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YBh4fAQQR"},"Id":"0172A0000YBh4fAQQR","ParentId":"a9C2A000000XZcgUAG","CreatedDate":"2016-12-21T17:20:30.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YBiCLJQQ3"},"Id":"0172A0000YBiCLJQQ3","ParentId":"a9C2A000000XZclUAG","CreatedDate":"2016-12-21T21:56:39.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000X3Nwe4QQC"},"Id":"0172A0000X3Nwe4QQC","ParentId":"a9C2A000000PBYZUA4","CreatedDate":"2016-09-21T21:25:54.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000X2AyT4QQK"},"Id":"0172A0000X2AyT4QQK","ParentId":"a9C2A000000PBYUUA4","CreatedDate":"2016-09-20T18:52:14.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000X3mlCnQQI"},"Id":"0172A0000X3mlCnQQI","ParentId":"a9C2A000000PBYeUAO","CreatedDate":"2016-09-22T13:12:00.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YMaIhNQQV"},"Id":"0172A0000YMaIhNQQV","ParentId":"a9C2A000000XZdeUAG","CreatedDate":"2017-01-09T16:12:20.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XanMc9QQE"},"Id":"0172A0000XanMc9QQE","ParentId":"a9C2A000000XZWTUA4","CreatedDate":"2016-10-27T23:19:41.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YD9IfHQQV"},"Id":"0172A0000YD9IfHQQV","ParentId":"a9C2A000000XZdZUAW","CreatedDate":"2016-12-23T17:34:39.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YOaZuLQQV"},"Id":"0172A0000YOaZuLQQV","ParentId":"a9C2A000000XZe3UAG","CreatedDate":"2017-01-11T17:10:13.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YbiwOrQQI"},"Id":"0172A0000YbiwOrQQI","ParentId":"a9C2A000000XZewUAG","CreatedDate":"2017-01-31T21:03:34.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YyEfV3QQK"},"Id":"0172A0000YyEfV3QQK","ParentId":"a9C2A000000XZkGUAW","CreatedDate":"2017-03-02T22:16:34.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YktEugQQE"},"Id":"0172A0000YktEugQQE","ParentId":"a9C2A000000XZiUUAW","CreatedDate":"2017-02-15T16:29:10.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XuJp7uQQC"},"Id":"0172A0000XuJp7uQQC","ParentId":"a9C2A000000XZYPUA4","CreatedDate":"2016-11-30T19:10:08.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000YS5CkxQQF"},"Id":"0172A0000YS5CkxQQF","ParentId":"a9C2A000000XZeNUAW","CreatedDate":"2017-01-17T19:34:18.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ZmpbvtQQA"},"Id":"0172A0000ZmpbvtQQA","ParentId":"a9C2A000000blcLUAQ","CreatedDate":"2017-05-05T17:48:13.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ZmpUXIQQ2"},"Id":"0172A0000ZmpUXIQQ2","ParentId":"a9C2A000000blcGUAQ","CreatedDate":"2017-05-05T17:07:11.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000aDMIbhQAH"},"Id":"0172A0000aDMIbhQAH","ParentId":"a9C2A000000bm6BUAQ","CreatedDate":"2017-06-14T03:15:51.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ZBIEbYQQX"},"Id":"0172A0000ZBIEbYQQX","ParentId":"a9C2A000000XZl4UAG","CreatedDate":"2017-03-21T03:00:43.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ahD4bJQAS"},"Id":"0172A0000ahD4bJQAS","ParentId":"a9C2A000000bmBsUAI","CreatedDate":"2017-07-11T13:24:32.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ZtrmGjQQI"},"Id":"0172A0000ZtrmGjQQI","ParentId":"a9C2A000000blruUAA","CreatedDate":"2017-05-15T13:19:44.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000bPuQwbQAF"},"Id":"0172A0000bPuQwbQAF","ParentId":"a9C2A000000KyvbUAC","CreatedDate":"2017-09-13T14:33:13.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000Zv44fQQQQ"},"Id":"0172A0000Zv44fQQQQ","ParentId":"a9C2A000000blrzUAA","CreatedDate":"2017-05-16T23:38:27.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ZY6QjkQQF"},"Id":"0172A0000ZY6QjkQQF","ParentId":"a9C2A000000XZsoUAG","CreatedDate":"2017-04-17T18:16:15.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000aMdrFpQAJ"},"Id":"0172A0000aMdrFpQAJ","ParentId":"a9C2A000000bmApUAI","CreatedDate":"2017-06-26T22:24:46.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000aHNE4gQAH"},"Id":"0172A0000aHNE4gQAH","ParentId":"a9C2A000000bm9IUAQ","CreatedDate":"2017-06-20T04:06:05.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000b7Rg1CQAS"},"Id":"0172A0000b7Rg1CQAS","ParentId":"a9C2A000000bmHvUAI","CreatedDate":"2017-08-17T23:04:30.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000bGmbCSQAZ"},"Id":"0172A0000bGmbCSQAZ","ParentId":"a9C2A000000Kyv2UAC","CreatedDate":"2017-08-31T17:37:43.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000b96tesQAA"},"Id":"0172A0000b96tesQAA","ParentId":"a9C2A000000bmJDUAY","CreatedDate":"2017-08-21T17:36:30.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000bzbOt9QAE"},"Id":"0172A0000bzbOt9QAE","ParentId":"a9C2A000000Kz0WUAS","CreatedDate":"2017-10-25T13:24:12.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000dPqFUHQA3"},"Id":"0172A0000dPqFUHQA3","ParentId":"a9C2A000000KzXkUAK","CreatedDate":"2018-02-01T17:01:35.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000dQcNrEQAV"},"Id":"0172A0000dQcNrEQAV","ParentId":"a9C2A000000KzYJUA0","CreatedDate":"2018-02-02T17:48:52.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000eIqo6FQAR"},"Id":"0172A0000eIqo6FQAR","ParentId":"a9C2A000000bmK1UAI","CreatedDate":"2018-03-30T14:36:53.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000ayVnJsQAK"},"Id":"0172A0000ayVnJsQAK","ParentId":"a9C2A000000bmESUAY","CreatedDate":"2017-08-04T12:52:51.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000axTPnpQAG"},"Id":"0172A0000axTPnpQAG","ParentId":"a9C2A000000bmDeUAI","CreatedDate":"2017-08-03T12:31:20.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000bZO71eQAD"},"Id":"0172A0000bZO71eQAD","ParentId":"a9C2A000000KyxrUAC","CreatedDate":"2017-09-26T13:16:54.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000bv1PXsQAM"},"Id":"0172A0000bv1PXsQAM","ParentId":"a9C2A000000Kz0CUAS","CreatedDate":"2017-10-19T17:04:56.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000cDinMDQAZ"},"Id":"0172A0000cDinMDQAZ","ParentId":"a9C2A000000Kz15UAC","CreatedDate":"2017-11-10T23:54:33.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000dkdFSHQA2"},"Id":"0172A0000dkdFSHQA2","ParentId":"a9C2A000000PBiBUAW","CreatedDate":"2018-02-25T17:30:37.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000dtveDyQAI"},"Id":"0172A0000dtveDyQAI","ParentId":"a9C2A000000PBikUAG","CreatedDate":"2018-03-07T18:00:08.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000e3AmZOQA0"},"Id":"0172A0000e3AmZOQA0","ParentId":"a9C2A0000004CSTUA2","CreatedDate":"2018-03-16T17:12:34.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000e6vxu3QAA"},"Id":"0172A0000e6vxu3QAA","ParentId":"a9C2A0000004CSnUAM","CreatedDate":"2018-03-20T22:11:19.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOzIQJ"},"Id":"017F00000JQ9yOzIQJ","ParentId":"a9CF0000000PB8SMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP0IQJ"},"Id":"017F00000JQ9yP0IQJ","ParentId":"a9CF0000000PB8TMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP1IQJ"},"Id":"017F00000JQ9yP1IQJ","ParentId":"a9CF0000000PB8UMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP2IQJ"},"Id":"017F00000JQ9yP2IQJ","ParentId":"a9CF0000000PB8VMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP3IQJ"},"Id":"017F00000JQ9yP3IQJ","ParentId":"a9CF0000000PB8WMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP4IQJ"},"Id":"017F00000JQ9yP4IQJ","ParentId":"a9CF0000000PB8XMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP5IQJ"},"Id":"017F00000JQ9yP5IQJ","ParentId":"a9CF0000000PB8YMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP6IQJ"},"Id":"017F00000JQ9yP6IQJ","ParentId":"a9CF0000000PB8ZMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP7IQJ"},"Id":"017F00000JQ9yP7IQJ","ParentId":"a9CF0000000PB8aMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP8IQJ"},"Id":"017F00000JQ9yP8IQJ","ParentId":"a9CF0000000PB8bMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yP9IQJ"},"Id":"017F00000JQ9yP9IQJ","ParentId":"a9CF0000000PB8cMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yPAIQZ"},"Id":"017F00000JQ9yPAIQZ","ParentId":"a9CF0000000PB8dMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yPBIQZ"},"Id":"017F00000JQ9yPBIQZ","ParentId":"a9CF0000000PB8eMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yPCIQZ"},"Id":"017F00000JQ9yPCIQZ","ParentId":"a9CF0000000PB8fMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQA7u8IQD"},"Id":"017F00000JQA7u8IQD","ParentId":"a9CF0000000PB8gMAG","CreatedDate":"2015-04-14T05:39:20.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000LFUUgFIQX"},"Id":"017F00000LFUUgFIQX","ParentId":"a9CF0000000PBLVMA4","CreatedDate":"2015-06-30T03:16:11.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000O1YFpfIQG"},"Id":"017F00000O1YFpfIQG","ParentId":"a9CF0000000blP2MAI","CreatedDate":"2015-10-23T19:05:05.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MKBPzvIQH"},"Id":"017F00000MKBPzvIQH","ParentId":"a9CF0000000PBTjMAO","CreatedDate":"2015-08-14T19:54:29.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MKCfqsIQD"},"Id":"017F00000MKCfqsIQD","ParentId":"a9CF0000000PBU3MAO","CreatedDate":"2015-08-14T20:34:26.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JVVNyzIQH"},"Id":"017F00000JVVNyzIQH","ParentId":"a9CF0000000PBAcMAO","CreatedDate":"2015-04-17T17:55:31.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JVVNz0IQH"},"Id":"017F00000JVVNz0IQH","ParentId":"a9CF0000000PBAdMAO","CreatedDate":"2015-04-17T17:55:31.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000LrqPhlIQE"},"Id":"017F00000LrqPhlIQE","ParentId":"a9CF0000000PBR4MAO","CreatedDate":"2015-07-27T12:15:12.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000N7c11cIQA"},"Id":"017F00000N7c11cIQA","ParentId":"a9CF0000000XZIGMA4","CreatedDate":"2015-09-16T21:19:06.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000RQZEn4IQH"},"Id":"017F00000RQZEn4IQH","ParentId":"a9CF00000008OZQMA2","CreatedDate":"2016-03-09T23:30:15.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000PmIKP9IQO"},"Id":"017F00000PmIKP9IQO","ParentId":"a9CF00000008OMlMAM","CreatedDate":"2016-01-07T03:43:54.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000Trj366IQA"},"Id":"017F00000Trj366IQA","ParentId":"a9CF00000008OvlMAE","CreatedDate":"2016-06-06T13:06:18.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000Trktn8IQA"},"Id":"017F00000Trktn8IQA","ParentId":"a9CF00000008OvqMAE","CreatedDate":"2016-06-06T18:30:27.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000P7rOOpIQM"},"Id":"017F00000P7rOOpIQM","ParentId":"a9CF0000000KyuEMAS","CreatedDate":"2015-12-10T01:08:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000UcibJsIQI"},"Id":"017F00000UcibJsIQI","ParentId":"a9CF00000008P3VMAU","CreatedDate":"2016-07-01T09:50:21.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000PhcK6DIQU"},"Id":"017F00000PhcK6DIQU","ParentId":"a9CF00000008OM2MAM","CreatedDate":"2016-01-04T18:09:55.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000SifR7IIQU"},"Id":"017F00000SifR7IIQU","ParentId":"a9CF00000008OihMAE","CreatedDate":"2016-04-23T00:36:14.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000UpbR6fIQE"},"Id":"017F00000UpbR6fIQE","ParentId":"a9CF00000008P4dMAE","CreatedDate":"2016-07-08T18:58:54.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000VRWdLBIQ1"},"Id":"017F00000VRWdLBIQ1","ParentId":"a9CF00000008P6PMAU","CreatedDate":"2016-07-28T23:59:57.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000dd2OQ9QAM"},"Id":"0172A0000dd2OQ9QAM","ParentId":"a9C2A000000PBhNUAW","CreatedDate":"2018-02-16T00:14:24.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000duuLFgQAM"},"Id":"0172A0000duuLFgQAM","ParentId":"a9C2A000000PBipUAG","CreatedDate":"2018-03-08T01:24:58.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JbZMPBIQ4"},"Id":"017F00000JbZMPBIQ4","ParentId":"a9CF0000000PBBaMAO","CreatedDate":"2015-04-22T15:30:23.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000KmSvSkIQK"},"Id":"017F00000KmSvSkIQK","ParentId":"a9CF0000000PBJAMA4","CreatedDate":"2015-06-11T01:25:08.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yHYIQZ"},"Id":"017F00000JQ9yHYIQZ","ParentId":"a9CF0000000PB78MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yHZIQZ"},"Id":"017F00000JQ9yHZIQZ","ParentId":"a9CF0000000PB79MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yHaIQJ"},"Id":"017F00000JQ9yHaIQJ","ParentId":"a9CF0000000PB7AMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNiIQJ"},"Id":"017F00000JQ9yNiIQJ","ParentId":"a9CF0000000PB7BMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNjIQJ"},"Id":"017F00000JQ9yNjIQJ","ParentId":"a9CF0000000PB7CMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNkIQJ"},"Id":"017F00000JQ9yNkIQJ","ParentId":"a9CF0000000PB7DMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNlIQJ"},"Id":"017F00000JQ9yNlIQJ","ParentId":"a9CF0000000PB7EMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNnIQJ"},"Id":"017F00000JQ9yNnIQJ","ParentId":"a9CF0000000PB7GMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNoIQJ"},"Id":"017F00000JQ9yNoIQJ","ParentId":"a9CF0000000PB7HMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNpIQJ"},"Id":"017F00000JQ9yNpIQJ","ParentId":"a9CF0000000PB7IMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNqIQJ"},"Id":"017F00000JQ9yNqIQJ","ParentId":"a9CF0000000PB7JMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNrIQJ"},"Id":"017F00000JQ9yNrIQJ","ParentId":"a9CF0000000PB7KMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNsIQJ"},"Id":"017F00000JQ9yNsIQJ","ParentId":"a9CF0000000PB7LMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNtIQJ"},"Id":"017F00000JQ9yNtIQJ","ParentId":"a9CF0000000PB7MMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNuIQJ"},"Id":"017F00000JQ9yNuIQJ","ParentId":"a9CF0000000PB7NMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNvIQJ"},"Id":"017F00000JQ9yNvIQJ","ParentId":"a9CF0000000PB7OMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNwIQJ"},"Id":"017F00000JQ9yNwIQJ","ParentId":"a9CF0000000PB7PMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNxIQJ"},"Id":"017F00000JQ9yNxIQJ","ParentId":"a9CF0000000PB7QMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNyIQJ"},"Id":"017F00000JQ9yNyIQJ","ParentId":"a9CF0000000PB7RMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yNzIQJ"},"Id":"017F00000JQ9yNzIQJ","ParentId":"a9CF0000000PB7SMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO0IQJ"},"Id":"017F00000JQ9yO0IQJ","ParentId":"a9CF0000000PB7TMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO1IQJ"},"Id":"017F00000JQ9yO1IQJ","ParentId":"a9CF0000000PB7UMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO2IQJ"},"Id":"017F00000JQ9yO2IQJ","ParentId":"a9CF0000000PB7VMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO3IQJ"},"Id":"017F00000JQ9yO3IQJ","ParentId":"a9CF0000000PB7WMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO4IQJ"},"Id":"017F00000JQ9yO4IQJ","ParentId":"a9CF0000000PB7XMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO5IQJ"},"Id":"017F00000JQ9yO5IQJ","ParentId":"a9CF0000000PB7YMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO6IQJ"},"Id":"017F00000JQ9yO6IQJ","ParentId":"a9CF0000000PB7ZMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO7IQJ"},"Id":"017F00000JQ9yO7IQJ","ParentId":"a9CF0000000PB7aMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO8IQJ"},"Id":"017F00000JQ9yO8IQJ","ParentId":"a9CF0000000PB7bMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yO9IQJ"},"Id":"017F00000JQ9yO9IQJ","ParentId":"a9CF0000000PB7cMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOAIQZ"},"Id":"017F00000JQ9yOAIQZ","ParentId":"a9CF0000000PB7dMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOBIQZ"},"Id":"017F00000JQ9yOBIQZ","ParentId":"a9CF0000000PB7eMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOCIQZ"},"Id":"017F00000JQ9yOCIQZ","ParentId":"a9CF0000000PB7fMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yODIQZ"},"Id":"017F00000JQ9yODIQZ","ParentId":"a9CF0000000PB7gMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOEIQZ"},"Id":"017F00000JQ9yOEIQZ","ParentId":"a9CF0000000PB7hMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOFIQZ"},"Id":"017F00000JQ9yOFIQZ","ParentId":"a9CF0000000PB7iMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOGIQZ"},"Id":"017F00000JQ9yOGIQZ","ParentId":"a9CF0000000PB7jMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOHIQZ"},"Id":"017F00000JQ9yOHIQZ","ParentId":"a9CF0000000PB7kMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOIIQZ"},"Id":"017F00000JQ9yOIIQZ","ParentId":"a9CF0000000PB7lMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOJIQZ"},"Id":"017F00000JQ9yOJIQZ","ParentId":"a9CF0000000PB7mMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOKIQZ"},"Id":"017F00000JQ9yOKIQZ","ParentId":"a9CF0000000PB7nMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOLIQZ"},"Id":"017F00000JQ9yOLIQZ","ParentId":"a9CF0000000PB7oMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOMIQZ"},"Id":"017F00000JQ9yOMIQZ","ParentId":"a9CF0000000PB7pMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yONIQZ"},"Id":"017F00000JQ9yONIQZ","ParentId":"a9CF0000000PB7qMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOOIQZ"},"Id":"017F00000JQ9yOOIQZ","ParentId":"a9CF0000000PB7rMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOPIQZ"},"Id":"017F00000JQ9yOPIQZ","ParentId":"a9CF0000000PB7sMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOQIQZ"},"Id":"017F00000JQ9yOQIQZ","ParentId":"a9CF0000000PB7tMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yORIQZ"},"Id":"017F00000JQ9yORIQZ","ParentId":"a9CF0000000PB7uMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOSIQZ"},"Id":"017F00000JQ9yOSIQZ","ParentId":"a9CF0000000PB7vMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOTIQZ"},"Id":"017F00000JQ9yOTIQZ","ParentId":"a9CF0000000PB7wMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOUIQZ"},"Id":"017F00000JQ9yOUIQZ","ParentId":"a9CF0000000PB7xMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOVIQZ"},"Id":"017F00000JQ9yOVIQZ","ParentId":"a9CF0000000PB7yMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOWIQZ"},"Id":"017F00000JQ9yOWIQZ","ParentId":"a9CF0000000PB7zMAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOXIQZ"},"Id":"017F00000JQ9yOXIQZ","ParentId":"a9CF0000000PB80MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOYIQZ"},"Id":"017F00000JQ9yOYIQZ","ParentId":"a9CF0000000PB81MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOZIQZ"},"Id":"017F00000JQ9yOZIQZ","ParentId":"a9CF0000000PB82MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOaIQJ"},"Id":"017F00000JQ9yOaIQJ","ParentId":"a9CF0000000PB83MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yObIQJ"},"Id":"017F00000JQ9yObIQJ","ParentId":"a9CF0000000PB84MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOcIQJ"},"Id":"017F00000JQ9yOcIQJ","ParentId":"a9CF0000000PB85MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOdIQJ"},"Id":"017F00000JQ9yOdIQJ","ParentId":"a9CF0000000PB86MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOeIQJ"},"Id":"017F00000JQ9yOeIQJ","ParentId":"a9CF0000000PB87MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOfIQJ"},"Id":"017F00000JQ9yOfIQJ","ParentId":"a9CF0000000PB88MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOgIQJ"},"Id":"017F00000JQ9yOgIQJ","ParentId":"a9CF0000000PB89MAG","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOhIQJ"},"Id":"017F00000JQ9yOhIQJ","ParentId":"a9CF0000000PB8AMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOiIQJ"},"Id":"017F00000JQ9yOiIQJ","ParentId":"a9CF0000000PB8BMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOjIQJ"},"Id":"017F00000JQ9yOjIQJ","ParentId":"a9CF0000000PB8CMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOkIQJ"},"Id":"017F00000JQ9yOkIQJ","ParentId":"a9CF0000000PB8DMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOlIQJ"},"Id":"017F00000JQ9yOlIQJ","ParentId":"a9CF0000000PB8EMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOmIQJ"},"Id":"017F00000JQ9yOmIQJ","ParentId":"a9CF0000000PB8FMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOnIQJ"},"Id":"017F00000JQ9yOnIQJ","ParentId":"a9CF0000000PB8GMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOoIQJ"},"Id":"017F00000JQ9yOoIQJ","ParentId":"a9CF0000000PB8HMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOpIQJ"},"Id":"017F00000JQ9yOpIQJ","ParentId":"a9CF0000000PB8IMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOqIQJ"},"Id":"017F00000JQ9yOqIQJ","ParentId":"a9CF0000000PB8JMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOrIQJ"},"Id":"017F00000JQ9yOrIQJ","ParentId":"a9CF0000000PB8KMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOsIQJ"},"Id":"017F00000JQ9yOsIQJ","ParentId":"a9CF0000000PB8LMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOtIQJ"},"Id":"017F00000JQ9yOtIQJ","ParentId":"a9CF0000000PB8MMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOuIQJ"},"Id":"017F00000JQ9yOuIQJ","ParentId":"a9CF0000000PB8NMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOvIQJ"},"Id":"017F00000JQ9yOvIQJ","ParentId":"a9CF0000000PB8OMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOwIQJ"},"Id":"017F00000JQ9yOwIQJ","ParentId":"a9CF0000000PB8PMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOxIQJ"},"Id":"017F00000JQ9yOxIQJ","ParentId":"a9CF0000000PB8QMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JQ9yOyIQJ"},"Id":"017F00000JQ9yOyIQJ","ParentId":"a9CF0000000PB8RMAW","CreatedDate":"2015-04-14T05:29:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000NTxzuSIQR"},"Id":"017F00000NTxzuSIQR","ParentId":"a9CF0000000XZKbMAO","CreatedDate":"2015-10-01T12:19:58.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MKCXnCIQX"},"Id":"017F00000MKCXnCIQX","ParentId":"a9CF0000000PBToMAO","CreatedDate":"2015-08-14T20:32:12.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MKCZuvIQH"},"Id":"017F00000MKCZuvIQH","ParentId":"a9CF0000000PBTtMAO","CreatedDate":"2015-08-14T20:32:45.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MKCaN6IQL"},"Id":"017F00000MKCaN6IQL","ParentId":"a9CF0000000PBTyMAO","CreatedDate":"2015-08-14T20:34:02.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000LIDzaKIQT"},"Id":"017F00000LIDzaKIQT","ParentId":"a9CF0000000PBLaMAO","CreatedDate":"2015-07-01T19:14:26.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000JVXZjpIQH"},"Id":"017F00000JVXZjpIQH","ParentId":"a9CF0000000PBAhMAO","CreatedDate":"2015-04-17T20:01:55.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000K5dqXMIQY"},"Id":"017F00000K5dqXMIQY","ParentId":"a9CF0000000PBFNMA4","CreatedDate":"2015-05-12T11:55:12.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000MfoqasIQA"},"Id":"017F00000MfoqasIQA","ParentId":"a9CF0000000XZARMA4","CreatedDate":"2015-08-29T02:50:22.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000OKYxvuIQD"},"Id":"017F00000OKYxvuIQD","ParentId":"a9CF0000000blT4MAI","CreatedDate":"2015-11-05T23:13:45.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000NoEk4xIQC"},"Id":"017F00000NoEk4xIQC","ParentId":"a9CF0000000blLjMAI","CreatedDate":"2015-10-15T01:12:12.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000V8IuOqIQK"},"Id":"017F00000V8IuOqIQK","ParentId":"a9CF00000008P5MMAU","CreatedDate":"2016-07-18T15:38:50.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000PCKAgiIQH"},"Id":"017F00000PCKAgiIQH","ParentId":"a9CF0000000KyuYMAS","CreatedDate":"2015-12-13T05:50:25.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/017F00000R9qSHsIQM"},"Id":"017F00000R9qSHsIQM","ParentId":"a9CF00000008OWqMAM","CreatedDate":"2016-02-29T21:27:48.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000b3ZRCIQA4"},"Id":"0170Z0000b3ZRCIQA4","ParentId":"a9C0Z000000TNeqUAG","CreatedDate":"2018-04-24T15:08:06.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000b2IZ3NQAW"},"Id":"0170Z0000b2IZ3NQAW","ParentId":"a9C0Z000000TNelUAG","CreatedDate":"2018-04-23T16:18:41.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000bH0XiBQAV"},"Id":"0170Z0000bH0XiBQAV","ParentId":"a9C0Z000000TNfAUAW","CreatedDate":"2018-05-07T02:20:37.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000bWVjUiQAL"},"Id":"0170Z0000bWVjUiQAL","ParentId":"a9C0Z000000TNgDUAW","CreatedDate":"2018-05-17T18:49:34.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000byaXfYQAU"},"Id":"0170Z0000byaXfYQAU","ParentId":"a9C0Z0000004E5ZUAU","CreatedDate":"2018-06-07T12:38:59.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000bpMJXqQAO"},"Id":"0170Z0000bpMJXqQAO","ParentId":"a9C0Z0000004E5UUAU","CreatedDate":"2018-05-31T07:35:02.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0170Z0000bdOClFQAW"},"Id":"0170Z0000bdOClFQAW","ParentId":"a9C0Z000000TNhVUAW","CreatedDate":"2018-05-22T17:54:46.000+0000","Field":"created","OldValue":null,"NewValue":null},{"attributes":{"type":"Incident__History","url":"/services/data/v43.0/sobjects/Incident__History/0172A0000XmAKzzQQG"},"Id":"0172A0000XmAKzzQQG","ParentId":"a9C2A000000XZXbUAO","CreatedDate":"2016-11-15T20:58:57.000+0000","Field":"created","OldValue":null,"NewValue":null}][{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fgbi8UAB"},"Id":"a1P2A00000Fgbi8UAB","CreatedDate":"2018-03-20T23:25:38.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta continues to investigate an issue with Provisioning Setup and IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP-Initiated Single-Sign-On is not affected. Please contact support if you are having difficulty setting up provisioning and we will assist with implementation of an applicable workaround as we investigate further. Another update is planned for 6:25pm PT or sooner as additional information becomes available.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbiDUAR"},"Id":"a1P2A00000FgbiDUAR","CreatedDate":"2018-03-21T01:27:26.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta continues to investigate an issue with Provisioning Setup and IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP-Initiated Single-Sign-On is not affected. Please contact support if you are having difficulty setting up provisioning and we will assist with implementation of an applicable workaround as we investigate further. Another update is planned for 7:00pm PT or sooner as additional information becomes available.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbiNUAR"},"Id":"a1P2A00000FgbiNUAR","CreatedDate":"2018-03-21T02:25:27.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta continues to investigate an issue with Provisioning Setup and IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP-Initiated Single-Sign-On is not affected. Please contact support if you are having difficulty setting up provisioning and we will assist with implementation of an applicable workaround as we investigate further. Another update is planned for 9:00pm PT or sooner as additional information becomes available.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbiSUAR"},"Id":"a1P2A00000FgbiSUAR","CreatedDate":"2018-03-21T03:19:22.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta is currently working to mitigate the issue with IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. We are exploring a patch with a workaround while we work on a permanent fix. We will continue to provide updates as plans solidify to patch. In addition, please continue to contact support if you are having difficulty setting up O365 provisioning and we will assist with implementation of an applicable workaround for that problem. Another update is planned for 10:30pm PT or sooner as additional information becomes available.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbiXUAR"},"Id":"a1P2A00000FgbiXUAR","CreatedDate":"2018-03-21T05:36:54.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta is currently working to mitigate the issue with IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. We are actively working on a patch deployment with a workaround while we work on a permanent fix. We will continue to provide updates as plans solidify to patch. In addition, please continue to contact support if you are having difficulty setting up O365 provisioning and we will assist with implementation of an applicable workaround for that problem. Another update is planned for 12:30 am PT on 03/21/2018 or sooner as additional information becomes available.\r\n<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbicUAB"},"Id":"a1P2A00000FgbicUAB","CreatedDate":"2018-03-21T07:33:17.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta is currently working to mitigate the issue with IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. We are actively working on deploying a patch to all cells with a workaround while we work on a permanent fix. In addition, please continue to contact support if you are having difficulty setting up O365 provisioning and we will assist with implementation of an applicable workaround for that problem. Another update will be provided as soon all cells have been successfully patched.\r\n<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbimUAB"},"Id":"a1P2A00000FgbimUAB","CreatedDate":"2018-03-21T10:43:22.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta has completed the deployment of a patch to all affected cells with a workaround to address the issue with IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP initiated authentication was unaffected by this issue. We are working on a permanent fix and will provide root cause analysis once it’s available.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fgbt6UAB"},"Id":"a1P2A00000Fgbt6UAB","CreatedDate":"2018-03-22T21:42:13.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Root Cause Analysis:\r\n\r\nOn 3/20/2018 at 9:50am PDT, Okta identified an issue with IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, Teams and some CRM instances. SP initiated authentication was unaffected by this issue. In addition, some customers were unable to complete the Advanced API Access setup for newly created Office 365 application instances. The service disruption was caused by a deactivation of an Okta tenant on Azure Active Directory. Okta deployed workaround to all affected cells from 11:32PM to 4:11am PDT on 3/20. The required AAD tenant was recovered on 3/21 which restored full functionality. In addition, we are reevaluating our internal processes with a focus on third party dependencies required for custom sign on protocols such as the ones used by these applications.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fj03vUAB"},"Id":"a1P2A00000Fj03vUAB","CreatedDate":"2017-05-15T13:52:05.000+0000","IncidentId__c":"a9C2A000000blruUAA","UpdateLog__c":"Okta is continuing to investigate the cause of the slow interactive response times in US Cell 2.  Admins may also experience delays in Job processing while we continue our investigation.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fj045UAB"},"Id":"a1P2A00000Fj045UAB","CreatedDate":"2017-05-15T14:19:12.000+0000","IncidentId__c":"a9C2A000000blruUAA","UpdateLog__c":"Interactive user experience has returned to normal in US Cell 2.  Admins may continue to experience delays in job processing while we investigate the root cause.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fj04ZUAR"},"Id":"a1P2A00000Fj04ZUAR","CreatedDate":"2017-05-15T15:03:33.000+0000","IncidentId__c":"a9C2A000000blruUAA","UpdateLog__c":"RESOLVED: 8:02am PDT: An issue impacting system responsiveness, including interactive performance and job processing in US Cell 2 was addressed.  Additional root cause information will be provided here shortly.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fjr2PUAR"},"Id":"a1P2A00000Fjr2PUAR","CreatedDate":"2018-03-30T15:15:50.000+0000","IncidentId__c":"a9C2A000000bmK1UAI","UpdateLog__c":"We are currently working with Microsoft who has acknowledged the issue via incident MO133118. As a workaround, customers can utilize portal.microsoft.com to access the Microsoft Office 365 Portal. More details of Microsoft incident MO133118 below:\r\n<br><br>\r\nhttps://portal.office.com/adminportal/home#/servicehealth. \r\n<br><br>\r\nMO133118 - Unable to access Office 365 portal\r\nStatus:Service degradation\r\nUser impact:Users may be unable to access the Office 365 portal.\r\nLatest message:Title: Unable to access Office 365 portal\r\n\r\nUser Impact: Users may be unable to access the Office 365 portal.\r\n\r\nMore info: Users attempting to access the Office 365 portal via https://portal.microsoftonline.com my receive the following error message: \"This site can't be reached\".\r\n\r\nSome users may be able to access the Office 365 portal via https://portal.office.com.\r\n\r\nCurrent status: We're analysing diagnostic data to isolate the root cause and identify steps to remediate impact.\r\n\r\nScope of impact: This issue could potentially affect any of your users if they are routed through the affected infrastructure.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fjr2ZUAR"},"Id":"a1P2A00000Fjr2ZUAR","CreatedDate":"2018-03-30T15:49:50.000+0000","IncidentId__c":"a9C2A000000bmK1UAI","UpdateLog__c":"Okta is monitoring progress with Microsoft on this issue. Recent mitigating steps have been taken to address the issue and we are actively monitoring this incident until fully resolved.\r\n<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UoBUAV"},"Id":"a1P2A00000G0UoBUAV","CreatedDate":"2018-03-07T18:20:10.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"We are working to revert the change impacting API Access Management in our US Preview Cell. If you need immediate assistance in resolving the issue, please contact Okta Customer Support.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UoaUAF"},"Id":"a1P2A00000G0UoaUAF","CreatedDate":"2018-03-07T19:04:09.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"The issue impacting API Access Management in US Preview cell has been resolved for the majority of customers. Work is on-going to fully restore the feature for all remaining customer tenants.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UouUAF"},"Id":"a1P2A00000G0UouUAF","CreatedDate":"2018-03-07T19:35:41.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"The issue impacting API Access Management in US Preview cell has been resolved for the majority of customers. Work is on-going to fully restore the feature for all remaining customer tenants. Customers experiencing any issues related to API Access Management should contact Support.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UozUAF"},"Id":"a1P2A00000G0UozUAF","CreatedDate":"2018-03-07T20:13:43.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"The issue impacting API Access Management in US Preview cell has been resolved for the majority of customers. Work is on-going to fully restore the feature for all remaining customer tenants. Customers experiencing any issues related to API Access Management should contact Support.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UpEUAV"},"Id":"a1P2A00000G0UpEUAV","CreatedDate":"2018-03-07T20:28:30.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"An issue impacting API Access Management for all end-users in US Preview Cell was resolved. Additional root cause information will be provided here as soon as it is available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UpTUAV"},"Id":"a1P2A00000G0UpTUAV","CreatedDate":"2018-03-07T20:45:51.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"Okta continues to address issues with the API Access Management feature. Customers experiencing issues are advised to contact support.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UpsUAF"},"Id":"a1P2A00000G0UpsUAF","CreatedDate":"2018-03-07T21:25:07.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"The issue impacting API Access Management in US Preview cell has been resolved for the majority of customers. Work is on-going to fully restore the feature for all remaining customer tenants. Customers experiencing any issues related to API Access Management should contact Support.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0Uq2UAF"},"Id":"a1P2A00000G0Uq2UAF","CreatedDate":"2018-03-07T21:50:15.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"An issue impacting API Access Management for all end-users in US Preview Cell was resolved. Additional root cause information will be provided here as soon as it is available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UqlUAF"},"Id":"a1P2A00000G0UqlUAF","CreatedDate":"2018-03-08T01:50:29.000+0000","IncidentId__c":"a9C2A000000PBipUAG","UpdateLog__c":"An issue impacting system responsiveness in US Cell 6 is being investigated.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UqvUAF"},"Id":"a1P2A00000G0UqvUAF","CreatedDate":"2018-03-08T02:15:09.000+0000","IncidentId__c":"a9C2A000000PBipUAG","UpdateLog__c":"An issue impacting system availability and authentication in US Cell 6 is being mitigated.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0Ur0UAF"},"Id":"a1P2A00000G0Ur0UAF","CreatedDate":"2018-03-08T02:45:44.000+0000","IncidentId__c":"a9C2A000000PBipUAG","UpdateLog__c":"An issue impacting system availability in US Cell 6 has been resolved. Additional root cause information will be provided here as soon as it is available","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UyNUAV"},"Id":"a1P2A00000G0UyNUAV","CreatedDate":"2018-03-09T23:40:54.000+0000","IncidentId__c":"a9C2A000000PBipUAG","UpdateLog__c":"Root Cause Analysis:\r\n\r\nOn March 7th, beginning at 5:15pm PST, Okta experienced a service disruption in US Cell 6. End-User, Admin and API requests within Okta tenants within US Cell 6 were slow, unresponsive, or encountered HTTP 5xx errors.\r\n\r\nThe disruption was the result of a memory issue which impacted the cell's Redis cluster which is used to cache application data. The root cause of the memory issue was traced to a combination of high memory usage within the Redis cluster, a mis-configured application server which increased the volume of caching above expected levels, and sub-optimal Redis configuration settings. Because both the primary and secondary Redis tiers were equally impacted by the increased memory demands, the cluster was unable to recover. To stabilize the Redis cluster, additional capacity was added and application servers were recycled to clear hung connections and re-balance load. By 6:08 pm PST, the cell had returned to normal performance levels.\r\n\r\nOkta has completed work to up-size our Redis caching clusters in US Cell 6 and will deploy the same mitigating changes across all remaining cells. Additionally, Okta will conduct exercises to replay this failure sequence within a test environment to determine and subsequently deploy the optimal settings for Redis memory management, client connection configuration and health-check thresholds. Additionally, new tooling is being investigated to allow us to flush Redis cache should such a mitigation step be needed in the future.\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-Service-Disruption-03-07-2017).","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000G0UymUAF"},"Id":"a1P2A00000G0UymUAF","CreatedDate":"2018-03-10T00:15:52.000+0000","IncidentId__c":"a9C2A000000PBikUAG","UpdateLog__c":"Root Cause Analysis:\r\n\r\nOn March 7th, beginning at 9:35am PST, Okta experienced a feature disruption to API Access Management in the US Preview cell. The disruption was caused while Okta was working to correct the assignment of the API Access Management feature to certain tenants and mistakenly removed the feature from orgs authorized to have it.\r\n\r\nAfter the feature was inadvertently disabled, Okta began work to bulk re-assign the feature to all entitled tenants. However, due the complexity of the process of enabling the API Access Management feature, it took Okta longer than usual to restore the feature to entitled tenants. During the incident, while bulk enablement was processing, Okta Support and Engineering manually enabled the feature for all customers who reported the issue or were detected as being impacted through Okta’s monitoring tools.\r\n\r\nBy 10:30 AM PST, the majority of the impacted tenants had the API Access Management feature reassigned at 1:50 PM PST all entitled customers in the US Preview cell had the feature restored.\r\n\r\nTo prevent recurrence, Okta is adding additional oversight to feature deployment processes and will be hardening our management software to reduce risk of data input errors.\r\n\r\n<br><br> \r\nReview the root cause analysis [here](https://support.okta.com/help/Documentation/Knowledge_Article/Root-Cause-Analysis-API-Access-Management-Service-Disruption-03072018).","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000FgbdXUAR"},"Id":"a1P2A00000FgbdXUAR","CreatedDate":"2018-03-20T11:30:33.000+0000","IncidentId__c":"a9C2A0000004CSTUA2","UpdateLog__c":"Root Cause Analysis: \r\n\r\nOn March 16th, beginning at 8:23 am PDT, Okta experienced an issue impacting US Cell 6 Administrators' ability to view recently processed user updates in the admin dashboard. The dashboard queries data from secondary read-only databases which were impacted by a replication error. \r\n\r\nThe root cause was traced to an internal database engine error on the primary database which required a consistency check on the secondaries. Addressing the replication failure and resultant latency was delayed because its alert was superseded by alerts for the database engine error. Shortly after the replication latency was escalated by Support, the issue was cleared by firstly re-directing the impacted traffic to the primary databases, and secondly by repairing the replication lag. By 10:22am PDT, Administrator dashboards displayed all current data. Okta is implementing recurrent alerting for replication lags to ensure faster response times going forward.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P2A00000Fgbi3UAB"},"Id":"a1P2A00000Fgbi3UAB","CreatedDate":"2018-03-20T22:34:12.000+0000","IncidentId__c":"a9C2A0000004CSnUAM","UpdateLog__c":"Okta continues to investigate an issue with Provisioning Setup and IDP-Initiated Single Sign-On functionality for the following Office 365 Apps: Yammer, CRM and Teams. SP-Initiated Single-Sign-On is not affected. Please contact support if you are having difficulty setting up provisioning and we will assist with implementation of an applicable workaround as we investigate further.<br><br>","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJNEUA2"},"Id":"a1P0Z000007eJNEUA2","CreatedDate":"2018-04-23T16:41:04.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta is currently investigating an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log).","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJPPUA2"},"Id":"a1P0Z000007eJPPUA2","CreatedDate":"2018-04-23T18:43:56.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta continues to investigate an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log). The next update will take place at 12:45pm PT or as soon as additional details become available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJPoUAM"},"Id":"a1P0Z000007eJPoUAM","CreatedDate":"2018-04-23T19:06:35.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta is actively mitigating an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log). The next update will take place at 1:00pm PT or as soon as additional details become available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJQ8UAM"},"Id":"a1P0Z000007eJQ8UAM","CreatedDate":"2018-04-23T19:54:35.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta continues to mitigate an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log). The next update will take place at 2:00pm PT or as soon as additional details become available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJO7UAM"},"Id":"a1P0Z000007eJO7UAM","CreatedDate":"2018-04-23T17:13:24.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta is currently investigating an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log).","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJUoUAM"},"Id":"a1P0Z000007eJUoUAM","CreatedDate":"2018-04-24T15:17:52.000+0000","IncidentId__c":"a9C0Z000000TNeqUAG","UpdateLog__c":"An issue impacting authentication for a subset of end users in US Cell 2 is being investigated.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJQhUAM"},"Id":"a1P0Z000007eJQhUAM","CreatedDate":"2018-04-23T21:01:13.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta continues to mitigate an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log). The next update will take place at 3:00pm PT or as soon as additional details become available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJbWUAU"},"Id":"a1P0Z000007eJbWUAU","CreatedDate":"2018-04-25T02:43:56.000+0000","IncidentId__c":"a9C0Z000000TNeqUAG","UpdateLog__c":"Root Cause Analysis:\r\n\r\nOn April 24th, at 7:53am PDT, Okta experienced a broad service disruption to US Cell 2. End users in US Cell 2 attempting to reach Okta received HTTP 500 errors, and customer integrations attempting to reach Okta API endpoints in US Cell 2 encountered elevated response times and errors. Operational mitigation steps commenced immediately at 7:53am. The greatest frequency of errors was a 14 minute period between 7:53am and 8:07am. The success rate began to gradually improve from 8:07am, and by 8:25am approximately 80% of requests were successfully returned. The cell was fully restored by 8:48am. \r\n\r\nRoot cause was traced to a combination of a procedural error and an automation bug while security patching infrastructure within US Cell 2. The procedural error targeted the security patching to a high usage cache cluster. The automation used to apply the patch disrupted the cluster’s ability to failover across nodes. \r\nTo prevent recurrence of this type of issue in the future, Engineering has immediately implemented additional safeguards to review and confirm operational patching procedures. Additionally, Engineering has prioritized a deep technical assessment to strengthen the patching automation for cache clusters.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJOWUA2"},"Id":"a1P0Z000007eJOWUA2","CreatedDate":"2018-04-23T17:44:08.000+0000","IncidentId__c":"a9C0Z000000TNelUAG","UpdateLog__c":"Okta continues to investigate an issue with the /api/v1/events endpoint in all cells. To access system logs, please utilize the [System Log API Endpoint](https://developer.okta.com/docs/api/resources/system_log). The next update will take place at 11:45am PT or as soon as additional details become available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eJVNUA2"},"Id":"a1P0Z000007eJVNUA2","CreatedDate":"2018-04-24T15:55:38.000+0000","IncidentId__c":"a9C0Z000000TNeqUAG","UpdateLog__c":"An issue impacting authentication for a subset of end users in US Cell 2 was addressed. Additional root cause information will provided when available.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eOBkUAM"},"Id":"a1P0Z000007eOBkUAM","CreatedDate":"2018-05-20T09:27:36.000+0000","IncidentId__c":"a9C0Z000000TNgDUAW","UpdateLog__c":"On May 17th, beginning at 11:28am PDT, Okta experienced a service disruption in US Cell 6. End-User and Administrators attempting to authenticate to their Okta tenant may have experienced HTTP 5xx errors. Through the duration of the incident, approximately 30% of US Cell 6 users attempting primary or multi-factor authentication encountered errors and would have needed to retry. Other requests, and End-Users and Administrators who already had an active session did not experience any impact.\r\n<br><br>\r\nThe issue surfaced when the cell's session token management cluster became overwhelmed by a sudden increase in the number of active sessions. Automated monitoring failed to effectively alert before the cluster was nearing its maximum capacity.\r\n<br><br>\r\nThe issue was resolved by 12:19pm PDT after operational actions were taken to manage the session count while capacity was added to the cluster. Immediately following the incident, Okta corrected the monitoring gap to prevent a future recurrence. Architectural design work is being initiated to better manage session counts and their expiry.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z0000051aauUAA"},"Id":"a1P0Z0000051aauUAA","CreatedDate":"2018-05-31T08:06:30.000+0000","IncidentId__c":"a9C0Z0000004E5UUAU","UpdateLog__c":"An issue impacting all functionality in US Cell 6 is being investigated. It appears that the underlying infrastructure issue has been resolved, and we are monitoring closely to ensure service has been restored.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eNdTUAU"},"Id":"a1P0Z000007eNdTUAU","CreatedDate":"2018-05-17T19:24:28.000+0000","IncidentId__c":"a9C0Z000000TNgDUAW","UpdateLog__c":"Okta is actively working to mitigate the issues impacting authentication and user interactive errors in US Cell 6. As of 12:19pm PDT, error rates have returned to 0%. We are continuing to monitor and will post updates as we continue to address the root cause.","CurrencyIsoCode":"USD"},{"attributes":{"type":"IncidentUpdate__c","url":"/services/data/v43.0/sobjects/IncidentUpdate__c/a1P0Z000007eNdsUAE"},"Id":"a1P0Z000007eNdsUAE","CreatedDate":"2018-05-17T19:46:07.000+0000","IncidentId__c":"a9C0Z000000TNgDUAW","UpdateLog__c":"An issue impacting authentication was resolved at 12:19pm PDT. During the event, End-Users and Administrators may have experienced HTTP 5xx errors while attempting to authenticate to their Okta tenant. Additional root cause information will be provided within 48 hours.","CurrencyIsoCode":"USD"}]