On February 19th, 2019, Inkling Habitat went offline for 3 minutes starting at 3:47 AM PST. During this time, the servers responsible for serving Inkling Habitat were starved for resources by a bug in one of the services running on them. The engineering team was alerted and the issue was automatically resolved by the operating system once the services responsible had been restarted. The team has since determined the cause of the issue and has planned to implement a long term solution. In the meantime, a temporary solution is in place that will prevent this from reoccurring until the fix is deployed and tested.

This incident has been resolved.

A fix has been implemented and we are monitoring the results.

We are continuing to monitor for any further issues.

On January 28th, 2019, Inkling Web Reader displayed error messages for about 4 minutes starting at 7:25 AM PST. During this time, services in the Inkling platform experienced elevated error rates which the Inkling Web Reader lacked sufficient hardware capacity to handle. The engineering team was alerted and manually intervened to add hardware capacity and restore the services. Over the past two days, the team has reviewed this incident and identified several updates to improve the error handling and autoscaling mechanism of the impacted services. We have temporarily increased the hardware capacity of our platform until these improvements are complete and validated in our test environment. We are confident these steps will prevent another occurrence of this issue.

The incident has been resolved and Inkling Web Reader is fully operational at this time.

We have restored Inkling Web Reader and have not detected any additional issues for the past 10 minutes. We will continue to monitor the situation.