[4:21pm EST] Normal operations are returning. During the outage, many customers had trouble viewing and adding images and file uploads. Please let us know at firstname.lastname@example.org if you notice any additional issues or have any questions.
[1:41pm EST] We are seeing an increased number of errors and performance issues on some sites that we host. Sites still remain up and viewable on the web, but you may notice occasional errors with editing or updating a site and lagging performance. This is related to ongoing outages with Amazon Web Services, which we use for much of our infrastructure. You may continue to have problems loading sites, and in particular, adding or viewing images or file uploads. We are monitoring the situation and doing what we can to minimize impact. You can follow the Amazon outage at https://status.aws.amazon.com.
All services and operations are currently normal.
Should you experience any issues, please email email@example.com.
There is much news going around about a recent bug in Cloudflare which resulted in an extremely small number of Cloudflare customers’ that had the possibility of exposing customer data.
We are a Cloudflare hosting partner and do utilize Cloudflare services, but we are 100% confident that we were not impacted by this bug and that no customer data that we host was compromised for the following reasons:
- We’ve been assured by Cloudflare that none of the domains we host were impacted, including all CampusPress customers and our Edublogs.org network.
- We do not leverage the specific Cloudflare services that contained the originally disclosed bug.
- Even still, we decided to change our authentication keys and force all logged in users to re-login just to ensure no further impact was possible.
Please contact us at firstname.lastname@example.org should you have any further questions.
Resolved: [8:45 PM EST] We have confirmation that it is now fully resolved. This event was Network routing issue outside of our data center partner’s facility. Network Engineers have rerouted all traffic to bypass the affected routes. We apologize for an inconvenience that this might have caused and will continue to monitor in case of any further issues.
Initial Report: [7:30 PM EST] Our team is currently working to resolve performance issues that are affecting some of our customers. We are aware that some sites are not available as a result of upstream network issues at one of our Data Center providers.
We are working as quickly as possible to resolve this issue and will update here as soon as we know more. We definitely apologize for this inconvenience.
Final Update: [9:09 EST] During our regular change management window, we pushed an update to the wiki plugin. This update was tested before update, but it lead to performance issues on some networks due to a database upgrade as users logged in. The problem is now fully resolved and shouldn’t happen again. We’ve already identified ways to better test so that a similar problem does not occur with future updates.
Update: [8:51 EST] Our team has identified the issue and put a fix in place. All customers will already experience better performance. We’ll continue to monitor and full access to all sites should stabilize shortly. We will keep you updated here.
Initial Report: [8:23 am EST] Our team is currently working to resolve performance issues that are affecting some of our customers. We are aware that some sites are not available.
We are working as quickly as possible to resolve this issue and will update here as soon as we know more. We apologize for this inconvenience.