Resolved

We have now written a robust patch to prevent this in the future. It was an aggressive attack from two networks, whilst we 403'd the first set of attacks, the firewall didn't kick in for the 2nd, so it flooded our query queue, eventually killing the server. We have now blocked these two networks using their ASN records. Apologies for the inconvenience caused.

Avatar for
Recovering

Temporary patch written, and all services are now live again, we will update this ticket a bit later with exactly what happened and a more robust solution.

Avatar for
Identified

We have identified the issue and currently writing a patch to resolve, this may be a temporary fix to get us back online ASAP, with a more robust patch being written this evening. Updates to follow.

Avatar for
Investigating

It appears this server is being targeted and is currently struggling to offer resource due to the attack, we are working on a fix urgently.

Avatar for
Began at:

Affected components
  • Cloud Servers