There has been a server hang impacting some customers, the server is back up now and virtual servers are starting.
A crash dump was created and will be analyzed to find the root cause and any necessary work will be done for stability.
Sorry for the inconvenience.
The powerdns cluster has failed beyond recovery, it is being restored from backups now.
Any changes made in the last w hours may need to be re-added.
Sorry for the inconvenience it is expected to be resolved by the end of the day today.
UPDATE: The work has been complete.
12th June 2017 @ 15:30 - The issues on node 5 are known, they are being worked on, service should be restored soon.
12th June 2017 @ 15:51 - The containers needed to be stopped and the node was rebooted, service should be restored fully within minutes, further root cause investigations will continue.
09th June 2017 @ 11:38 (UK Time)The node is starting to hang due to issues with the Xen network stack, guest servers are bing shut down to clear this issue and while this is being patched the opportunity is being used to apply all outstanding XSA security patches.The server will be back up within 30 minutes, sorry for the inconvenience but ... Read More »