VoxiHost - Notice history

A major service interruption occurred starting at 21:45:00 on October 30th. The root cause was an external, critical failure at our former DDoS Protection vendor, NeoProtect Remote Shield.

NeoProtect's upstream provider, CDN77 / Datapacket, disabled all active BGP sessions towards the NeoProtect network, instantly causing all services protected by their Remote Shield to become unrouteable and unavailable.

Our resolution involved an emergency network migration:

1. We attempted to route raw network traffic via Amsterdam as a temporary fix, but complex routing issues prevented immediate deployment overnight.

2. We successfully established contact with a new DDoS Protection partner, PletX.net, and performed a full, critical network swap.

3. Service was fully restored at 13:53:24 on October 31st.

Outcome: VoxiHost has permanently migrated to PletX.net for DDoS protection as NeoProtect has since discontinued its Remote Shield service. We are implementing a raw-network standby failover with our DC provider to prevent future external vendor failures from causing extended downtime.

This incident has been resolved. As from now on we will be using PletX.net DDoS Protection. Soon there will be postmortem about this incident and more information for the summary.

We are currently, on PletX protection & networking. Everything should be back to normal!

We are looking forward into having this issue solved in the morning EU time, we will be trying to get it replaced as soon as possible once PletX team wakes up and can preform the setup. This issue with NeoProtect wasn't expected at all, since their provider pulled a 'plug' on them and disconnected BGP sessions leaving us completely stranded and many other companies.

We hope for full understanding from our customers, and we will take all important steps to provide compensation & make stuff right after this hard time...

We are awaiting for PletX.net routing & whitelist to be configured, to replace NeoProtect.

Provided information by NeoProtect: "Our Upstream CDN77 / Datapacket has deactivated all BGP sessions towards our network. This results in full downtime of all associated services such as all Remote Shield customers (aside from XC customers in AMS).
The ETR given by them at this time is "tomorrow", we are trying to get this reconsidered but we do not estimate for reconsideration to happen in our favor."

We are trying our best to get around this and deploy PletX DDoS Protection with will replace NeoProtect

We have identified to be a global outage from NeoProtect

https://status.neoprotect.net/incidents/kdmtx0wk3h1l