Scheduled for October 20, 2024 at 6:00 AM – 1:48 PM
Affects
Core Networks
Under maintenance from 6:00 AM to 1:48 PM
New York, New York (NYC1)
Under maintenance from 6:00 AM to 1:48 PM
Completed
October 20, 2024 at 1:48 PMCompleted
October 20, 2024 at 1:48 PMThe issue has been solved at this time. We no longer see any packet losses or unreachability issues.
All servers have now been up and remained stable. We've successfully migrated to new Core routers and new network design, which will allow us to scale further without performance penalty.
Our team will add more capacity next weekend as a part of this upgrade. We will put up another announcement once confirmed.
Please let us know if you via ticket if you still experience any issues.
Our apologies for any inconvenience caused during this process.
Thank you for your patience and understanding!
Update
October 20, 2024 at 11:13 AMIn progress
October 20, 2024 at 11:13 AMOur team is still working on the issue.
As noted, majority of servers have been back to normal, we are still observing packet losses toward a few IP ranges and are looking into it.
Our team will post update once we have more information.
Update
October 20, 2024 at 10:13 AMIn progress
October 20, 2024 at 10:13 AMMost of our IPs are functional, we are aware of a few subnets still flapping, causing spikes in latency and 5-12% packet losses, our team is investigating on this issue.
All downlinks to our core routers have been migrated successfully at this time.
Update
October 20, 2024 at 9:13 AMIn progress
October 20, 2024 at 9:13 AMWe are still in the mid of transferring downlinks of old Core router to new, it is expected that servers will experience intermittent packet losses or be unreachable for short period amount of time during this process.
Update
October 20, 2024 at 8:33 AMIn progress
October 20, 2024 at 8:33 AMOur backup upstream did not pickup our subnets immediately and has resulted in a slight downtime of 5-10 minutes. All subnets have been back online at this time.
Update
October 20, 2024 at 7:56 AMIn progress
October 20, 2024 at 7:56 AMAll of our Edge switches have been updated to latest firmware and configuration at this time. Our team is currently upgrading Core routers to newer hardware. It is expected that your servers will have packet losses or unreachable during this time as we transfer loads back and forth between old and new cores, with new uplinks.
In progress
October 20, 2024 at 6:00 AMIn progress
October 20, 2024 at 6:00 AMMaintenance is now in progress
Planned
October 20, 2024 at 6:00 AMPlanned
October 20, 2024 at 6:00 AMWe will be performing a network upgrade at our New York location to improve network performance and reliability.
Scheduled Timeframe: Sunday, October 20, 2024, from 1:00 AM to 12:00 PM (EST).
During this timeframe, your service may experience periodic packet loss and could become unreachable for up to 15 minutes as we perform software updates across all our switches.
We have carefully planned this maintenance and do not expect any issues during this process. Our team will promptly post updates as we proceed with the maintenance.
If you have any questions about this maintenance, please let us know via ticket.
Thank you for your understanding!