Rogers Outage

Rogers Outage: early July 8th Rogers is suffering a massive outage. This outage affects mobile phones, internet, ATM machines, 911 service in various regions, government services and the list goes on. Rogers has about 9 million wireless customers and over 3 million cable internet customers. The Rogers outage has put a serious strain on all the other Canadian internet service providers.

Technically what happened this morning?

Around 1am Pacific time, Rogers networking sent out tons of updates to the Border Gateway Protocol system. BGP routes traffic internet.  Put simply BGP is what connects your computer or phone on the west coast to a web site hosted in Toronto (or anywhere else in the world).

As those routing updates spread throughout the system clients could no longer communicate via the internet.

Bad BGP updates are what caused Facebook and Friends Outage in October. In the Facebook and Friends Outage, Facebook itself initiated the updates. At this point we don’t know if Rogers initiated the changes itself or if their network equipment was hacked. BGP has been hacked before for profit most notably in April 2018 when Amazon DNS was attacked.. Here is technical explanation of BGP hacking.

From the CloudFare BGP stats, it looks like Rogers hasn’t been able to update or rollback the BGP updates to last known good settings in over 12 hours. Facebook was able to recover in under 8 hours. rogers bgp

Scams and Fake Rogers Info already

Rogers has already promised to reimburse customers for the outage. I suspect we will soon see scam text and email messages that will reimburse you with one click.

Already on Twitter I have seen a fake Rogers Customer Service announcement stating their “servers” were hacked and service will not restored until July 11th.

fake rogers announcement

That fake announcement was showing up on Twitter and Downdetector.

Cost to business

This Rogers outage has cost a lot of businesses and consumers. From being unable to pay via debit, send emails, lost phone calls, customer frustration, lost work hours, the list goes on.

Government Response

The CRTC which is supposed to regulate the industry and protect Canadians needs to a) hold an independent inquiry on the Rogers outage and its impact on Canadians and business b) break up the monopoly Rogers, Bell and Telus have on the industry c) do something about our overpriced internet which is hurting business and consumers.

You can’t call the CRTC today because due to the Rogers outage their phones aren’t working. The CRTC web site complaint section is here.

Update July 9th

CloudFlare reports Rogers traffic is now 95% of normal. Interac reports all services restored now.