Verizon, Google Error Causes Internet Crashes In Japan

Google and Verizon jointly committed an error on Friday that caused internet connections throughout Japan to slow to a crawl and, in many cases, go out entirely. The somewhat simple issue boiled down to a misconfiguration of Google's border gateway protocol (BGP) that was not caught by Verizon, who most of the traffic ended up going through. This, in turn, caused a leak of sorts. Essentially, a number of Google IP addresses were advertised as free for internet traffic, and thus had traffic routed to them by local and foreign service providers, so long as the traffic was meant for Japan. Not only were Google's servers not equipped to forward traffic, but they could not handle the collective strain meant for all combined service providers in Japan. Google rooted out the issue and corrected it within minutes, but getting the traffic flowing correctly again resulted in hours of slow internet throughout the nation. The issue is currently under investigation not only by Google, but by the Internal Affairs and Communications Ministry of Japan.

The incident had somewhat long-lasting knock-on effects for a range of network providers and internet entities around the world, including Japanese entities like KDDI Corp and NTT Communications, and more global entities like the German arm of Vodafone. Many of these providers ended up having traffic routed through upwards of 1,000 of Google's ports, which meant that the traffic needed to find that many open ports in order to right itself once the issue was fixed. NTT Communications was hit the hardest by the ordeal, having its traffic jump on 24,834 Google ports.

The widespread BGP leaks and misconfigurations led to somewhere in the area of 135,000 ports being erroneously used. The issue started with Google's erroneous assignment of traffic into Verizon's network. Verizon did not have filters on its BGP handler, which resulted in it accepting this erroneous traffic from Google seamlessly. This, in turn, caused Verizon's network to blast the Google ports and prefixes that it had received as available, since it did not see them saturated with traffic. According to BGPMon, having filters on both ends of the transaction would have prevented this disaster.

Copyright ©2019 Android Headlines. All Rights Reserved
This post may contain affiliate links. See our privacy policy for more information.
You May Like These
More Like This:
About the Author
2018/10/Daniel-Fuller-2018.jpg

Daniel Fuller

Senior Staff Writer
Daniel has been writing for Android Headlines since 2015, and is one of the site's Senior Staff Writers. He's been living the Android life since 2010, and has been interested in technology of all sorts since childhood. His personal, educational and professional backgrounds in computer science, gaming, literature, and music leave him uniquely equipped to handle a wide range of news topics for the site. These include the likes of machine learning, voice assistants, AI technology development, and hot gaming news in the Android world. Contact him at [email protected]
Android Headlines We Are Hiring Apply Now