NSDI '21 - Running BGP in Data Centers at Scale

NSDI '21 - Running BGP in Data Centers at Scale
Anubhavnidhi Abhashkumar and Kausik Subramanian, University of Wisconsin-Madison; Alexey Andreyev, Hyojeong Kim, Nanda Kishore Salem, Jingyi Yang, and Petr Lapukhov, Facebook; Aditya Akella, University of Wisconsin-Madison; Hongyi Zeng, Facebook
Border Gateway Protocol (BGP) forms the foundation for routing in the Internet. More recently, BGP has made serious inroads into data centers on account of its scalability, extensive policy control, and proven track record of running the Internet for a few decades. Data center operators are known to use BGP for routing, often in different ways. Yet, because data center requirements are very different from the Internet, it is not straightforward to use BGP to achieve effective data center routing.
In this paper, we present Facebook's BGP-based data center routing design and how it marries data center's stringent requirements with BGP's functionality. We present the design's significant artifacts, including the BGP Autonomous System Number (ASN) allocation, route summarization, and our sophisticated BGP policy set. We demonstrate how this design provides us with flexible control over routing and keeps the network reliable. We also describe our in-house BGP software implementation, and its testing and deployment pipelines. These allow us to treat BGP like any other software component, enabling fast incremental updates. Finally, we share our operational experience in running BGP and specifically shed light on critical incidents over two years across our data center fleet. We describe how those influenced our current and ongoing routing design and operation.
View the full NSDI '21 program at www.usenix.org/conference/nsd...

[@aphrozz]

Seems to work fine

[@somename8831]

Well this aged like milk. :D

[@netcruzer]

This network config is having a massive failure right now. FB, Messenger, WhatsApp, and Instagram all down.

[@pvk93]

I would assume the recovery time for routes to propogate around the world is in hours.

[@LLMA2]

The technical level of this team is very good, I hope not to be fired. . .

[@IshamMohamedIqbal]

Did they implement this? Could this shed light on the current outage?

[@Jccke]

Yes. I guess Kim made a bug and It has destroyed everything

[@abrand305]

1st day at work. Go ahead and configure production BGPs… Lol

[@Cuwubiq]

Great.. i was there.

[@FrankFloresRGVZGM]

Move fast and break everything.

[@SpaceFederation]

Next time use staging to test your changes 😬

[@kcwithbrim2582]

LMAO

[@garyha2650]

Can you make a version for those who speak English?

[@Jccke]

That's your Fault Kim