"Building Scalable Stateful Services" by Caitie McCaffrey

The Stateless Service design principle has become ubiquitous in the tech industry for creating horizontally scalable services. However our applications do have state, we just have moved all of it to caches and databases. Today as applications are becoming more data intensive and request latencies are expected to be incredibly low, we’d like the benefits of stateful services, like data locality and sticky consistency. In this talk I will address the benefits of stateful services, how to build them so that they scale, and discuss projects from Halo and Twitter of highly distributed and scalable services that implement these techniques successfully.
Caitie McCaffrey
TWITTER
@caitie
Caitie McCaffrey is a Backend Brat and Distributed Systems Diva working on Infrastructure at Twitter. Prior to that she spent the majority of her career building services and systems that power the entertainment industry at 343 Industries, Microsoft Game Studios, and HBO. Caitie has a degree in Computer Science from Cornell University, and has worked on several video games including Gears of War 2, Gears of War 3, and Halo 4. She maintains a blog at CaitieM.com and frequently discusses technology and entertainment on Twitter @Caitie

[@wengao6544]

Great talk, thanks! Can't believe it's 8 years ago, but still very helpful to me

[@growlingchaos]

Excellent talk!

[@userasadullah]

Well explained.

[@guangtongshen7007]

Some keypoints:
11:05 Dynamic Cluster Membership.

[@leif5046]

99% of what is mentioned in this talk is trivially easy to implement using Erlang/OTP, because it was designed specifically for concurrent and distributed computing and eventual consistency. This talk is basically an unintentional sales pitch for Erlang/OTP 😊