ML Drift: Identifying Issues Before You Have a Problem

www.fiddler.ai/blog/drift-in-...
Over time, our AI predictions degrade. Full Stop.
Whether it’s concept drift, where the relationships of our data to what we’re trying to predict has changed, or data drift, where our production data no longer resembles the historical training data, identifying meaningful machine learning drift versus spurious or acceptable drift is tedious.
In this 15 minute overview you’ll learn about the different types of ML drift and how to monitor for the early warning signs. We’ll also cover strategies to intervene before “drift” impacts the bottom line.

[@googol-boy-data]

hey congratulations for the presentation. It was very concise, I learned a lot and I really loved the references.

[@hossein_haeri]

in 4:50, Is mathematically even possible to have label drift and not feature drift when drift is not real? (the same p(x) but different p(y)). Bayes rule tells us p(y|x) = p(x,y)/p(x). This means if p(y|x) and p(x) are fixed, then p(x,y) is fixed, hence, p(y) is fixed.
Long story short, the mathematics of this presentation is wrong! Virtual drift is when p(x) changes and real drift is when p(y|x) changes.