Monitoring and retraining

Keeping a model right after launch: why models decay, the kinds of drift and the broken pipelines that are more common than any of them, the four layers of monitoring, measuring drift with PSI, watching a model whose labels arrive months late, alerts that page for the right things, retraining triggers, adversarial drift in fraud and an incident worked from first alert to fix.