What is the difference between covariate shift, label shift, and concept drift as types of distribution shift?

Question

Machine Learning — Hard

What is the difference between covariate shift, label shift, and concept drift as types of distribution shift?

Accepted Answer

Covariate shift, label shift, and concept drift all refer to different types of distribution shift. Covariate shift occurs when P(X) changes but P(Y|X) remains constant, label shift is when P(Y) changes but P(X|Y) remains constant, and concept drift is when P(Y|X) itself changes, requiring different correction strategies.