Related to dropout. Noising up actions or more generally making the environment "harder" to learn in than test-time might help generalization.