-
Notifications
You must be signed in to change notification settings - Fork 194
Open
Description
Currently, the step-size change in CSA, .max_delta_log_sigma = 1. This is however undocumented!
The option
{'CSA_clip_length_value': 'None #v poorly tested, [0, 0] means const length N**0.5, [-1, 1] allows a variation of +- N/(N+2), etc.'}is related and restricting the size of a single summand in
Arguably, step-size clipping is universal and could or should be handled independently of the control method?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels