Links

Stopping Criteria Object

Criteria by which an Experiment could be judged to be completed. If you are looking for guidance on whether you should stop or continue requesting more observations, Stopping Criteria can make recommendations.

Fields

Key
Type
Value
reasons
array<string>
Any stopping criteria which have been satisfied. Possible reasons include:
observation_budget_reached
You have reached the observation_budget for this experiment.
possible_stagnation
No improvement has been observed for a while. We use a variety of techniques to predict if an experiment is stagnant - however these methods are only estimates and we are not able to provide a score for how likely you are to observe improvement beyond this point. For this reason, we recommend setting an explicit observation_budget.
should_stop
boolean
Whether any stopping criteria have been satisfied. If this value is true, you could consider terminating your experiment.