Stopping Criteria Object

Criteria by which an Experiment could be judged to be completed. If you are looking for guidance on whether you should stop or continue requesting more observations, Stopping Criteria can make recommendations.

Fields

KeyTypeValue

reasons

array<string>

Any stopping criteria which have been satisfied. Possible reasons include:

observation_budget_reached

You have reached the observation_budget for this experiment.

possible_stagnation

No improvement has been observed for a while. We use a variety of techniques to predict if an experiment is stagnant - however these methods are only estimates and we are not able to provide a score for how likely you are to observe improvement beyond this point. For this reason, we recommend setting an explicit observation_budget.

should_stop

boolean

Whether any stopping criteria have been satisfied. If this value is true, you could consider terminating your experiment.

Last updated