Testing rules

There are two options for testing rules: shadow mode and backtesting.

If a rule is in shadow mode, it will appear in API responses and the dashboard but not affect scoring. Statistics (e.g. fire rate, precision, recall) are computed for evaluation. You can change rules from shadow mode to live mode when comfortable with their performance.

You can backtest a rule when you go to create or edit one. Backtesting will generate statistics about rule performance (e.g. fire rate, precision, and recall), and also show example sessions where the rule was triggered. You cannot backtest rules with custom data.