Docs · LLMs and developers
Version3.13.0How the confidence setting decides which inferences count, and how the review queue works.
Confidence and the review queue
The confidence setting
The confidence setting decides how confident an inference must be before it counts toward a score or stage. Every team uses Balanced. Only the team's Owner can change the setting; this is not yet available in the app.
| Setting | Minimum confidence |
|---|---|
| Strict | 0.9 |
| Balanced (default) | 0.8 |
| Permissive | 0.7 |
No setting goes below 0.7. An app can raise the bar for a specific factor but cannot lower it below the team's setting. Each change to the setting is recorded.
Inferences below the bar do not count. They appear in the review queue.
The review queue
The review queue lists what needs a person's attention, such as low-confidence inferences and sources that disagree. It is shown to the steward, Owners, and Admins.
Owners and Admins can act on an item:
- Correct a fact. The correction is saved to team memory.
- Record a decision. The decision, approval, or rejection is saved to team memory in the app's environment.
Approving a low-confidence inference makes it count as approved from the next run. Each action records the member, the app, and the version it came from. Repeating the same request does not create a second action.
Members who are not Owners or Admins can open evidence but cannot correct or approve.