HITL Reviews¶

Human-in-the-loop (HITL) reviews let a human approve, reject, or modify AI output before it has downstream effects.

Creating a review¶

Reviews are created automatically when a run hits a hitl_checkpoint, or manually from the dashboard.

Review workflow¶

sequenceDiagram
    participant Run
    participant Platform
    participant Reviewer

    Run->>Platform: POST /reviews (pending)
    Platform->>Reviewer: notify (webhook / email)
    Reviewer->>Platform: GET /reviews (see queue)
    Reviewer->>Platform: POST /reviews/{id}/approve
    Platform->>Run: resume signal
    Run->>Run: continue execution

Assignees¶

Reviews can be assigned to specific workspace members. Unassigned reviews are visible to all members with the reviewer role.

Audit trail¶

Every review action (assign, approve, reject, comment) is recorded in the audit log with the reviewer's identity and timestamp.