Mailbox demo

Fictional company and emails. simulated reading: a deterministic stand-in for the Copilot Studio agent; rules, replies and numbers are the real, tested code.

Design
Mode

    Every email, expected vs actual

    Illustrative assumptions — not real company data. Defaults come from data/model.json; the same function runs in CI.

    Assumptions

    What moves the 3-year NPV most (±25%)

    Trust is earned in steps

    1. 0 · Shadow

      Runs on a copy of the mailbox; outcomes only in the log. Gate: agrees with agents on ≥ 90% of in-scope emails.

    2. 1 · Draft-only

      Every reply is a draft with a Teams card. Gate: ≥ 95% sent unedited, no data-protection rejections, DPO sign-off.

    3. 2 · Graduated

      Automatic for plain status and POD to contacts. Weekly review of 20 automatic replies.

    4. 3 · Expand

      Phase 2: slot changes. Separate design and business case.

    Going down is one setting, and automatic after a data-protection incident, a harmful reply in the weekly sample or a failed evaluation after a model update.

    KPIs

    KPIBaselineTarget week 12
    Median first response, status/POD2.9 h< 15 min auto, < 2 h draft
    French-language first response5.2 hequal to NL/EN
    In-scope emails answered automatically0%55%
    Drafts sent unedited—≥ 85%
    Repeat emails12%< 5%
    Data-protection incidentsunknown0

    What this demo is not