Skip to content
Office

Office Assist feature

Batch testing

Coming soon

Run a whole list of questions against the assistant after every change and see what got better or worse.

A test set from real questions

Paste a list, upload a CSV, or import the last 100 questions customers actually asked. Add an expected answer or a note to any of them.

Graded, with your override

Each run answers every question and grades it Pass, Partial, Fail or Not covered against what you expected. You can overrule any grade. Runs are kept, so you can see "Run 4: 82% pass, up from 71%".

Example

Before and after a guidance change

A team adds a rule to always ask for the order number. Their 60 question test set goes from 44 passes to 51, and the two new fails show the rule firing on questions that had nothing to do with orders, so they narrow it.

How to set it up

  1. 1

    Open Tests and create a test set.

  2. 2

    Import recent questions or upload a CSV.

  3. 3

    Run it, review the grades, and run it again after your next change.

Batch testing is part of Office Assist and included on every plan.

Try Office Assist with your whole team

7-day trial with every feature. Cancel from the billing page whenever you like.