All guides

Free checklist

For product, engineering and IT leaders at U.S. software companies about to release an AI feature to their customers

A demo shows what the AI does. These show what it refuses.

15 ways to break your AI before customers do

A demo shows what the AI does. These fifteen tests show what it refuses, and any fail holds the release.

This answers

  • How do we prove our AI cannot leak data or misbehave?
  • What does a pass look like for each test?
  • Which failures should hold a release?

Checklist · 8 pages, PDF · Proposed approach

What is inside

  1. 1All 15 tests, in five groupsAt a glance
  2. 2Test 1: another customer's recordWhat you get · one test in full
  3. 3Leaks, rights and planted ordersTests 1 to 8 · the pass line
  4. 4Leaked instructions, actions and outagesTests 9 to 15 · the pass line
  5. 5Denied in staging, before anyone uses itFrom our work
  6. 6Your result sheetYour results

You also get

  • All fifteen tests, in five groups
  • One test written out in full, with a failing and a passing reply
  • The pass line for every test
  • A result sheet with the release gate

Get the full guide

All 15 tests with the pass line for each, one test written out in full with the failing and passing reply, the release gate for tests that depend on the model, and a result sheet. The checklist opens on this page as soon as you send the form, and we email you a link to it, with the PDF to download.

We use these details to send you the guide and to follow up once by email about a free 30-minute Product Review. You can ask us to stop at any time. See our Privacy Policy.