Step 3 of 3
Proof nothing was lost
Trimming only helps if Claude still gets what it needs. Here's the proof.
Bridge: checked by the computer
Ten everyday questions about Acme, our made-up company. For each one we ask Acme's API, trim the reply, and check that every fact needed to answer is still there and still the same.
- 1 All facts kept
Which orders are still processing, and for which customers?
Checked: order ids, customers. Reply size: 8,912 → 1,828 tokens.
- 2 All facts kept
What was in order ord_5007, and what was the total?
Checked: products, quantities, total. Reply size: 802 → 333 tokens.
- 3 All facts kept
What's the email and city of customer cus_1003?
Checked: email, city. Reply size: 795 → 317 tokens.
- 4 All facts kept
Which customers are on the Pro plan?
Checked: names, plans. Reply size: 9,636 → 1,402 tokens.
- 5 All facts kept
Which customers owe us money, and how much?
Checked: names, balances. Reply size: 9,636 → 1,402 tokens.
- 6 All facts kept
Which support tickets are open, and what are they about?
Checked: ticket ids, subjects, priorities. Reply size: 4,102 → 505 tokens.
- 7 All facts kept
Who is cus_1001's account manager, and how do I reach them?
Checked: name, email, phone. Reply size: 793 → 316 tokens.
- 8 All facts kept
When was order ord_5012 placed, and has it shipped?
Checked: placed, shipped, status. Reply size: 954 → 420 tokens.
- 9 All facts kept
List customer cus_1002's orders with their status and total.
Checked: order ids, statuses, totals. Reply size: 3,602 → 944 tokens.
- 10 All facts kept
Which orders were cancelled, and when?
Checked: order ids, cancelled on. Reply size: 8,846 → 1,947 tokens.