Repeatable test setup
TokenWarden used up to 70% fewer input tokens.
We ran the same opencode coding tasks with TokenWarden, with no plugin, and with other token-saving plugins.
The full suite includes 210 runs and 7.7 hours of runtime. The detailed setup and raw results are available in the benchmark repository.
Latest comparison
Average input tokens used.
These results use the 30-run read/write subset behind the up-to-70% claim. Percent saved is measured against the no-plugin result.
| Setup | Runs | Average tokens | Average savings |
|---|---|---|---|
| No plugins | 6 | 336,849 | Baseline |
| TokenWarden | 6 | 101,213 | 70% saved |
| OpenSlimEdit | 6 | 393,092 | 16.7% higher usage |
| DCP | 6 | 261,277 | 22.4% saved |
| OpenRTK | 6 | 325,105 | 3.5% saved |