Harness choice has little effect on task success rate, but can significantly affect the cost on the benchmarks we test. The same model can achieve similar success rates at up to 5x costs.
Pi, a minimal, open-source harness can be competitive on both cost and task success rate.
Models may perform better with other harnesses than with their own.