
Live · 5 October 2026Research Insights Made Simple #33
SWE-agent: interfaces change outcomes
How search, editing and feedback help the same model
/ Research Insights Made Simple · SWE-agent
Slide contents
1. SWE-agent: interfaces change outcomes
How search, editing and feedback help the same model
2. The hard exam came first
3. A model needs its own IDE-like interface
4. The ACI shapes both command and feedback
5. Resolved means the repository tests pass
6. SWE-agent resolves 12.47% of full SWE-bench
7. The ACI adds 7 pp over Shell-only
8. Good search forces a narrower query
9. Iterative search is worse than none
10. The file window keeps the agent oriented
11. One edit returns the updated state
12. A rejected edit must enable recovery
13. The editor contributes more than linting
14. Old output becomes a placeholder; actions stay
15. Maximum context loses to selection here
16. Successful runs reproduce and locate first
17. Agents succeed quickly and fail slowly
18. Six attempts expand the solvable task set
19. Half of failures: wrong or narrow fixes
20. Transfer the method, not the constants
21. Design actions, measure whole tasks
22. SWE-smith scales up training tasks
23. mini-SWE-agent keeps just bash
24. SWE-bench Verified also needed an audit