From AI-Native Development to AI-Native Measurement
Why developer productivity becomes the key to evaluating process changes
Slide contents
1. From AI-Native Development to AI-Native Measurement
Why developer productivity becomes the key to evaluating process changes
2. What This Article Is About
Measurement stack for transition
Part 1: local acceleration misleads.
Part 2: Google research lessons.
Part 3: no magic metric.
Parts 4-6: measurement layer.
3. 01. No Measurement, Only Local Optimization
Coding speed ≠ delivery improvement
4. AI-Native Needs Developer Productivity
5. DORA 2024–2025: AI Adoption ≠ Delivery Improvement
6. Narrow Metrics: Convenient but Dangerous
7. 02. Developer Productivity for Humans
Google Research series — the best framework for evaluating development process changes
8. Productivity ≠ Conveyor Belt
Development is complex creative work
Measuring people: technology + sociology.
Taylorism fails for knowledge work.
AI removes routine, leaves risk.
The human part gets harder.
9. Measure Developer Goals, Not Tools
10. Every Data Source Lies Differently
11. Speed, Ease, Quality and Trust
12. 03. No Single 'Magic' Metric
All models are wrong, but some are useful
13. Measuring Productivity = Building a Model
14. 04. Measurement Layer for SE 2.0
Measure effect, not tool adoption
15. Unit of Analysis: Process Change
16. Five Principles of the Measurement Layer
17. Longitudinal Measurement and Trust
18. 05. What to Measure in Practice
Four feedback loops for a large company
19. Four Measurement Loops
20. 06. Conclusions for a Large Company
Measurement layer — the mechanism for transferring practices from frontier to core
21. Without Measurement Frontier Becomes Case Theater
Transfer proven impact
Frontier shines: PRs, code, docs.
Core misses what improves delivery.
Separate stability damage from noise.
Measurement turns frontier into capabilities.
22. AI-Native Without Measurement: Open Loop
23. References and Materials
Developer productivity and delivery outcomes
DORA AI research: dora.dev/research/
SPACE framework: queue.acm.org/detail.cfm?id=3454124
DX Core 4: getdx.com/research
Google Engineering Productivity + Accelerate.
24. Thank You!
AI-Native Measurement
For more materials on this topic, visit the "Book Cube" channel — all links are collected there
Alexander Polomodov, Technical Director & Fellow, T-Technologies
@Book_Cube