Skip to content
all longreads
Longread#Productivity#Leadership#AI4SDLC

Developer Productivity: Google’s Human-Centered View

Builds are faster, more code is being produced, and the team still struggles to ship changes. Developer Productivity for Humans helps explain which work we measure, whose effort we overlook, and why AI makes these questions more pressing.

September 21, 2026≈ 35 min

An author’s synthesis of Google research and my reviews in Book Cube and on Medium. Sources checked as of September 20, 2026. Prepared for solo Research Insights Made Simple episode 30; this is a standalone article, not a summary of a recording.

01

Measuring human work is harder than measuring a production line

Imagine a familiar conversation. A platform leader presents shorter build times. An engineering manager replies that deadlines are still slipping. The finance director asks whether the new capacity paid for itself. Each is addressing a real problem, but each has a different unit of outcome: a technical operation, a delivered feature, or an economic return. If we immediately look for a common indicator, we risk combining three separate questions into a number that helps nobody make a decision.

This is why I find Developer Productivity for Humans interesting. Its editors, Ciera Jaspan and Collin Green, bring together Google research on people, tools, and the conditions of engineering work. It is a sequence of short articles rather than a finished, unified theory. Contributors change, methods differ, and individual articles may report a study, propose a model, or explore a thought experiment. They are best read as an evolving research program in which each new question sharpens the boundaries of the preceding answer.

The opening article, A Human-Centered Approach to Developer Productivity, frames the problem around a person doing complex, creative work. Technical infrastructure shapes what that person can do; the social environment shapes access to knowledge, assistance, and decisions. Separating these factors may be convenient for organizing departments, but it is risky when explaining outcomes. A fast tool offers limited help to an engineer who does not know who can approve a change. Good communication does not remove flaky tests that consume attention every day.

Under this view, developer productivity cannot be reduced to the intensity of visible activity. Writing less code may mean finding an existing solution. Closing fewer tickets may mean removing the cause that generated them. Spending a day explaining a system may make several colleagues faster the following week. These situations have different mechanisms, so a single activity counter cannot assign the right value to them in advance.

Goal attainmentSpeedEaseQualityGoal attainmentA single metric leaves part of the work out
Speed, ease, and quality are complementary dimensions. This diagram represents the series’ framework, not a formula for an overall score.

For a practical discussion, the series keeps speed, ease, and quality in view together. That is not a request to average three scales. When a change saves time but makes work opaque and fragile, both effects matter. The reverse can happen too: understandable code can make review easier, shorten the next change, and reduce the risk of mistakes. Tradeoffs exist, but a gain in one dimension does not necessarily require a loss in another.

The later article Measuring Productivity: All Models Are Wrong But Some Are Useful explains why debates about the one correct metric are often unproductive. Measuring productivity always constructs a model of reality. It selects events, task boundaries, a time horizon, and an outcome. Incompleteness is unavoidable; the problem arises when omitted work matters to the decision being made. A model of time spent writing a function may help improve a code editor while remaining inadequate for assessing product delivery.

My starting question for an initiative is therefore: what decision are we trying to make, and which omitted part of engineering work might change that decision? Purchasing capacity requires attention to latency and infrastructure costs. Changing a review process requires the author’s and reviewer’s effort, rework, and result quality. An onboarding program requires attention to learning and independence. Context is not an obstacle to measurement. It determines what is worth measuring.

02

A goal outlives the tool used to achieve it

In Measuring Developer Goals, Ben Ferrari-Church and Carolyn Egelman propose a more durable unit of observation: the developer’s goal. The distinction sounds semantic until we examine an example. “Using search” describes an interaction with a tool. “Understanding an existing solution so I can safely change it” describes a person’s intent. Search may then sit alongside reading code, talking to a colleague, running an experiment, and consulting documentation.

If each tool evaluates only its own segment, successful local reports can coexist with a poor overall experience. Search returned results quickly, documentation loaded, and the build finished. Yet the engineer still could not establish what behavior the system permits. Successful operations may have increased precisely because the person repeatedly tried to understand the problem. Activity then represents an unfinished goal rather than a productive outcome.

The authors describe 30 goals formulated to be durable, understandable, consistent in scope, and connected to observable behavior. The refinement process matters: researchers check whether engineers interpret the wording consistently and whether the goals cover actual work. This is neither a job description nor a set of individual performance standards. It is a way to agree on which episodes of activity can meaningfully be compared.

GoalGoalMultipletoolsIterationsVerifiedoutcomeThe goal survives a change of tools
A goal connects actions across tools. Loops and workarounds should remain visible in the analysis rather than being classified automatically as user errors.

My review of developer goals highlights a useful shift: from asking about code review to asking how tools support ensuring the quality of someone else’s contribution. An ordinary survey can become confined to the review interface. The broader wording includes understanding intent, locating requirements, testing, and discussing consequences. Ratings can decline after this change even when the tool is unchanged: researchers have made previously omitted work visible. We also reviewed this paper in Research Insights Made Simple #8 and discussed it in Code of Leadership #67 (both in Russian).

This is an important precaution when comparing results over time. If wording, scenario boundaries, or the participant mix changes, the new measure cannot simply be appended to the old chart without explanation. Better observability can look like deteriorating conditions. Before asking a team to fix a falling score, check whether the survey has started asking a more meaningful question. Keep the old and new wording together with the date of the change.

In practice, I would start with one frequent, painful goal. An engineer needs to understand why a test failed and return a change to a verifiable state. We can describe the episode’s beginning and end, key actions, waiting points, and requests for help. We distinguish a product defect, a flaky test, and an environment problem. Otherwise, identical time to a green build can conceal different causes that call for different interventions.

Observe both the intended path and real deviations. A platform team may have designed a short sequence of steps while developers have long relied on a workaround because the official route requires unavailable permissions. The workaround is evidence about the product, not a reason to blame its users. The next discussion should concern the need it serves, why it arose, and whether that need can be met more reliably.

Durable goals become particularly valuable with AI. An agent may replace manual search; a description of intent may replace typing code. The need to understand a system, obtain a correct change, and support its future maintenance remains. Measurement tied only to clicks in the previous interface can become obsolete before the organization has evaluated the new way of working.

03

Methods should test one another

Once a goal is chosen, it is tempting to seek one trustworthy data source. Logs appear objective, surveys subjective, and interviews expensive. The series offers a more useful distinction: every method observes a particular aspect of work and has its own blind spots. An event log can reliably record that a build started. It does not know why the engineer started it at that moment or whether the result is sufficient to continue.

The earlier work Enabling the Study of Software Development Behavior With Cross-Tool Logs, published before the column began, describes InSession, a system integrating events from many development tools. Its value lies in reconstructing sequences of activity across product boundaries. Between a test run and the next edit, someone may search for information or interact with colleagues. Watching only the editor makes those actions disappear. Watching only the build system makes waiting look like empty time, even when the person is doing another useful task.

Connected events do not automatically identify a goal correctly. Logs contain missing events, background activity, concurrent tasks, and ambiguous pauses. Session definitions and interpretations of transitions therefore need validation against human experience. Without that, sophisticated infrastructure merely counts poorly chosen signals more precisely. Even a small company can apply this lesson: before building a common event warehouse, examine a few real work sequences with the people who performed them.

One research questionLogsWhat happenedSurveysHow it feltInterviewsWhy it happenedOne research questionAn experiment tests the effect of a change
Three sources help explain work. Establishing a causal effect requires a separate study design, not merely joining tables.

Measuring Developer Experience With a Longitudinal Survey describes EngSat, the survey program Google has run since 2018. Its duration makes changes in experience visible, while repeatable operations make surveys part of management practice. My review of the survey program highlights the rotating researcher–engineer pair, a documented process, automated processing, and reports to participants. Measurement infrastructure includes responsibility for the quality of questions and resulting decisions, as well as software. We devoted Research Insights Made Simple #10 to this study. For me, the feedback loop matters: participants are shown which decisions their answers informed.

A survey measures perception, which is a legitimate subject of research. Ease, confidence, fatigue from repeated verification, and access to help cannot be reconstructed from code-submission counts. The mistake is treating a perception report as an exact time measurement or proof of causation without further validation. The opposite mistake is dismissing experience because a technical log cannot capture it.

Disagreement between sources is a reason to investigate the mechanism. Suppose builds are demonstrably faster but satisfaction is unchanged. Engineers may not yet have adjusted their expectations. Rare scenarios may have improved while the most painful ones remain. Test stability may have deteriorated at the same time. Averaging the signals and closing the question would be easier, but the disagreement points to the next useful data breakdown or interview.

What Makes a Good Productivity Metric? shifts attention from the entire productivity model to the quality of an individual measure. For my own practice, this suggests a definition that explains the phenomenon, the observed signal, the proposed relationship, and the decision it supports. These four checks are my working approach, not a verbatim list from the authors. Reproducibly calculating a number does not establish that it answers the intended question.

Finally, an intervention’s effect cannot automatically be inferred from a before-and-after comparison. Tasks, team composition, seasonal load, and external dependencies change. A control group or staged rollout helps where feasible; interviews can explain unexpected differences. In a small organization, showing uncertainty honestly is better than imitating the precision of a large study. Measurement should improve a decision rather than give a predetermined answer an impressive statistical presentation.

04

Waiting changes behavior as well as elapsed time

Build Latency, Predictability, and Developer Productivity begins with a question an infrastructure leader might ask: how fast must builds be for developers to remain productive? A convenient model is already hidden in the question. It assumes a threshold below which someone continues working and above which they lose focus. If that threshold exists, infrastructure investment could stop once the build system becomes fast enough.

In my build latency review, I highlighted that the researchers did not find the expected universal boundary. In the data they studied, lower latency was associated with a greater likelihood of continuing the same work. This does not establish that every millisecond saved is economically justified. It does remove a simple justification for deciding that further speed is unnecessary. Infrastructure costs, scenario frequency, and subsequent behavior remain separate parts of the assessment.

The second part concerns expectations. People decide whether to switch before the build finishes, so their decision depends on its anticipated duration. Someone expecting a long wait may open another task even when this particular build finishes quickly. Someone expecting a short wait may spend several minutes watching unproductively. The same actual duration can therefore produce different experiences and different costs of returning to the original task.

Duration How long I waitedDurationHow long I waitedPredictabilityWhat I expectedBehaviorWhat I switched toThe experience of waiting extends beyond the build timer
Actual latency, an engineer’s expectations, and the subsequent choice of activity are separate measurement targets. There is no universal switching threshold in this diagram.

This suggests another way to improve tools: make waiting more understandable. It does not promise that a progress indicator can replace faster execution. A good time estimate helps people plan their next step; a poor one can increase frustration. Its accuracy and usefulness should be tested in a real scenario. Predictability has different value for a brief check and a lengthy release build because people organize their surrounding work differently.

The authors’ build-acceleration experiment contains another important lesson: behavioral change arrived with a delay. My review notes that engineers needed time to adapt to the new conditions. A particular interval from one study should not become a universal standard for platform initiatives. The broader point is that a technical improvement can appear immediately while human adaptation follows later. Measuring only the first week can miss a meaningful part of the outcome.

Measuring Flow, Focus, and Friction for Developers develops this line by relating logs to surveys and developer diaries. Flow, focused work, and friction are related but distinct concepts. A long stretch without switching does not automatically mean productive problem-solving: the person may be stuck. Several transitions between tools do not establish the reverse: those transitions may be a natural part of finding a solution.

This changes the management question. Protecting opportunities to concentrate is useful, but counting uninterrupted minutes should not create a new production quota. First establish which interruptions are disruptive, which help someone obtain an answer, and which follow from the nature of the work. An on-call engineer and an algorithm designer have different responsibilities. Giving them the same target for uninterrupted work may improve a report while harming the service.

A practical response is to examine specific waiting episodes. Where does waiting occur, how predictable is it, what activity does it prompt, and what does returning cost? This connects infrastructure to behavior. It helps distinguish investment in speed from investment in stability, better feedback, or a different process. Purchasing capacity remains a possible answer, but it is no longer the only answer prepared in advance.

05

The work environment shapes learning and access to help

Hybrid Productivity is easy to recruit into an argument about office attendance. First, however, restore its research context: the pandemic changed more than work location. Home conditions, colleague availability, schedules, and onboarding practices changed simultaneously. Isolating the effect of physical presence is difficult in that situation. Google’s experience is valuable primarily for how questions were framed, not as a ready-made rule for the number of office days.

Comparing the average employee also conceals differences. An experienced engineer who knows the system and the right people brings an established network into remote work. A newcomer must build that network while learning the tools and domain. Equally good technical conditions do not make the situations equivalent. Asking whether someone can perform a task at home is insufficient without asking where they will obtain context they do not yet know they need.

Onboarding and Ramp-Up examines onboarding and the transition toward independent work. A first code submission is a convenient observable milestone, but captures only part of the process. Someone can fix a typo quickly while still not understanding the system. Someone else may take longer to prepare a substantive change while learning testing and responsibilities. The initial task affects the metric, making individual comparisons particularly misleading.

AccessAccessContextSupportIndependenceA first change captures only part of onboarding
Access, context, support, and independence are practical areas to examine during onboarding. This is an editorial synthesis inspired by the research, not a normative Google scale.

Instead of one milestone, describe what someone gradually learns to do independently: locate a component owner, run the relevant checks, explain a change’s consequences, and obtain useful feedback. These indicators depend on the role. A platform engineer and a user-interface developer face different situations. Assessment principles can be shared, but tasks and expectations should match future responsibility. Otherwise, the program teaches people to pass an onboarding exercise rather than do their job.

Requesting help should not be treated as onboarding failure. Knowing when to ask can demonstrate maturity. Distinguish access to support, answer quality, and recurrence of the problem. If every newcomer asks how to obtain the same permissions, improve the process. If questions concern difficult tradeoffs, talking to an experienced colleague may be precisely the learning the organization wants to preserve.

Managers also need to see who pays for onboarding with their time. A mentor may temporarily submit less of their own code because they are explaining the system. If individual measures count only direct code output, the organization penalizes behavior it needs. Comparing newcomer speed without mentor effort is as incomplete as measuring generation without review time. The collective outcome extends beyond individual counters.

A team can keep a short record of difficulties: what was missing, where an answer was sought, who helped, and what can now be done independently. Do not turn it into mandatory detailed reporting on every action. A few meaningful episodes each week may reveal that the problem is an unavailable environment or unclear responsibility rather than a weak introductory lecture. The intervention can then be specific.

My cautious conclusion is that work arrangements should be evaluated through tasks and conditions for collaboration. A result from one company and period cannot establish a rule for all teams. The research discipline can travel: distinguish groups, account for prior experience, collect different kinds of evidence, and observe what changes after an intervention. For a manager, that is more useful than another universal argument for or against the office.

06

Connect quality and debt to future changes

Software Quality distinguishes process, code, system, and product quality. I find this particularly useful because it explains a common organizational disagreement. A manager asks for better quality, meaning fewer user problems. Engineers propose refactoring. Operations wants greater reliability, while product colleagues want to revisit the user journey. All four actions can be reasonable, but they address different questions.

Process quality concerns how a change is created: understandable requirements, meaningful review, and dependable tests. Code quality concerns understanding intent and making the next modification. System quality appears in operation: correctness, resilience, and performance. Product quality includes usefulness and fitness for the user’s task. These distinctions clarify the goal even though the dimensions influence each other in practice.

ProcessProcessCodeSystemProductConceptual connections: each link needs evidence
The four kinds of quality discussed by Google. Arrows represent proposed relationships, not a guaranteed causal chain or measured coefficients.

Do not turn a conceptual model into an established law. A well-designed process can support code quality, but a particular set of rules still needs evaluation. Readable code does not guarantee freedom from external failures. A reliable system may solve a problem users do not have. An investment case should therefore follow the chain: which property changes, what behavior is expected, where an intermediate effect should appear, and which final outcome matters.

Imagine a service where adding calculation variants is difficult. Engineers propose separating business rules from technical plumbing. Their case might include time spent understanding new requirements, the number of places needing modification, and verification effort. Reduced code complexity alone cannot justify a promise of greater customer satisfaction. Explain how simpler changes will support more timely or reliable delivery of a useful capability. Refactoring then becomes a testable hypothesis rather than an argument about taste.

Defining, Measuring, and Managing Technical Debt adds another complication: technical debt depends on the current code and on expectations of the desired future. My technical debt review uses migration from Python 2 to Python 3 as an example. Once a migration decision is made, old code may become debt without its bytes changing. The judgment emerges from new context, requirements, and possibilities. Static analysis without that knowledge sees only part of the situation. We discussed this paper in Research Insights Made Simple #2.

The researchers investigated engineers’ perceptions of debt and tried relating them to existing technical measures. The practical conclusion highlighted in my review is that the available measures did not provide a satisfactory substitute for human judgment. This does not prove automation fundamentally impossible. It establishes a limitation of a particular attempt and reminds us that available data is not necessarily suitable data. Sometimes the phenomenon needs a better definition before choosing a model.

A manager can discuss debt through three questions. Which work does it obstruct? Why will that work matter in the foreseeable future? Which way of reducing the obstruction is preferable? Not every problem needs an immediate monetary estimate. Frequency, affected teams, and severity may be sufficient for some decisions. But a list of bad code detached from planned changes can quickly become an endless catalog of technical preferences.

The research also addresses organizational arrangements: discussing deliberately accepted debt, investing in debt reduction, and establishing a workable management process. Zero debt is not presented as the ultimate objective. A limited solution can help test product value before expensive restructuring. The obligation should remain understood, the risk should have an owner, and changed conditions should trigger reconsideration. Otherwise, a temporary compromise becomes permanent architecture without another discussion.

What Happens When Technical Debt Vanishes? offers a useful thought experiment. Suppose one class of debt disappears permanently. Developers gain time and take on different work. The task mix changes, new difficulties emerge, and familiar metrics need not all improve. This cannot calculate the actual effect of automatic code repair. It does expose the weakness of demanding that every productivity indicator increase whenever an investment is useful.

Removed frictionRemovedfrictionWork changedThe task mixchangedRevalidatethe modelA thought experiment, not a measured time series
Removing an obstacle changes the work itself. This thought experiment examines metric limitations; it does not predict a particular post-AI performance curve.

In practice, observe the specific obstruction removed and the capabilities newly available to the team. Repetitive manual migration might disappear while engineers take on harder changes. Average task duration may increase even as the organization becomes more capable of developing its product. Distinguishing this case from a failed investment requires evidence about the work mix, not just the old completion-time chart.

07

Team productivity is not the sum of individual counters

So far, it has been easy to picture an individual developer at the center: setting a goal, using tools, and obtaining a result. Products, however, are usually created collectively. Software Development Is a Team Sport considers observed collaboration relationships and, separately, teamwork quality through a survey scale. These answer different questions: who works with whom, and how effectively those interactions support a shared goal.

An organization chart does not fully answer even the first question. Two people may share a reporting line while rarely working together. An engineer may regularly depend on another platform’s specialist, a product manager, and an operations colleague. Those relationships change across projects. Formal reporting structures are convenient administrative models, but they do not always map actual collaboration.

Shared outcomeEngineeringProduct and designOperationsShared outcomeWorking relationships cross organizational boundaries
A shared outcome connects different roles. Contact frequency and collaboration quality require separate measures.

A key distinction separates having contact from benefiting from it. Many discussions may indicate healthy collaboration, unclear requirements, or poorly defined responsibilities. Few meetings may reflect sufficient shared context or isolation. Neither direction deserves a positive sign in advance. The research question must identify what coordination problem an interaction addresses and which obstacle it removes.

Platform leaders encounter this directly. Their team can accelerate its own work while adding burden for consumers, for instance by shipping more interface changes that require coordinated migrations. Its internal report shows speed while neighboring teams spend more time maintaining compatibility. This illustrates a possible mechanism; it is not a finding from a specific Google experiment. Team boundaries and consequence boundaries rarely coincide.

The second strand is Creativity in Software Engineering. This qualitative research shows participating developers connecting creativity with usefulness and clever reuse. Novelty alone does not guarantee a good engineering solution. Finding a familiar idea in an adjacent domain, understanding its constraints, and carefully adapting it can be more creative than writing another unique library for an already solved problem.

Find an ideaFind an ideaUnderstandlimitsAdaptShare knowledge
Clever reuse requires understanding constraints and sharing knowledge. This editorial diagram is informed by the creativity research.

This helps explain why important contributions can be hard to see in activity reports. An engineer may prevent unnecessary implementation, help two teams agree on a shared model, or recognize that an existing mechanism already solves the problem. Less new code follows. The organization may benefit, but the benefit needs evidence: duplication avoided, complexity reduced, or subsequent changes made easier.

Nor should the article become a universal opposition between creativity and short-term productivity. It clarifies a concept and raises further questions without providing a coefficient that converts creative decisions into future speed. Qualitative work offers a meaningful model of participants’ experience. That model can inform hypotheses; applying it elsewhere requires testing. The promise is narrower but more useful.

For management, this means discussing contributions beyond direct code output. Which solutions became reusable? Who can now understand the system more easily? Where did shared agreement remove repeated coordination? Such questions complement delivery measures. They do not require a mandatory numerical creativity ranking that people will soon optimize instead of doing the work.

Collaboration and creativity meet in the transfer of context. An idea benefits the organization when others understand where it applies and where it does not. Documentation of reasoning, discussion of alternatives, and mentoring therefore produce team capability. Treating them solely as distractions from coding can deliver short-term acceleration alongside long-term dependence on a few indispensable people.

08

AI shifts work between people and across time

AI makes the preceding questions more visible. What Do Developers Want From AI? starts with developers’ needs rather than available technological capabilities. The ability to continue code does not establish code continuation as someone’s main difficulty. They may need to understand an unfamiliar system, align requirements, or establish that a proposed change respects an important constraint.

Understanding and Designing for Trust in AI Powered Developer Tooling focuses on trust and the ability to customize AI interaction. Users respond differently to erroneous suggestions and interruptions. One suggestion frequency or imposed workflow may therefore suit some engineers poorly. The practical question is how to offer sufficient control and understandable feedback while keeping assistance available when needed.

Seamful AI for Creative Software Engineering extends this discussion into creative work. The authors consider AI designs that preserve room for developer reflection and participation. This is not a proposal to slow every tool deliberately. Distinguish meaningless friction from a moment when someone needs to notice an assumption, consider an alternative, or check their understanding. Removing all pauses indiscriminately can also remove opportunities to learn from decisions.

The September article Navigating the Tensions of AI in the Software Development Lifecycle organizes four tensions in AI use. My September 16 review describes its basis: 1,110 open-ended responses from Google developers about AI’s effects on work over the preceding three months. This is qualitative analysis of experience within one company. It cannot establish a universal speedup, industry-wide risk prevalence, or evidence of long-term skill erosion. My annotated copy of the paper accompanies the review.

FramingFramingGenerationVerificationMaintenanceTime saved at one stage can become work at another
Evaluate the whole change journey: framing, generation, verification, and maintenance. This diagram shows possible work redistribution, not measured costs.

Saving work and shifting it

The first tension separates effort saved from effort relocated. Generation can reduce typing while adding task clarification, verification, and error correction. Some burden can move to a colleague reviewing the change. Author time before submission is therefore insufficient. We need to understand the total effort of bringing a change to a state the team is willing to trust.

Recommendations highlighted in the review concern verification throughout the workflow: smaller tasks, tests inside the agent loop, and fewer switches between disconnected tools. Managers can investigate where errors surface. If discovery moves to a later, more expensive stage, early acceleration may be cost transfer. That is a research hypothesis for a particular team, not a predetermined negative verdict on AI.

Immediate results and accumulated debt

The second tension concerns accumulated quality. Code and documentation can appear complete while preserving decision rationale poorly. The review discusses technical debt, understanding debt, and loss of intent. Ask whether the next engineer will be able to explain the design, not merely whether the current version works. Polished prose without necessary reasoning does not solve that problem.

The position article Technical Debt in the AI Era reinforces attention to human decisions about debt management with automation. AI can help reduce debt, making “generation always adds debt” as weak as a promise of automatic debt disappearance. The task, acceptance criteria, and responsibility for consequences matter. Delegating a repair should include a way to verify what improved.

An easy start and a difficult final stretch

The third tension separates a quick prototype from operational readiness. Edge cases, integration, permissions, and behavioral verification remain part of the work. My review includes respondents describing tools claiming tests had passed when they had not run. These are reported experiences, not an estimate of how often all tools behave this way. They nevertheless show why an agent’s success claim cannot serve as evidence of success.

The practical response is to define readiness in advance and account separately for the work required to reach it. When a demonstration succeeds on a convenient example, the next step should test constraints. Agents need context about internal interfaces and architecture; people need actual verification results. Fast generation cannot compensate for the absence of an agreed definition of completion.

Being able to produce and being able to verify

The fourth tension concerns learning. AI helps people attempt unfamiliar languages and components, but evaluating the proposed solution takes knowledge. Rapid output can bypass independent investigation through which that knowledge develops. The authors discuss a risk; the survey does not establish inevitable deskilling. A more useful managerial question is which tasks engineers can now solve and explain without continual external prompting.

Explanatory AI use, mentoring, and independent work in areas requiring deep expertise can preserve learning. Reviewer cognitive load also matters: continually auditing large amounts of someone else’s text differs from developing a solution step by step. Being able to say “I do not understand this change” or “I lack time to verify it” must remain part of ordinary engineering work.

Faster today Produce ExploreFaster todayProduceExploreSustainable tomorrowVerifyUnderstandWork · debt · last mile · learning
Four tensions connect today’s speed with tomorrow’s team capabilities. They help formulate questions; they are not four universal risk coefficients.

This brings the series back to its starting framework. AI adoption changes action sequences, labor distribution, learning, and the meaning of quality. We therefore need to revalidate what old metrics observe. More accepted suggestions, submissions, or completed tickets can be useful observations. They support a productivity decision only after considering goals, verified outcomes, and consequences for everyone involved.

09

Start an improvement program people can trust

Google’s research does not imply a need to reproduce its entire infrastructure. A smaller organization may lack a research team, common tooling, or a sample large enough to detect subtle effects. What transfers is disciplined questioning. Start with the decision to improve, then describe the developer’s goal, work boundaries, observed difficulties, and people affected by an intervention.

The following first-month plan is my management heuristic informed by the series, not a universally validated program from its authors. A month starts a useful cycle of investigation and action. It does not guarantee that the full effect will appear within that time. The build-latency example already explains why behavioral adaptation may need longer observation.

Goal and scopeGoal andscopeBaselineInterventionDecisionA one-month starting plan; effects may take longer
The first month establishes a basis for decisions and continued observation. Scale a change based on evidence, not the calendar.
Period
Week 1
Work
Choose one goal, define its boundaries, and talk to performers and recipients
Outcome
Question, scope, and decision owner
Period
Week 2
Work
Compare real episodes, available events, and a short survey
Outcome
Baseline and blind spots
Period
Week 3
Work
Try one limited intervention; define signs of harm beforehand
Outcome
Observed effects and side effects
Period
Week 4
Work
Review evidence with the team, explain the decision, and schedule another check
Outcome
Continue, revise, or stop

Suppose the chosen scenario is diagnosing a failing test. First clarify completion: does it mean a green check or an understood cause and a fix? Then examine episodes of different kinds, including environmental instability. Look in event logs for waiting, reruns, and returns. Ask what the engineer was trying to establish, where confidence was lost, and which information was missing. The data then acquires an understandable connection to the goal.

A narrow intervention might improve a diagnostic message. Evaluate it against the same scenario. Is identifying the cause easier? Have unnecessary reruns declined? Has support burden increased? Does the process feel more understandable? These questions need not become four permanent indicators. Observation may answer some; a follow-up interview after several real cases may answer others.

Before starting, write down which finding would change the manager’s decision. If every movement in a chart will justify continuation, this is not a hypothesis test. Allow for a benefit limited to one group, an improvement dependent on training, excessive support costs, or an insensitive metric. Each can be useful if it changes the action rather than merely defending money already spent.

Agree on data-use boundaries separately. Investigating working conditions is poorly compatible with secretly ranking people by their answers. Participants need to know what is collected, who sees it, and what happens afterward. Small groups require particular care with interpretation and identifiability. Trust has methodological significance: it affects willingness to describe actual difficulties.

Returning results to participants is equally important. Even a good questionnaire loses purpose when nothing follows. Show which problem was selected, what was tried, what remains unknown, and when the team will revisit it. Declining an intervention with an honest explanation is reasonable. Expecting useful feedback indefinitely while each cycle ends only in a management presentation is not.

In subsequent cycles, expand the map where evidence justifies it. A goal may reveal another team’s dependency, a new kind of debt, or a learning problem. Add that part of the work and test the next hypothesis. The program grows from decisions instead of an ambition to collect as many events as possible. As infrastructure becomes more complex, preserve an understandable connection between each measure and its originating question.

For me, this is the main result of reading the series together. Engineers, tools, and organizations form a joint system. Improvement requires seeing its boundaries, hearing participants, and testing our explanations. AI makes the speed of artifact creation particularly visible, but a team’s ability to understand, verify, and evolve a system remains an outcome in its own right. That capability deserves a visible place in the productivity conversation.

Takeaways

Five principles for engineering leaders

  1. 01Start with a developer’s goal and the decision you need to make. Tool events become useful measures only after their relationship to that goal has been validated.
  2. 02Consider speed, ease, and quality together. A better number can conceal work shifted to another person or into the future.
  3. 03Logs, surveys, and interviews reveal different aspects of work. Disagreement helps expose a faulty model; an experiment can test an intervention’s effect.
  4. 04Quality, learning, and collaboration create the conditions for future productivity. Today’s volume of code changes cannot capture them on its own.
  5. 05AI makes verification, preservation of intent, and expertise development particularly important. Evaluate the whole change journey and everyone involved in it.

A thematic reading guide

IEEE Software columns and related research are listed separately from my reviews. For restricted articles, detailed discussion relies on the identified author reviews; abstracts of newer work support only their stated scope and conclusions. Thought experiments and recommendations are not presented as comparative measurements.

People and goals · IEEE Software column

  1. A Human-Centered Approach to Developer Productivity (2023) — the starting framework: technical and social conditions of engineering work
  2. Measuring Developer Goals (2024) — Ben Ferrari-Church and Carolyn Egelman: 30 goals, sentiment, and behavior

Measurement · IEEE Software column

  1. Measuring Developer Experience With a Longitudinal Survey (2024) — the EngSat program, running since 2018; survey practice
  2. Measuring Productivity: All Models Are Wrong But Some Are Useful (2025) — multiple outcomes, metrics, and methods instead of a single indicator
  3. What Makes a Good Productivity Metric? (2026) — designing an individual metric rather than prescribing a universal set

Work environments · IEEE Software column

  1. Hybrid Productivity (2023) — work during the pandemic; context limits generalization
  2. Build Latency, Predictability, and Developer Productivity (2023) — speed, expectations, and behavioral adaptation to faster builds
  3. Onboarding and Ramp-Up (2023) — onboarding as learning rather than the date of a first code submission
  4. Measuring Flow, Focus, and Friction for Developers (2023) — relating human experience to observable behavior

Quality and collaboration · IEEE Software column

  1. Software Quality (2024) — process, code, system, and product quality; a conceptual model
  2. Defining, Measuring, and Managing Technical Debt (2023) — perceived debt, limits of metrics, and organizational interventions
  3. Creativity in Software Engineering (2024) — a qualitative study of usefulness and clever reuse
  4. Software Development Is a Team Sport (2025) — observable collaboration ties and a survey measure of team functioning

The AI continuation · IEEE Software

  1. What Do Developers Want From AI? (2024) — developers’ needs as the starting point for design
  2. Understanding and Designing for Trust in AI Powered Developer Tooling (2024) — trust and the ability to customize interactions with AI
  3. Seamful AI for Creative Software Engineering (2025) — designing AI to leave room for reflection and creativity
  4. What Happens When Technical Debt Vanishes? (2026) — a thought experiment about improvements that need not lift every metric
  5. Technical Debt in the AI Era (2026) — a position paper and principles from the Technical Debt Manifesto
  6. Navigating the Tensions of AI in the Software Development Lifecycle (2026) — four tensions from developers’ open responses, not an estimate of universal speedup

Related research · InSession, 2020

  1. Enabling the Study of Software Development Behavior With Cross-Tool Logs (2020) — related work preceding the column: the InSession system and its validation

Alexander Polomodov’s reviews (in Russian)

  1. Book Cube · research map, part 1 — human-centered research, goals, surveys, quality, and debt
  2. Book Cube · research map, part 2 — builds, hybrid work, onboarding, focus, and creativity
  3. Medium · a human-centered approach — the author’s review of the initial framework
  4. Medium · developer goals — moving from tools to goals; the correct review link
  5. Medium · build latency — waiting, predictability, and delayed changes in habits
  6. Medium · hybrid work — pandemic context and differences in engineers’ experience
  7. Medium · developer onboarding — multiple ways to assess ramp-up
  8. Medium · flow and friction — why behavior must be related to experience
  9. Medium · longitudinal surveys — organizing EngSat and reporting back to participants
  10. Medium · four types of quality — connections to architecture and stakeholders’ differing expectations
  11. Medium · managing technical debt — human judgment and the limits of automated indicators
  12. Book Cube · creativity — usefulness and reuse
  13. Book Cube · productivity models — multiple outcomes, methods, and metrics
  14. Book Cube · four AI tensions — the September 16, 2026 review and annotated paper
  15. Book Cube · technical debt vanishing — the September 17, 2026 review of the thought experiment