今日推荐英文原文：《Why feedback, not metrics, is critical to DevOps》
（请检查，本文勾上了且只勾了《开源日报》这一个分类，请检查，有添加文章 Tag，请检查，有添加文章摘要，请检查，有添加特色图像，有添加bigger图片，有选中头图“布局设置”为占满屏幕的那张“第3张”） （请检查，预览时候，所有图片和文字显示正常，且勾上了百度熊掌号-原创提交） （请检查，本文的信息已经添加到 https://pm.openingsource.org/projects/daily/wiki日报摘要里，每个月的摘要信息单独发一个page，格式参照 https://openingsource.org/daily-index/2018-5/，标题，URL，正文等格式均需保持一致） （检查上述都完成之后，请删掉括号里的字，包括这一句，每天发布时间为早晨8点左右）
推荐理由：对于正在在微信公众号上发表文章的人来说用得上的工具——这个项目可以把 Markdown 转换成微信公众号中所使用的专用 HTML，只需要你写好 Markdown 然后丢进去，然后把输出丢进公众号里就行了，如果你需要自己改一改输出样式的话，也只需要打开源码自己改就行，这都取决于你。 介绍文章：https://mp.weixin.qq.com/s/pn0LzyfgUj6rGUfVHUksjg
今日推荐英文原文：《Why feedback, not metrics, is critical to DevOps》作者：Ranjith Varakantam
Why feedback, not metrics, is critical to DevOpsMost managers and agile coaches depend on metrics over feedback from their teams, users, and even customers. In fact, quite a few use feedback and metrics synonymously, where they present feedback from teams or customers as a bunch of numbers or a graphical representation of those numbers. This is not only unfortunate, but it can be misleading as it presents only part of the story and not the entire truth.
When it comes to two critical factors—how we manage or guide our teams and how we operate and influence the product that our teams are developing—few exceptional leaders and teams get it right. For one thing, it has become very easy to get your hands on data and metrics. Furthermore, it’s still hard to get real feedback from teams and users. It requires significant investments and energy, and unless everyone understands the critical need for it, getting and giving feedback tends to be a low priority and keeps getting pushed to the back burner.
How to manage and guide teamsWith the acceptance of agile, a lot of teams have put a ridiculously high value on metrics, such as velocity, burndown charts, cumulative flow diagram (CFD), etc., instead of the value delivered by the team in each iteration or deployment. The focus is on the delivery or output produced without a clear understanding of how this relates to personal performance or implications for the project, product, or service.
A few managers and agile coaches even abuse the true spirit of agile by misusing metrics to chastise or even penalize their teams. Instead of creating an environment of empowerment, they are slipping back into the command-and-control method where metrics are used to bully teams into submission.
In our group, the best managers have weekly one-on-one meetings with every team member. These meetings not only give them a real pulse on team morale but also a profound understanding of the project and the decisions being made to move it forward. This weekly feedback loop also helps the team members communicate technical, functional, and even personal issues better. As a result, the team is much more cohesive in understanding the overall project needs and able to make decisions promptly.
These leaders also skip levels—reaching out to team members two or three levels below them—and have frequent conversations with other group members who interact with their teams on a regular basis. These actions give the managers a holistic picture, which they couldn’t get if they relied on feedback from one manager or lead, and help them identify any blind spots the leads and managers may have.
These one-on-one meetings effectively transform a manager into a coach who has a close understanding of every team member. Like a good coach, these managers both give and receive feedback from the team members regarding the product, decision-making transparency, places where the team feels management is lagging, and areas that are being ignored. This empowers the teams by giving them a voice, not once in a while in an annual meeting or an annual survey, but every week. This is the level where DevOps teams should be in order to deliver their commitments successfully.
This demands significant investments of time and energy, but the results more than justify it. The alternative is to rely on metrics and annual reviews and surveys, which has failed miserably. Unless we begin valuing feedback over metrics, we will keep seeing the metrics we want to see but failed projects and miserable team morale.
Influencing projects and product developmentWe see similar behavior on the project or product side, with too few conversations with the users and developers and too much focus on metrics. Let’s take the example of a piece of software that was released to the community or market, and the primary success metric is the number of downloads or installs. This can be deceiving for several reasons:
- This product was packaged into another piece of software that users installed; even though the users are not even aware of your product’s existence or purpose, it is still counted as a win and something the user needs.
The marketing team spent a huge budget promoting the product—and even offered an incentive to developers to download it. The incentive drives the downloads, not user need or desire, but the metric is still considered a measure of success.
Software updates are counted as downloads, even when they are involuntary updates pushed rather than initiated by the user. This keeps bumping up the number, even though the user might have used it once, a year ago, for a specific task.
In these cases, the user automatically becomes a metric that’s used to report how well the product is doing, just based on the fact it was downloaded and it’s accepting updates, regardless of whether the user likes or uses the software. Instead, we should be focusing on actual usage of the product and the feedback these users have to offer us, rather than stopping short at the download numbers.
The same holds true for SaaS products—instead of counting the number of signups, we should look at how often users use the product or service. Signups by themselves have little meaning, especially to the DevOps team where the focus is on getting constant feedback and striving for continuous improvements.
Gathering feedbackSo, why do we rely on metrics so much? My guess is they are easy to collect, and the marketing team is more interested in getting the product into the users’ hands than evaluating how it is fairing. Unless the engineering team invests quite a bit of time in collecting feedback with tracing, which captures how often the program is executed and which components are used most often, it can be difficult to collect feedback.
A big advantage of working in an open source community is that we first release the piece of software into a community where we can get feedback. Most open source enthusiasts take the time to log issues and bugs based on their experience with the product. If we can supplement this data with tracing, the team has an accurate record of how the product is used.
Open as many channels of communication as possible–chat, email, Twitter, etc.—and allow users to choose their feedback channel.
A few DevOps teams have integrated blue-green deployments, A/B testing, and canary releases to shorten the feedback loop. Setting up these frameworks it is not a trivial matter and calls for a huge upfront investment and constant updates to make them seamlessly work. But once everything is set up and data begins to flow, the team can act upon real feedback based on real user interactions with every new bit of software released.
Most agile practitioners and lean movement activists push for a build-deploy-measure-learn cycle, and for this to happen, we need to collect feedback in addition to metrics. It might seem expensive and time consuming in the short term, but in the long run, it is a foolproof way of learning.
Proof that feedback pays offWhether it pertains to people or projects, it pays to rely on first-hand feedback rather than metrics, which are seldom interpreted in impartial ways. We have ample proof of this in other industries, where companies such as Zappos and the Virgin Group have done wonders for their business simply by listening to their customers. There is no reason we cannot follow suit, especially those of us working in open source communities.
Feedback is the only effective way we can uncover our blind spots. Metrics are not of much help in this regard, as we can’t find out what’s wrong when we are dealing with unknowns. Blind spots can create serious gaps between reality and what we think we know. Feedback not only encourages continuous improvement, whether it’s on a personal or a product level, but the simple act of listening and acting on it increases trust and loyalty.