I just got back from the DevOps Enterprise Summit last night. This was the 2nd annual installation of the conference and it was three solid days of great content. My colleague, Dominica DeGrandis, was there last year and was on the organizing committee for the conference and she promised me this would be great. This was my first attendance at a DevOps specific conference so I wasn’t sure what to expect.
There were notable big names there like Jez Humble and Gene Kim. But, I found it refreshing that, in large part, the plenary sessions were comprised of people in the trenches telling stories about their company’s journey to improving quality and time to market by using DevOps principles. There were great presentations from Nordstrom (here in Seattle!), Target, Netflix, Ticketmaster, USPTO and many more. Instead of spoiling the surprise to be had from viewing the upcoming presentation videos, I wanted to share some of my overarching thoughts I had while attending the conference.
On the state of DevOps Findings
In the opening remarks, Gene Kim shared the stats shown above in the 2015 Puppet Labs State of Devops Findings. It looks like things have improved dramatically for those implementing a DevOps mindset. But, I found it interesting that, as a community, we have improved activities like deployment frequency and lead time, change success rate, and MTTR at ranges of 30x to 200x, but the likelihood of achieving organizational performance goals only doubled. Going forward do we need to continue to focus on these same metrics or have we reached a point where we need to start measuring things that will help us with our next big issues? We need to make sure we are always focused on the things that help us move the needle that really matters. After a point, cramming more deployments in per hour won’t help us achieve our goals. Do we know what is keeping us from making the measure for likelihood of achieving organizational performance goals a 2x, 4x or 8x?
Its all about learning through fast feedback loops
Largely, the stories being shared as successes had a common theme: understanding the value of being a learning organization… growth mindsets over fixed mindsets. Companies, like Nordstrom, that are moving away from telling people solutions to helping them see how to solve their own problems are winning.
Also, it was stressed that while learning is huge, being able to do it quickly with small chunks of input has shown amazing returns at companies who have tried it. If you wait too long to give feedback it can be too late. One of my favorite quotes from the conference is “Don’t beat people up for things they don’t remember doing.”
People are craving helpful metrics
Many of the metrics talks, including the one Troy Magennis and I gave, had a packed room with more than a few people sitting on the floor and standing by the doors. We talked about how to use (or not to use) metrics to help teams achieve their goals.
Specifically, Troy spoke about different types of business analytics to give people a baseline set of info. I encouraged people to avoid some costly anti-patterns like using vanity metrics, measuring individuals and creating wobbly businesses by having unbalanced metrics. Troy wrapped it up by helping people understand its ok to make trade-offs with your set of metrics and to monitor trends instead of getting hung up on too many individual data points (without succumbing to any flaws of averages of course). Our final point was to make your visualizations visually enticing to encourage smart people to go deeper and look for root causes.
After that talk, I noticed that other talks on metrics, like the one from Mark Michaelis, had similar advice and also took the stance of “we can’t tell you what to measure, you have to decide that in your own context” but we’ll help you avoid these pitfalls. People really heard the message and had lots of questions about identifying and weeding out the vanity metrics in their organizations. They were also asking for advice on how to convince their executives and leadership that certain metrics really weren’t as valuable as they thought.
Appropriate wielding of metrics is going to be a hot topic for the forseeable future.
Lean, Kanban and DevOps are complementary
I believe that using Kanban can help create the time to do the improvements needed for a devops transformation by controlling WIP and creating slack. I was happy to see that companies were starting to show how Lean, Kanban and Kata were helping in their DevOps transformations. As a Kanban coach, my peer group needs to draw more parallels between these and make adopting DevOps mindsets easier in large organizations. Two large companies, Chef and Nordstrom, have already begun bridging the mental gap and made it a huge theme in their presentations:
- Nicole Forsgren from Chef on How Continuous Delivery and Lean Management Make your DevOps Amazeballs
- Courtney Kissler and Jason Josephy from Nordstrom on Mindsets, metrics and mainframes… oh my!
— Peter Spung (@paspung) October 19, 2015
Dependencies are the next big thing
Dominica DeGrandis explained how each dependency cuts our probability of finishing on time in half. So, a huge question that resulted from discussions around this topic was “How do you visualize and manage your dependencies?” Basically, now that we know this, what do we do about it? This is one of the things we need to focus on in the future as it is so crucial to our business success.
Would I recommend this conference?
I watched the attendees at this conference become more energized by each passing day. They felt community by finding others with their same issues and needs. They heard stories of people that were farther on their journey and were able to pick up tips to help themselves. They heard stories of people who were just starting and whom they could help. But, by far and away, I saw in people’s eyes the same excitement or awe that I experienced when I went to LSSC12 in Boston. It was then I knew that for many people this was their seminal conference and would set the tone for return visits year over year. If you are interested in the DevOps mindset, definitely check out DevOps Enterprise Summit 2016!