Over the last four years as a Product Manager and Founder, I’ve been faced with questions such as: What makes product teams successful? What processes do we need to put in place to ensure that we build a good product? And how can we measure the quality and performance of our product management team? The most obvious answer is:
Great product teams build great products.
In this article, I attempt to dissect this truism and tackle the question of what it takes to build a good product. The result is an actionable checklist you can use to assess the health of your product organisation.
The checklist for assessing your product org
Vision: Have you articulated a clear product vision?
Strategy: Have you defined a competitive product strategy?
Customer interaction: Are product managers (and engineers) speaking to your customers regularly?
Authority: Do the people working on the customer and product discovery have the authority to influence your strategy?
Focus & Alignment: Have you established effective and transparent prioritization mechanisms?
Roadmap: Do you have a roadmap that prioritizes the most important business items?
Ownership: Does the product team own business outcomes (not just output)?
Outcome: Have you defined what success means for your product?
Analytics: Are you measuring the success of your product?
Progress & Traction: Do you have the processes in place to continuously transmit progress and the traction of your products to the rest of the organisation?
Delivery: Can you ship the thing you intended to ship, in the timeframe that you had planned?
Customer feedback: Do you have a process in place to continuously transmit customer feedback to the product team?
Let’s dive deeper into each question, discuss why they are important and explore actions and examples that how product managers and leaders can implement in each dimension.
For context: At store2be, we’re building a platform where brands and live marketing agencies can book promotional spaces in physical locations such as shopping malls, train stations, airports, public spaces and more. Our platform team consists of seven engineers, two product managers, a product designer, CTO and CPO.
1. Articulate a clear product vision
“The product vision describes the future we are trying to create, typically somewhere between 2 and 5 years out.”
Marty Cagan · Vision vs. Strategy
Why is a product vision important?
Articulating a clear product vision is the foundation for where your company is headed and provides long-term guidance of what the company wants to achieve. It serves as a North Star for the team. It’s very difficult to prioritize initiatives if a common understanding of where you want to be is not shared among the team.
At the same time, I would encourage Product Managers to leave some flexibility and space to iterate on your product vision during the early product stages to incorporate customer and market insights. When we started out, our vision was to build the “Airbnb for retail space”. The v1 of our platform turned out to be a slightly altered version of Airbnb rather than a platform that solved a market need.
How can I create my own product vision statement?
Geoffrey Moore’s Product Vision Statement is a good framework to start with. It brings together for whom the product exists, the problem/opportunity, the core benefit, and the differentiating features in a concise format. Alternatively, the Lean Canvas is a more comprehensive and established business modelling tool that can help you outline your vision.
Examples
Great vision statements focus on the user needs and long-term perspective.
Stripe is a technology company that builds economic infrastructure for the internet. Businesses of every size — from new startups to public companies — use our software to accept payments and manage their businesses online.
Netflix: Becoming the best global entertainment distribution service. Licensing entertainment content around the world. Creating markets that are accessible to filmmakers. Helping content creators around the world to find a global audience.
store2be: Our mission is to enable brands to interact with people in the real world. We are building a global platform where brands can book scalable, targeted and measurable Live Marketing campaigns.
2. Define your product strategy
Why is it important to have a good product strategy?
“A bad plan is better than no plan.” — Peter Thiel
A strategy defines how you set yourself apart from your competitors. A good strategy and reliable execution can be a key differentiator for your business. With regards to team alignment, it also connects the dots between where you want to go and where you are.
How can I put a good product strategy in place?
Marty Cagan defines product strategy as “our sequence of products we plan to deliver on the path to realizing the vision.” Product strategy is sometimes used synonymously with the roadmap, but there’s more to it. While the question of how to define a product strategy and existing strategy frameworks deserve a piece on its own, a good strategy covers at least the following aspects:
Target customer(s)
Customer needs and Jobs-To-Be-Done
Key differentiators / Positioning against competing solutions
How you are going to build your key differentiators
Pricing and Business Model
The order in which you build solutions (‘features’) to perform those jobs for each specific customer segment
Addressing those items will shine light on which items you already cover and where you might need more research. At a very early stage, your strategy should at least outline “what hypothesis do we need to prove first, second, third? And what are pre-requisites to achieve that?”. Asking those questions forces you to come up with a reasonable approach to deliver on your value proposition. If you are building a marketplace for example, your strategy should address solving the chicken-and-egg problem. At a later stage, your strategy might be more focused on how you monetise your product.
Communicating your strategy
Communicating (changes to) your strategy regularly and aligning all departments around it is as important as defining one. You have a clear strategy in place only once every team member has understood it and is able to define their objectives based on it. As a test, ask your entire team the question ”Can you say what our strategy is?“
Example: The strategy of store2be
At store2be, we decided to pursue a three-step strategy to establish a platform for Live Marketing campaigns. Each stage addressed certain needs we observed in the existing marketplace, aimed to solve the chicken-and-egg problem.
Build a SaaS tool for retailers: At first, we built and sold administration software to retail space operators to digitise their assets (spaces). This helped us acquire inventory for our marketplace.
Provide brands with offline marketing analytics: During the second phase, we built an analytics solution for advertisers to measure the performance of Live Marketing campaigns. We differentiated our services for advertisers from existing space brokers and location owners.
Build and scale a booking platform: With the underlying software infrastructure in place and a key differentiator for the demand-side of the market, we are now establishing a SaaS-enabled marketplace for booking retail spaces.
3. Speak to customers regularly
Why is regular customer interaction important?
Good Product Teams develop a deep understanding of their customer and their needs. They do so primarily through regular, direct customer interaction, effective research methodologies, and data analysis. ‘Direct’ is key here because communication through other parties, such as sales and customer support, can be filtered or biased. ‘Regular’ is important because your product changes, your customer segments change and you risk relying too much on information gathered in the past.
How can I establish regular customer interaction?
Marty Cagan recommends a minimum of three 1-hour customer interactions each week ongoing.
Ask yourself: How often are you and your team speaking directly to customers?
Define your desired cadence and add it to your checklist
Get on the phone and call your (potential) customers. From my experience, the majority of people love talking about their work and the problems they encounter.
Involve engineers and other stakeholders regularly in customer interviews and user tests. It’s an opportunity to reduce communication/alignment overhead and create a missionary spirit for solving customer problems.
Customer obsession
“Good product teams are customer obsessed.”
Good Product Team/Bad Product Team · Justin Bauer
I personally like the term customer obsession used by Amplitude’s VP of Product Justin Bauer. Customer obsession is difficult to measure, but a good start is to anchor the customer needs in your vision and objectives. You can also observe customer obsession: How excited is the team about interacting with customers? How attentive are they to customer problems? How does the team react to customers getting stuck in the product? Product Managers play a key role in establishing this mindset in a company.
4. Give people working on product discovery the authority to influence strategy
Why is this important?
Inspired by the book Product Leadership, this question addresses any potential disconnect between company management and your product discovery and delivery teams. In an era where the best companies have shown the potential of autonomous, objective-driven teams rather than hierarchies where feature roadmaps and deadlines are handed top-down by management, it’s vital that those doing the customer research have the authority to influence the strategy.
How can I establish this?
Ideally, strategizing is an ongoing, joint effort between product teams and management. The strategy should primarily be driven by the teams generating market and customer insights rather than based on assumptions made by management in brainstorming meetings. Don’t miss out on the opportunity to empower cross-functional teams to strategize and plan on their own, then incorporate this in the company strategy.
Example: Authority of Product Managers at store2be
At store2be, we are moving towards a culture where Product Managers have full ownership over the product strategy within their respective fields. It is the PMs who primarily drive the roadmap and align it directly with executives and other stakeholders. They seek to understand and incorporate the perspectives of other functions. This has the added benefit of Product Managers becoming more authoritative figures in the company.
5. Establish an effective and transparent prioritization mechanism
Why is this important?
A clear prioritization mechanism removes opinionated discussions and enables effective roadmapping. It also enables product teams to maintain focus on building a ‘deep product’, as they can confidently reject ideas and initiatives that do not fit the current strategic focus.
How can I establish this? Examples of prioritization techniques
As a novice or seasoned Product Manager, you’ve probably studied some or all of the following techniques:
Value vs. Complexity
RICE
Kano Model
MoSCoW
Weighted Scoring
…
After trying several of these mechanisms I noticed they can all be effective depending on your situation, however they do not incorporate the strategic objectives very well. If you prioritise 200 backlog items, you risk ending up with a bunch of disconnected themes across your product portfolio that all seem important. I would therefore prioritise by strategic themes first and then apply one of the prioritisation techniques above.
Strategic focus over backlog prioritisation
While it’s essential to consider cost and opportunity when prioritising, I would argue that having a clear objective- and theme-based prioritisation is even more important than a ‘low-level’ mechanism such as weighted feature scoring. Theme-based prioritisation can happen through Story Mapping, based on Customer Jobs-To-Be-Done or a specific North Star Metric. Set the strategic theme, and if necessary you can then sort and rank stories according to one of the ‘classical’ mechanisms into these themes. As a side benefit, this cuts hours of guesstimation work on stories that don’t align with your strategy in the first place and frees up time to properly validate a few core opportunities before building them.
6. Create a roadmap that prioritises the most important business items
Why do I need a roadmap?
The first purpose is because the management of the company wants to make sure that the teams are working on the highest business value items first.
The second purpose is because since they’re trying to run a business, there are cases where they actually need to make date-based commitments, and the roadmap is where they see and track those commitments.
The Alternative to Roadmaps · Marty Cagan
This statement resonated with me because:
A roadmap serves as a forcing function for prioritisation.
It creates strategic alignment in the company.
It provides planning ground for the other teams.
It’s a great communication tool.
We’ve always had to balance our product roadmap with external deadlines, for example when onboarding strategically relevant suppliers into our platform.
How should I build my roadmap?
Roadmap formats are a heavily discussed topic in Product Management. In principle, the product roadmap should define actionable, shared, high-level goals for the product team. Those goals should describe desired outcomes rather than outputs (= features). An effective method for this is to prioritise the most important customer needs and business outcomes and giving the product team full authority and accountability from there. It is the Product Team’s job to discover a roadmap that can deliver on these targets.
Based on their discovery and validation work, this allows product teams to come up with an effective, more short-term roadmap of initiatives. Finally, ensure that your roadmap is up-to-date and visible to the entire team (and possibly your customers) to serve as a central reference for the entire company.
While there is a lot of discussion around roadmaps, I still believe that they are one of the most important communication tools that can establish a shared understanding of what the roadmap contains and means for your company.
7. Establish ownership for business outcomes (not just output) in the product team
Why is this important?
This question addresses the desirability of autonomy, authority, and accountability of a product team. When Product Management teams are ‘handed down’ a feature-based roadmap, they are forced to take on the role of project and delivery managers, which undermines the potential of more autonomously product squads.
How can I establish ownership for business outcomes?
In the spirit of ‘modern product management’, product teams should be responsible for business outcomes and able to move freely within the opportunity and solution space. The below illustration of a Continuous Discovery by Teresa Torres illustrates the ‘negotiation space’ between Product Leader and Product Team. At an early stage, outcomes might be negotiated in shorter intervals. A quarterly rhythm might also align well with company-wide OKRs and is a good time horizon to reflect on the previous quarter’s hypothesis and experiments.
Example
8. Define what success means for your product
Why is this important?
The most obvious answer is that great product teams build great products. But if you can’t measure it, you can’t improve it. You need a definition of what success means at each stage of your product.
Success of your product is where user value and business objectives come together. Let’s express this in the form of two question sets:
What does success of your product mean from a user POV? What desired result should the product enable the user to achieve? For Superhuman, for example, success might mean staying on top of my emails, improving my response times, having ease of mind or similar.
How is product success reflected in your business objectives? Increase Revenue, sign up rates, transaction frequency, matching quality?
User success > business success
It’s common for Product Teams to primarily measure their success in terms of business metrics, rather than user success. I’ve made this mistake many times. I believe it happens because every single driver tree of a business metric, such as revenue or profit, will naturally result in objectives that aim to move the underlying metrics. This can create wrong incentives for product teams that don’t focus on the user problem, lead to bad UI/UX and delay the process of reaching product/market fit.
Resist the pressure to optimise conversion rates and financials KPIs at the cost of UX and the opportunity cost of creating user value, especially before you have reached product-market fit.
A good product solves a user problem in a way no competing solution does. When you’re setting out to solve a user problem, anchoring customer success in your core metrics is a good start to get you there. Most of the products I like to use put the user experience first. If you look at the products most popular with end-users — Asana, Superhuman, Slack, Figma — they have all spent years creating a product users value before optimising for their business metrics.
How can I implement this?
Being clear on what jobs your users are supposed to be able to do with your product is an important first step. Once this is done, you might ask your users how satisfied they are with your solution in performing a given Job-To-Be-Done. How do you benchmark against competitive alternatives?
In a recent conversation with a friend and early-stage founder working on a software tool for business customers, I asked how they prioritise their product initiatives. He explained to me that they are optimising for “user flow” — meaning how long the users can engage with the product as part of their specific workflow, completing their job at hand, without having to switch the tool. Similar to working front to back through a customer journey, this gives the team a clear focus. I think this approach of optimising for ‘User Flow’ is a great way of putting the user first, which eventually maximises the value of the product and the business.
9. Implement processes to measure the success of your product
TL;DR
Keep your analytics setup lean and focused on your core metrics
Include qualitative insights and don’t limit yourself to quantitative metrics
Differentiate between usage and performance/satisfaction of your product
Segment your users to understand product/user segment fit
Examples · Choose your metrics
In reality, product teams need to balance a set of qualitative and quantitative objectives of your product, both on the user and the business side. Some examples:
User surveys: Product/market fit score, NPS, Jobs-To-Be-Done satisfaction*, qualitative customer feedback
Product metrics: Signup rates, conversion rates, usage frequency, retention, transaction frequency, revenue
*For example, you may ask users “how satisfied are you with the way you can do X with solution Y?” on a Likert Scale.
Set up lean analytics
When I launched my first websites, I would usually just plug in Google Analytics to have any kind of analytics setup. It’s ok to start tracking some basic visitors metrics as you might need the data later. However you very quickly want to implement an event-based analytics tool.
Avoid focusing on vanity metrics. Don’t overrate no. of website visitors and signup conversions in the beginning as it might distract you. Chose a core set of metrics that measure what you defined as success of your product. Ideally, focus on usage and retention metrics for a key user segment. Then add monitoring for a bunch of additional metrics that you want to have on your radar. There are heaps of great analytics tools, such as Mixpanel, Amplitude, Hotjar, etc.
Include qualitative insights
Another mistake I’ve made in the past is to force a quantitative measure upon ourselves before even acquiring the first recurring user. A conversion rate might not be relevant if you have a small user base of B2B customers. Focusing on quality first will help you build a great product first before optimising conversion funnels. No product metric can replace the insights you will get from speaking to 20 users. Incorporate qualitative feedback into your regular reporting.
If the user base is too broad to give you a clear view, segmenting into cohorts might help you as well. We spoke about product strategy being a set of features we build for a certain target group — maintain focus on this target group.
10. Continuously transmit your progress and the traction of your products to the organisation
Why is this important?
Teams need to have the processes in place to continuously transmit their progress and the traction of their products to the organisation.
Whether it’s reporting the metrics of a live product, the status of one in development, or the insights from user testing — a lightweight way to project the status of metrics the company cares about, available to anyone who wants to see them, creates a virtuous cycle in a product group.
7 heuristics for being a product director · Brandon Chu
From my experience I can agree that the output of the team and the outcome the product needs to be visible and communicated regularly to everyone in the company, not least in order to establish trust in the product team and demonstrate your progress. As Product Managers, we might understand how much leverage this type of communication can have. We sometimes expect everyone to know exactly what we are working on and why, but this is rarely the case. It’s our job to make sure the information reaches everyone else.
How can I implement this?
Over the years, I’ve found the following mechanisms effective in transmitting progress to the organisation:
Product Newsletter: In the beginning, we would write a monthly newsletter to the entire team describing new features and what is planned next. In hindsight, our communication focused too much on features back then.
Product Crunch: A bimonthly all-hands meeting with a recap of the product strategy, a demo of new features, usage metrics and things we’d work on next.
User-focused Release Notes: Our Product Managers now write release notes with screencasts demoing new functionality in our platform. Our sales team, for example, gets informed about updates and onboarded into the product at the same time. Make sure those notes convey the user value, not only the technical details.
KPI Dashboards: Anchor the most relevant product metrics in our OKRs and make them visible to the team.
11. Establish a development workflow to ship the thing you intended to ship in the planned timeframe
Why is this important?
This question addresses the health of your delivery process. Good product teams ship in regular intervals.
How can I establish this? (Indicators of a healthy delivery process)
Good product development teams release regularly and develop a good sense of what work they can get done within a development cycle. I therefore suggest looking at two factors to measure your ‘delivery pulse’:
Release cycle
Ability to produce desired results within the release cycle
Note this is not about estimating the number of hours for each specific task. It is about managing focus, optionality, and constraints within a development cycle correctly to make sure the core functionality makes it to the user in the intended time frame.
Example: A new product development workflow
Our Platform Team almost doubled in 2018, and we didn’t adjust our ‘Scrumban’ way of working. Development slowed down. Large epics would drag on sprint after sprint. We weren’t able to predict when things would be done. Epics suddenly took months to make it into production.
At the beginning of 2019, we adopted the core principles of Basecamp’s ShapeUp product development methodology. Our Product Manager David, who spearheaded this change, has written this great article on our implementation of ShapeUp, its benefits and things we’re still figuring out. You can also listen to this Changelog Podcast with Basecamp’s Head of Strategy Ryan on Basecamp’s approach to product development.
12. Put processes in place to continuously transmit customer feedback to the product team
Why is this important?
Beyond product analytics and customer research conducted by the product team, there are plenty of other channels that generate valuable customer insights: marketing, sales, customer support. It can be helpful to establish a mechanism and mindset to ensure this feedback reaches the Product Team.
How can I establish this?
Reduce the friction to forward feedback. Make sure there’s an easy tool where everyone can leave their feedback asynchronously. Measure the feedback pulse and celebrate when you receive feedback to create a positive reinforcement loop.
Be a broken record about it. Make sure everyone knows the importance of customer feedback as a driver for product success.
Establish trust. I feel like the effort other teams put into forwarding and summarising customer feedback to Product Managers is a measure of their trust towards the Product Team to make use of it effectively.
Conclusion
Scope
While I believe many of the items and techniques can be applied to Product Teams in general, my personal experiences come from an early-stage SaaS and platform product. I’m eager to hear your thoughts on what an assessment might look like for different company sizes and product stages.
How to use this
Simply start out by doing this assessment together with your team. Create a survey and ask your team: In which areas are we strong? Where do we see gaps? Spark a discussion and see what improvements you come up with to create a stronger product culture I set up a recurring health check to reflect on some of these questions regularly with the team. And be sure to include other teams, they might uncover some blindspots for you.
Diving deeper into individual topics
Each of these questions probably deserves more than one dedicated article on their own and I am planning to expand on some of these topics in the future. I’m also thinking of transforming this into an assessment spreadsheet, divided into categories such as vision & strategy, defining and measuring product success, delivery, communication, etc.
Share your thoughts
I hope the questions and suggestions were valuable to you in assessing and strengthening your product organisation. There are probably several more items that could be added to such a checklist. Some of the items on the list might not be applicable to you. Either way, I’d be curious to hear your thoughts, get feedback and learn how other product managers and leaders are assessing and improving their product orgs! Join the discussion below 👇