According to the Nielsen Norman study of the return on investment for usability, demonstrate that the "usability" costs were between 8% and 13% of the projects' budget. Based on Origami customer research, 90% of respondents agree that user experience design phase in their intranet design has significantly improved project results. Even though the numbers point towards a growth in the amount of resources spent on user experience and design, there are still many organizations wondering how they can articulate the value to their project sponsors. In this post, I'll share what we measure to articulate the benefits of the usability design stage.
What Do We Measure to Calculate Intranet Design ROI?
The intranet design phase for Origami is typically 1 or 2 weeks worth of time depending on the size of the customer team. Most of the activities are pretty prescribed, so we have a reliable timeline of when things conclude.
Most commonly, the areas we design include:
Content Design (includes information architecture, and related technology features)
Branding and user experience
Processes, including SharePoint intranet governance and content authoring
Here are the most common questions we want to know after the process:
How did the participant find the intranet design process? (Very Satisfied ... Dissatisfied)
This probes for overall satisfaction and prepares them to think about details
Did the participant find they had strong influence during the design process? (Strongly Agree or Not)
This helps us understand if everyone felt heard.
It's especially important when participants join remotely or have different levels of experience. We don't want them to feel left out.
Has the functionality they expected at the beginning of the project been captured well in the final product?
This helps us understand how we managed participant expectations and if there were any surprises.
Does the new SharePoint intranet support them as content owners/contributors?
This helps us understand whether authoring and management roles have been accounted for in our design.
Does the new intranet support the needs of your department/team? (Strongly Agree or Not)
This puts participants in a mindset as representatives of their groups and helps us to understand how did we do overall in the eyes of their team (vendors, external contributors, contractors etc).
We also ask two open ended questions to get more anecdotal evidence:
What was your favorite part of the process?
What didn't go so well?
How Do We Calculate Intranet Design ROI?
We chose the combination of qualitative and quantitative methods to do this research. This allows to measure not only whether the process was helpful but exactly how we can improve the experience.
Sending an intranet design survey similar to below is usually the best way to get started. Be sure to include all of your workshop participants which would include your sponsor, content representatives, and other key stakeholders.
More participants these days are joining remotely and common design methods need to be constantly upgraded to cater to a hybrid group of participants.
We prefer to send our surveys anonymously.
Here is an example of a typical survey results we get. In this study we used Office 365 Forms and shared the link anonymously.
When to Measure SharePoint Intranet Design ROI
We send surveys right after the user experience intranet design phase has concluded.
This phase typically lasts between 3-6 workshop and design sessions. While some of the questions are future looking, we're interested in the impact the SharePoint intranet design phase had on the participants while it's fresh in their minds.
On average we get a 50-70% response rate if sent right after the intranet design sessions have concluded. The response rate drops off the longer you wait after the design process.
Articulating ROI of your intranet design is key to bringing attention to why the project was successful and taking into account feedback from your key stakeholders. By knowing what went well and how you can improve will help you prioritize the next steps in your intranet roadmap and help to ensure your new SharePoint intranet brings the most value to your organization.
We hope this helps in your upcoming intranet design strategies. Post your comments below!
Yaroslav Pentsarskyy is the Director of Product at Origami. He's also 8 time Microsoft MVP, speaker at many local and worldwide tech events, and a published author of several SharePoint related books.