{"id":9071,"date":"2017-06-09T15:43:07","date_gmt":"2017-06-09T20:43:07","guid":{"rendered":"https:\/\/www.invespcro.com\/blog\/?p=9071"},"modified":"2026-08-18T11:45:09","modified_gmt":"2026-08-18T11:45:09","slug":"7-methods-to-uncover-problems-on-your-website","status":"publish","type":"post","link":"https:\/\/www.invespcro.com\/blog\/7-methods-to-uncover-problems-on-your-website\/","title":{"rendered":"Usability Problems &#8211; 7 Methods to Uncover Usability Issues on Your Website"},"content":{"rendered":"<span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\"> 16<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"9071\" class=\"elementor elementor-9071\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-d03df3f elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"d03df3f\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-5bb816c3\" data-id=\"5bb816c3\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-58ac7759 elementor-widget elementor-widget-text-editor\" data-id=\"58ac7759\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><strong>There is no such thing as a perfect website. <\/strong><\/p><p><strong>No designer, developer, or marketer can spot the full range of problems on a website alone.<\/strong><\/p><p>Why? One direct reason is that only real users can identify some of these problems.<\/p><p>The market today is a fierce battlefield, as everyone is striving to deliver the best they can to their users. At the front lines, marketers need techniques to better understand website visitors and customers.<\/p><p>There are many articles that tackle <a href=\"https:\/\/www.invespcro.com\/blog\/usability-testing\/\">usability testing<\/a> and its benefits. But most of these articles treat usability as a broad, theoretical term. Most fail to suggest concrete steps for detecting usability problems and propose potential solutions.<\/p><p>One of the very first steps when implementing the <a href=\"https:\/\/www.invespcro.com\/cro\/process\/\">12-step conversion optimization system<\/a> to increase a <a href=\"https:\/\/www.invespcro.com\/cro\/conversion-rate-by-industry\/\">website&#8217;s conversion rate<\/a> is to conduct a website assessment. This article will provide 7 concrete techniques used by UX and CRO experts to uncover problems on your website.<br \/><img fetchpriority=\"high\" decoding=\"async\" class=\"aligncenter size-full wp-image-9079\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/uncover-website-problems.png\" alt=\"\" width=\"680\" height=\"350\" \/><\/p><h2>1. The Guerrilla Testing -In Person Usability Testing<\/h2><p><strong>Some VPs of marketing and CMOs fail to understand that guerrilla testing can occur throughout the entire life cycle of a website. <\/strong><\/p><p>The term usability, <a href=\"https:\/\/www.nngroup.com\/articles\/usability-101-introduction-to-usability\/\">according to Nielsen<\/a>, refers to the quality attribute that assesses how easy an interface is to use for both novices and experts.\u00a0<span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">Ease of use\u00a0<strong>has been<\/strong><\/span><strong>\u00a0a goal for designers, developers, and marketers all along. \u00a0<\/strong><\/p><p>These usability tests are usually described as laboratory-based studies in which users perform tasks in a setting similar to their environment, while observers take notes.<\/p><p>With more than <a href=\"https:\/\/measuringu.com\/ux-methods-2016\/\">80%<\/a> of subject matter experts using it as their first and primary resort for problem detection, guerrilla testing is one of the most commonly used methods for improving user experience, as shown in the graph below.<br \/><img decoding=\"async\" class=\"aligncenter size-full wp-image-9082\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/most-used-UX-methods.png\" alt=\"\" width=\"600\" height=\"352\" \/><\/p><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/measuringu.com\/ux-methods-2016\/\">measuringu<\/a><\/p><h3 style=\"text-align: left;\">How to Conduct a Usability Test?<\/h3><p>Our detailed guide on conducting <a href=\"https:\/\/www.invespcro.com\/blog\/guide-to-conducting-qualitative-usability-studies\/\">usability testing<\/a> breaks the process into 3 stages:<\/p><ul><li>Step1: Planning the Test<ul><li style=\"text-align: left;\">Identify the Goal of the Research<\/li><li style=\"text-align: left;\">Select the Research Method<\/li><li style=\"text-align: left;\">Design Your Research Questions<\/li><li style=\"text-align: left;\">Recruit Participants<\/li><\/ul><\/li><li style=\"text-align: left;\">Step 2: Conducting Your Research<\/li><li>Step 3: Analyzing Research Results<ul><li style=\"text-align: left;\">Transcribing Your Data<\/li><li style=\"text-align: left;\">Data Mining: Looking for Insights<\/li><li style=\"text-align: left;\">Defining Themes &amp; Looking for Patterns<\/li><\/ul><\/li><\/ul><h3 style=\"text-align: left;\">The Usability Testing in Action<\/h3><p><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">Let\u2019s take a look at this\u00a0<a href=\"https:\/\/www.theseus.fi\/bitstream\/handle\/10024\/119628\/Pokki_Sini.pdf?sequence=1\" target=\"_blank\" rel=\"noopener\">case study<\/a>\u00a0of a\u00a0<a href=\"https:\/\/www.invespcro.com\/blog\/usability-testing-on-a-budget\/\" target=\"_blank\" rel=\"noopener\">usability test for an e-commerce website<\/a>, in which three users were recruited to complete tasks using the existing web services.<\/span><\/p><p>The main objective of this testing was to identify pain points users experienced while browsing the website under its current design and to determine whether users could navigate it easily, regardless of what they were looking for.<\/p><p><strong>Scenario and Tasks: <\/strong><\/p><p>Tasks were presented in a contextual scenario for users to complete, as the one below:<\/p><p>Christmas is coming, and you want to buy presents for your family. Your mother has always wanted a rose-gold <a href=\"https:\/\/www.michaelkors.com\/watches\/women\/_\/N-28c5\">Michael Kors watch<\/a>, so you want to buy it for her.<\/p><p>The aim of using a scenario was to keep the tasks between users as coherent as possible, so the results could be compared efficiently in the analysis.<\/p><p><strong>Tasks: <\/strong><\/p><p>1. Browse and find a Michael Kors watch in rose gold and its details, such as price, warranty, and the material used for production.<\/p><p>2. Add the product to the cart and proceed to checkout.<\/p><p>3. Find the information on the company\u2019s policies, including its delivery and return practices.<\/p><p><img decoding=\"async\" class=\"aligncenter size-full wp-image-9080\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/case-study-guerilla-testing.png\" alt=\"\" width=\"603\" height=\"404\" \/><\/p><p><strong>Execution and Observation: <\/strong><\/p><p>First, participants were asked to browse the website to find the \u201cMichael Kors watch in rose gold.\u201d When asked to find\u00a0<span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">a specific product using the navigation<strong>, two of the three participants couldn&#8217;t locate it right away<\/strong> and began to question whether that option existed\u00a0<\/span>at all.<\/p><p>Regarding the second task, the participants had no trouble adding the product to the cart and completing checkout.<\/p><p>For the third task, all participants in the usability study had difficulty finding information about the website&#8217;s delivery and return policies.<\/p><h3>Advantages of Usability Testing<\/h3><ul><li><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">Help you identify and uncover problems, as\u00a0<a href=\"https:\/\/www.invespcro.com\/blog\/user-testing\/\" target=\"_blank\" rel=\"noopener\">user testing<\/a> can clarify any issues you noticed during analysis of analytics data or heatmaps\/video recordings.<\/span><\/li><li>Test the validity of a certain feature on a page or on a site.<\/li><li>Uncover unexpected problems within your website that you may not have picked up on earlier.<\/li><li>Help you inform the design process.<\/li><li>Quick and easy to conduct, and it doesn\u2019t require much effort.<\/li><\/ul><h3>Disadvantages of Usability Testing<\/h3><ul><li><strong>Data contamination:<\/strong> it\u2019s a bit scripted and controlled, so, of course, that contaminates the data to a certain extent.<\/li><li><strong>Subjectivity:<\/strong> The person conducting the user test may make prompts or suggestions that can affect the test&#8217;s validity and further compromise it.<\/li><li><strong>Users&#8217; awareness of the test:<\/strong> because it isn\u2019t a normal online experience but rather a test, users skew their behaviors.<\/li><\/ul><h2>2. Heuristic Evaluation: Critique Expertise and Feedback<\/h2><p><a href=\"https:\/\/www.invespcro.com\/blog\/heuristic-evaluation-your-complete-guide\/\">Heuristic evaluation<\/a> relies on subject matter experts (SMEs) to predict interface problems (website\/mobile\/mobile app) and rate them. It\u2019s still one of the most widely used methods among experts.<\/p><p>Different <a href=\"https:\/\/www.invespcro.com\/blog\/questions-to-ask-before-hiring-a-cro-agency\/\">CRO companies<\/a> approach heuristic evaluation in different ways. But all heuristics are rooted in the same principles.<\/p><p>At Invesp, we combine <a href=\"https:\/\/www.invespcro.com\/blog\/the-conversion-framework\/\">the conversion framework<\/a>, a form of qualitative data, with our heuristic evaluation process to ensure we cover as many problems as possible.<\/p><p><a href=\"https:\/\/www.nngroup.com\/articles\/ten-usability-heuristics\/\">Nielsen uses<\/a> 10 basic heuristics as broad rules that cover many possible user interface problems. You can work your way around these rules by adding anything that works for your website, as well as by eliminating whatever does not apply to your situation.<br \/><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9073\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/10-heuristics.png\" alt=\"\" width=\"680\" height=\"680\" \/><\/p><p>So, how many experts should be conducting the evaluation? You need more than one expert to uncover heuristic problems. The more experts you add, the more problems you will be able to uncover.<\/p><p>We usually recommend conducting the heuristic evaluation with 3 to 5 experts. Having more than 5 experts conduct the evaluation does not seem to add much more value.<\/p><h3>Severity Rating in Heuristic Evaluation<\/h3><p>As we\u00a0<span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">evaluate a\u00a0<a href=\"https:\/\/www.invespcro.com\/blog\/website-analysis\/\" target=\"_blank\" rel=\"noopener\">website<\/a>, two things <\/span>happen. We uncover problems with the website. These problems receive a rating as follows:<\/p><ul><li>P1: Catastrophic and nearly unusable for all users, imperative to fix<\/li><li>P2: Major problems are present, but users are still able to perform tasks<\/li><li>P3: Minor problems are present for some users<\/li><li>P4: Cosmetic issues only<\/li><\/ul><p>These items are then sent to the client or the development team for fixing. At the same time, the team will uncover research opportunities. These are items we need to investigate further, develop better designs for, or improve visitor flow. Research opportunities identified during the heuristic evaluation form the basis of our CRO work.<\/p><h3>How to Conduct a Heuristic Evaluation?<\/h3><p>The knowledge and experience of reviewers are crucial to heuristic evaluation because they can drastically affect the findings.<\/p><p>You go through three fundamental steps when conducting a heuristic evaluation:<\/p><p><strong>The Preparation phase: <\/strong><\/p><ul><li>Agree on who will do the review.<\/li><li>Determine the key principles or guidelines of the evaluation.<\/li><li>Select the key content areas for evaluation that will cover a wide range of evaluation types.<\/li><\/ul><p><strong>The Execution phase:<\/strong><\/p><ul><li>For each heuristic, experts, individually or in a group, assess the severity of each problem and assign a severity rating from 0 to 4.<\/li><\/ul><p><strong>The Consolidation phase: <\/strong><\/p><ul><li>Discuss the aggregated findings and identify problem areas; these can be specific details or broader pain points.<\/li><li>Look for patterns.<\/li><li>Suggest appropriate recommendations and allocate resources to fix those problems through realistic solutions.<\/li><\/ul><h3>The Heuristic Evaluation in Action<\/h3><p>The following case study evaluates the user interface of the Gateway to Electronic Media Services (GEMS) system.<br \/><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9081\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/heuristic-evaluation-case-study.png\" alt=\"\" width=\"462\" height=\"299\" \/><\/p><p style=\"text-align: center;\">Image source: GEMS<\/p><p>The study focuses on identifying problem areas on the website and making informed decisions about areas that need improvement.<\/p><p>For these purposes, a questionnaire based on Nielsen\u2019s 10 heuristics was designed and administered to a sample of 25 NTU students.<\/p><p>The evaluation included four different tasks for the users to complete:<\/p><ul><li style=\"text-align: left;\">Finding the title of a book.<\/li><li style=\"text-align: left;\">Finding the author(s) of the book.<\/li><li style=\"text-align: left;\">Finding the title of the book using the ISBN.<\/li><li style=\"text-align: left;\">Finding the ISBN number of a book with the help of a title.<\/li><\/ul><p><strong>The overall impression of the users:<\/strong><\/p><p>The users were asked to give their impressions of the GEMS system, as you can see below:<br \/><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9090\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/heuristic-case-study-table.png\" alt=\"\" width=\"542\" height=\"165\" \/><br \/>This case study poses an interesting question. Who should conduct the heuristic evaluation? Should CRO\/usability experts conduct the review, or should we recruit users of the system? If you have the budget and time, do both. If you absolutely have to choose one, we believe conversion experts are better than non-specialists at conducting heuristic evaluation.<\/p><h3 style=\"text-align: left;\">Advantages of Heuristic Evaluation<\/h3><ul><li style=\"text-align: left;\">Obtain feedback in the early stages of the design.<\/li><li style=\"text-align: left;\">Obtain more accurate and detailed results.<\/li><li style=\"text-align: left;\">Easily obtain meaningful results in a very short time.<\/li><li style=\"text-align: left;\">Evaluate potential issues on your website.<\/li><\/ul><h3 style=\"text-align: left;\">Disadvantages of Heuristic Evaluation<\/h3><ul><li style=\"text-align: left;\">Based on experts&#8217; personal inferences, which makes it subjective to some extent.<\/li><li style=\"text-align: left;\">The evaluation may identify minor issues as well as some major ones.<\/li><li style=\"text-align: left;\">The fact that only experts can undertake this evaluation makes it obligatory for you to assign and hire experts, in case you lack the needed knowledge, which requires resources.<\/li><\/ul><h2>3. Cognitive Walkthrough<\/h2><p>A cognitive walkthrough traces the mental processes users are expected to follow to accomplish tasks.<\/p><p><strong>This technique\u2019s primary focus is\u00a0<\/strong><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>ease of use on a specific website,\u00a0<\/strong>and it\u2019s based on a\u00a0<a href=\"https:\/\/books.google.com.tr\/books?id=LQ0wAAAAQBAJ&amp;pg=PR12&amp;dq=Usability+Inspection+Methods&amp;hl=en&amp;sa=X&amp;redir_esc=y#v=onepage&amp;q=cognitive%20walkthrough&amp;f=false\" target=\"_blank\" rel=\"noopener\">theory<\/a> that users learn through exploration rather than formal\u00a0<\/span>training.<\/p><p>After selecting a task from the suite the website supports, the expert\u2019s main objective is to determine one or more sequences of actions that users will actually follow.<\/p><h3>How to Conduct a Cognitive Walkthrough?<\/h3><p>The process of conducting a cognitive walkthrough evaluation can be done through three major steps:<\/p><p><strong>Step 1. Preparation<\/strong><\/p><ul><li>Define an assumed user background and their level of knowledge about your website.<\/li><li>Choose a task sample that is both realistic and important.<\/li><li>Specify correct action subsequences for the task.<\/li><li>Determine interface states along the sequence(s).<\/li><\/ul><p><strong>Step 2. Analysis<\/strong><\/p><ul><li>For each correct action, come up with a successful story that can explain and give reasons why a user would choose to take that action, or a failure story on why a user wouldn\u2019t choose to take that action.<\/li><li>Record problems, reasons, and assumptions.<\/li><li>Suggest alternatives and solutions for the defined problems.<\/li><\/ul><p><strong>Step 3. Follow-up<\/strong><\/p><ul><li>Modify your website based on the findings to eliminate the problems.<\/li><\/ul><h3>The Cognitive Walkthrough in Action<\/h3><p>This case study was conducted using the \u201cHist\u00f3ria do dia,\u201d a children\u2019s website.<\/p><p>The method used to validate the cognitive walkthrough for children included five main steps:<\/p><p>1. Performing the cognitive walkthrough on all the tasks available on the website (performed first by an expert).<\/p><p>2. Creating a list of typical tasks that children perform on the website.<\/p><p>3. Getting two other experts to perform the cognitive walkthrough on the same list of tasks.<\/p><p>4. Testing the tasks with children and recording their results.<\/p><p>5. Comparing the difficulties experienced by the children and the problems predicted in steps 1 and 3.<\/p><p><strong>Users:<\/strong><\/p><p>Children aged 5 to 7 with some knowledge of using a mouse and keyboard. Users can also read and learn the basics of web navigation.<\/p><p><strong>List of Tasks: <\/strong><\/p><p><strong>Read the daily story:<\/strong><\/p><ol><li>Click the picture associated with the story.<\/li><li>Click the icon to start the story.<\/li><li>Click the icons to navigate through the story.<\/li><\/ol><ul><li><strong>Results: <\/strong><\/li><\/ul><p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-9095 aligncenter\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/results-daily-story.png\" alt=\"\" width=\"283\" height=\"113\" \/><\/p><p><strong>Hear the daily story:<\/strong><\/p><ol><li>Click the picture associated with the story.<\/li><li>Click the icon to start the narration.<\/li><\/ol><ul><li><strong>Results:<\/strong><\/li><\/ul><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9096\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/results-hear-the-daily-story.png\" alt=\"\" width=\"253\" height=\"118\" \/><\/p><p><strong>Read a story from the archive:<\/strong><\/p><ol><li>Click the \u201cArquivo\u201d icon.<\/li><li>Click the desired month.<\/li><li>Click on the period within the chosen month in which the story was first made available.<\/li><li>Click the picture associated with the story.<\/li><\/ol><ul><li><strong>Results:<\/strong><\/li><\/ul><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9097\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/results-archive.png\" alt=\"\" width=\"329\" height=\"147\" \/><\/p><p><strong>Vote on the daily story:<\/strong><\/p><ol><li>Click the \u201cVotar\u201d icon.<\/li><li>Choose how many stars we will award to the story.<\/li><\/ol><ul><li><strong>Results:<\/strong><\/li><\/ul><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9098\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/results-vote.png\" alt=\"\" width=\"238\" height=\"117\" \/><\/p><p><strong>Conclusion:<\/strong><\/p><p>As shown in the table below, the cognitive walkthrough is a reliable method for predicting usability problems and for identifying areas for improvement in an interface.<br \/><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9099\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/conclusion.png\" alt=\"\" width=\"326\" height=\"103\" \/><\/p><h3>Advantages of Cognitive Walkthrough<\/h3><ul><li>It\u2019s an effective method for identifying problem spots, if any, and suggesting possible causes.<\/li><li><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">It uses a more detailed, more complete procedure with more practical instructions for experts, and\u00a0<a href=\"https:\/\/books.google.com.tr\/books?id=WuQbERgXR10C&amp;pg=PA705&amp;dq=Usability+Inspection+Methods&amp;hl=en&amp;sa=X&amp;redir_esc=y#v=onepage&amp;q&amp;f=false\" target=\"_blank\" rel=\"noopener\">it uncovers almost 40% of the problems and hurdles identified<\/a><a href=\"https:\/\/books.google.com.tr\/books?id=WuQbERgXR10C&amp;pg=PA705&amp;dq=Usability+Inspection+Methods&amp;hl=en&amp;sa=X&amp;redir_esc=y#v=onepage&amp;q&amp;f=false\" target=\"_blank\" rel=\"noopener\">\u00a0by user testing.<\/a><\/span><\/li><\/ul><div class=\"blog_img\"><h3 style=\"text-align: left;\">Disadvantages of Cognitive Walkthrough<\/h3><ul><li style=\"text-align: left;\">Requires an expert\u2019s knowledge to be conducted.<\/li><li style=\"text-align: left;\">It provides no quantitative data because it\u2019s primarily theoretical.<\/li><li style=\"text-align: left;\">Time-consuming at the level of conducting a complete and thorough analysis.<\/li><li style=\"text-align: left;\">It depends on analysis and theory rather than user testing.<\/li><\/ul><h2 style=\"text-align: left;\">4. Checklist Review (Guidelines Review)<\/h2><p>The checklist review is similar to the heuristic evaluation, but more detailed, based on concrete test statements and a set of best practices and principles.<\/p><p>How to conduct a Checklist Review?<\/p><p>In his book, <a href=\"https:\/\/books.google.com.tr\/books?id=LC0cG-vFJbcC&amp;pg=PA155&amp;lpg=PA155&amp;dq=%27%27problem+inspection+methods+within+your+website%27%27&amp;source=bl&amp;ots=CXm--pjT6i&amp;sig=ZpnpVgKoxI01wjFFbFhmrq4dFFQ&amp;hl=en&amp;sa=X&amp;ved=0ahUKEwjW2Iz989DTAhXDFSwKHSwqCGYQ6AEIIjAA#v=onepage&amp;q&amp;f=false\"><em>\u201cDesigning Web Navigation: Optimizing the User <\/em>Experience,\u201d<\/a> James Kalbach states that <em>\u00a0<\/em>the checklist evaluation or the guideline review is conducted throughout three main stages:<\/p><ul><li style=\"text-align: left;\"><strong>Preparation: <\/strong>This stage involves recruiting subjects once they are familiar with the site&#8217;s key pages and determining which items need evaluation.<\/li><li style=\"text-align: left;\"><strong>Execution<\/strong>: At this stage, there are only major steps; you review the test statements and rate both those checkpoints and how they are met.<\/li><li style=\"text-align: left;\"><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>Consolidation:\u00a0<\/strong>This stage is fully devoted to a thorough analysis to identify patterns in the findings, how each key page works, the main problems identified, and appropriate recommendations to address them.<\/span><\/li><\/ul><p>Because of their detailed nature, these statements and guidelines tend to grow over time to cover all areas where problems might occur on the website, which requires more attention and focus when implemented.<\/p><p>These statements are time-consuming but still easy to conduct. They can replace usability tests if budget constraints exist.<\/p><table style=\"height: 2208px; width: 676px;\"><tbody><tr><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Evaluation Point <\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Rating<\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Comment<\/strong><\/td><\/tr><tr><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Navigating <\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">All the major parts of the website are accessible from the home page<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Critical content is located high in the structure of the site<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Content is within three clicks of the home page<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Alternative navigation mechanisms are available<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">An exit point appears on every page<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Further navigation suggestions on every page apart from a global navigation<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Related information is linked together<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Navigation links behave consistently and predictably<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Labelling <\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Links are labeled accurately with mutually exclusive terms<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The language used is simple and in terms that the site visitors can understand<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The meaning of navigation is clear, consistent, and useful<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The destination of navigation links is predictable<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Abbreviations are not used, or, when they are used, they are clear and obvious to target audiences<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Each page has a browser title that is coordinated with the navigation and page title<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Each page has a clear page title, related to other labels around it<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">If the site supports multiple languages, the navigation is flexible to accommodate translations<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Visual Designs <\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Navigation options are clear and visible<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Navigation options are readable and quickly scannable<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">There is a clear hierarchy of options, labels, and headers on each page<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The navigation mechanisms are pleasing and attractive<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The layout is clear with a sufficient amount of white space<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Colors are used effectively to prioritize and organize navigation<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"background-color: #08a2bd; border-color: #000000;\"><strong>Browser<\/strong><\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><td style=\"background-color: #08a2bd; border-color: #000000;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Back buttons and other assumed browser functions are operable<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">Each page has a human-readable URL<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">The URL is related to the name of the company and shows a predictable structure within the site via directory structure<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><tr><td style=\"border-color: #000000; width: 373px;\">There are no broken navigation links<\/td><td style=\"border-color: #000000; width: 82px;\">\u00a0<\/td><td style=\"border-color: #000000; width: 203px;\">\u00a0<\/td><\/tr><\/tbody><\/table><h3 style=\"text-align: left;\">Advantages of the Checklist Review<\/h3><ul><li style=\"text-align: left;\">Quick feedback to designers with relatively direct answers<\/li><li style=\"text-align: left;\">The detailed nature, which limits the scope of interpretation and guessing<\/li><li style=\"text-align: left;\">Relatively inexpensive<\/li><li style=\"text-align: left;\">Doesn\u2019t require knowledge and expertise to be conducted<\/li><\/ul><h3 style=\"text-align: left;\">Disadvantages of the Checklist Review<\/h3><ul><li style=\"text-align: left;\">Time-consuming due to its detailed nature<\/li><li style=\"text-align: left;\">Requires a lot of intention and focus when being conducted<\/li><\/ul><h2 style=\"text-align: left;\">5. The PURE Method: A Substitute for Usability Testing<\/h2><p>The term PURE stands for <a href=\"https:\/\/www.nngroup.com\/articles\/pure-method\/\"><strong>\u201cPragmatic Usability Rating by Experts.\u201d<\/strong><\/a> This new method, according to Christian Rohrer, is used to estimate the amount of \u2018friction\u2019 a typical user is likely to experience when using an interface. The focus is on examining the ease of use.<\/p><p>To estimate this friction, the method provides a scoring mechanism, and the experts\u2019 job is to rate it according to predefined rubrics and criteria.<\/p><p>To simplify scoring, Christian Rohrer introduced colored bars of varying heights. Each bar and color has significance.<\/p><p>Keep in mind that the numbers and colors shown in the scorecard represent the level of friction; the more friction there is, the higher the number and the \u2018\u2019hotter\u2019\u2019 the color becomes.<\/p><table style=\"height: 419px; width: 676px;\"><tbody><tr><td style=\"border-color: #000000; background-color: #e8be6b; width: 129px;\"><strong>Bar heights<\/strong><\/td><td style=\"border-color: #000000; background-color: #e8be6b; width: 535px;\"><strong>Significance<\/strong><\/td><\/tr><tr><td style=\"border-color: #000000; width: 129px; background-color: #4fa62d;\">\u00a0<\/td><td style=\"border-color: #000000; width: 535px;\">The green bar represents steps that can be easily accomplished by the target users due to low cognitive load and, mainly, because the patterns are known.<\/td><\/tr><tr><td style=\"border-color: #000000; width: 129px; background-color: #e3d642;\">\u00a0<\/td><td style=\"border-color: #000000; width: 535px;\">As for steps that fall in the yellow range, they require some effort from users and impose a significant cognitive load.<\/td><\/tr><tr><td style=\"border-color: #000000; width: 129px; background-color: #f70a0a;\">\u00a0<\/td><td style=\"border-color: #000000; width: 535px;\">The red bar indicates steps that users could accomplish but require a humongous cognitive load. However, most of the steps in this stage are challenging. The majority of users are likely to fail.<\/td><\/tr><\/tbody><\/table><p>As the name suggests, the PURE method first quantifies a website&#8217;s ease of use by aggregating ratings against a set of criteria. Next, they provide qualitative insights on how to fix the issues they rated.<\/p><p>The PURE method combines both behavioral and attitudinal measures. In this sense, it enables you to fill the gaps left by traditional methods, whether behavioral or attitudinal.<\/p><p>Below is a scorecard showing the aggregated scores for each task.<\/p><p>The numbers and colors also indicate an overall rate for the task, usually determined by the worst score.<\/p><p>For instance, in the following example, a single step rated (3) on \u2018browser extension\u2019 led the entire task to be labeled red, indicating failure points in a fundamental task.<\/p><p>On the scorecard, green and yellow indicate tasks that are easy to fulfill, with less friction.<br \/><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9115\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/pure-method.png\" alt=\"\" width=\"560\" height=\"380\" \/><\/p><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/app.box.com\/s\/v55qenredhi8v07zhrjt5ql7qe54hzu8\">app.box<\/a><\/p><h3 style=\"text-align: left;\">How to conduct the PURE evaluation?<\/h3><p>The PURE evaluation is quick, cheap, and reliable. However, it takes around ten detailed, specific steps to obtain valid results.<\/p><p><strong style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, 'Helvetica Neue', Arial, 'Noto Sans', sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol', 'Noto Color Emoji';\">Identify target user profiles<\/strong><span style=\"font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, 'Helvetica Neue', Arial, 'Noto Sans', sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol', 'Noto Color Emoji';\">: defining your user profile types will help experts maintain consistent ratings.<\/span> For this task, we usually recommend that our panel review the website personas.<\/p><p><strong>Defining fundamental tasks: <\/strong>identify tasks that are fundamental to your evaluation by asking questions such as:<\/p><ul><li style=\"text-align: left;\">\u201cWhat are the critical tasks for the business to succeed?\u201d<\/li><li style=\"text-align: left;\">\u201cWhat kind of steps allow the target users to meet their core needs?\u201d<\/li><\/ul><p><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>Uncover your users\u2019 happy paths:<\/strong> the most desired way they accomplish their tasks.<\/span><\/p><p>Having more than one path sounds reasonable, especially with multiple users, but it will require significant work and data analysis in later stages.<\/p><div class=\"blog_img\"><ol><li style=\"text-align: left;\"><strong>Setting your steps\u2019 boundaries: <\/strong>this stage is dedicated to defining your steps\u2019 beginnings, where users are provided with a set of options, and their endings, when they expect a response from the interface.<\/li><li style=\"text-align: left;\"><strong>Review by 3 expert raters:<\/strong> A panel of 3 CRO specialists gathers in a room to conduct the PURE review. We try to select experts who have no prior involvement with the design in hand or with any other products, and we also include product professionals to avoid bias and subjectivity when rating. The lead in the panel starts performing each of the fundamental tasks. The rest of the panel will observe and record a score. Each member of the panel will record their score silently without sharing it with others. Again, each task will be rated on a scale of 1 (easy) to 3(challenging).<\/li><li style=\"text-align: left;\">Determine the <strong>PURE score for each task:<\/strong> In this step, the panel reviews each task, and each member reveals their score for it. The panel must agree on the score for the task.<\/li><\/ol><p>The panel might have different opinions and rate differently, which will lead to the following cases:<\/p><ul><li style=\"text-align: left;\"><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>Case 1:<\/strong> all three decide on the same individual score; in this case, the decided score is obvious, and the margin of disagreement is absent.<\/span><\/li><li style=\"text-align: left;\"><strong>Case 2:<\/strong> 2 out of 3 agreed on a certain score; it\u2019s obvious that the score represents the majority, unless the discussion revealed insights the majority missed and the panel chose the less popular score as their final decision.<\/li><li style=\"text-align: left;\"><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>Case 3:<\/strong> all three experts have different scores; in this case, the discussion will clarify any wrongful assumptions or misunderstandings about the method or interface.<\/span><\/li><\/ul><p><strong>Summing up the PURE scores: <\/strong>in the final step, the scores for each task are added together. As mentioned earlier, these bar heights indicate the simplicity or complexity of the task at hand. Knowing where your users encounter hurdles gives you more room to improve your product.<\/p><h3 style=\"text-align: left;\">Advantages of the PURE Method<\/h3><ul><li style=\"text-align: left;\">Easy to conduct and cost-effective.<\/li><li style=\"text-align: left;\">You can use it on user experiences that haven\u2019t been completely built yet.<\/li><li style=\"text-align: left;\">Provides regular assessments and tracks long-term improvement.<\/li><\/ul><h3 style=\"text-align: left;\">Disadvantages of the PURE Method<\/h3><ul><li style=\"text-align: left;\">Requires knowledge and expertise to be conducted.<\/li><li style=\"text-align: left;\">It is time-consuming and requires significant effort and planning.<\/li><\/ul><h2 style=\"text-align: left;\">6. The Navigation Stress Test<\/h2><p>The navigation stress test was <a href=\"http:\/\/instone.org\/navstress\">first introduced<\/a> by Keith Instone. This test asks tough questions about your website, helps focus on navigation issues, and forces you to make conscious design decisions.<\/p><p>These questions revolve around three basic points:<\/p><ul><li style=\"text-align: left;\"><strong>Where am I?<\/strong><\/li><li style=\"text-align: left;\"><strong>What\u2019s here?<\/strong><\/li><li style=\"text-align: left;\"><strong>Where can I go? <\/strong><\/li><\/ul><h3 style=\"text-align: left;\">How to Conduct a Navigation Stress Test?<\/h3><p>The stress test method is quite easy and simple:<\/p><ul><li style=\"text-align: left;\">The first step is about randomly choosing a webpage.<\/li><li style=\"text-align: left;\">After removing the URL from that page, print it in black and white.<\/li><li style=\"text-align: left;\">Pretend to be a first-time visitor, or ask someone who has never seen the site before to participate in the test, and try to answer the questions included in the chart below:<\/li><\/ul><table style=\"height: 651px; width: 672px;\"><tbody><tr><td style=\"border-color: #000000; background-color: #27c4cc;\">Navigation Questions<\/td><td style=\"border-color: #000000; background-color: #27c4cc;\">Mark up on the paper<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What is this page about?<\/td><td style=\"border-color: #000000; width: 458px;\">Draw a rectangle around the title of the page or write it on the paper yourself<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What site is this?<\/td><td style=\"border-color: #000000; width: 458px;\">Circle the site name, or write it on the paper yourself<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What are the major sections of this site?<\/td><td style=\"border-color: #000000; width: 458px;\">Label with X<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What major sections is this page in?<\/td><td style=\"border-color: #000000; width: 458px;\">Draw a triangle around the X<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What is one level up from here?<\/td><td style=\"border-color: #000000; width: 458px;\">Label with U<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">How do I get to the home page?<\/td><td style=\"border-color: #000000; width: 458px;\">Label with H<\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">How do I get to the top of this section of the site?<\/td><td style=\"border-color: #000000; width: 458px;\"><p>Circle the major groups of links and label:<strong>D<\/strong>: More details, sub-pages of this one<\/p><p><strong>N<\/strong>: Nearby pages, within the same section as this page<\/p><p><strong>S<\/strong>: Pages on same site, but not as near<\/p><p><strong>O<\/strong>: Off-site pages<\/p><\/td><\/tr><tr><td style=\"border-color: #000000; width: 198px;\">What does each group of links represent?<\/td><td style=\"border-color: #000000; width: 458px;\">Write the set of selections as: Choice 1 &gt; Choice 2 &gt; \u2026<\/td><\/tr><\/tbody><\/table><p style=\"text-align: center;\">Chart source: <a href=\"http:\/\/instone.org\/navstress\">instone<\/a><\/p><ul><li style=\"text-align: left;\">Start marking up the question you answered with the symbols in the chart.<\/li><li style=\"text-align: left;\">Prepare recommendations and solutions for the questions you didn\u2019t answer based on the findings.<\/li><\/ul><h3 style=\"text-align: left;\">Applying the Navigation Stress Test<\/h3><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9123\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/navigation-path.png\" alt=\"\" width=\"1357\" height=\"687\" \/><\/div><\/div><div class=\"blog_img\"><h3 style=\"text-align: left;\">Advantages of the Navigation Stress Test<\/h3><ul><li style=\"text-align: left;\">Among the cheapest methods to evaluate your website.<\/li><li style=\"text-align: left;\">One of the quickest techniques to apply.<\/li><li style=\"text-align: left;\">No need to hire experts to conduct the test.<\/li><\/ul><h3 style=\"text-align: left;\">Disadvantages of the Navigation Stress Test<\/h3><ul><li style=\"text-align: left;\">The major problem with this method is the limitation to the specific page you are evaluating. It is hard to generalize the findings to the other pages of the website.<\/li><\/ul><h2 style=\"text-align: left;\">7. UX Benchmarking Studies<\/h2><p>UX Benchmarking studies, <a href=\"https:\/\/measuringu.com\/five-types-usability\/\">also called summative studies<\/a>, help you position your website features against industry standards.<\/p><p>With benchmarking, you can test, measure, and track how well your website is doing in correlation to users\u2019 experience metrics over time.<\/p><p>These studies combine quantitative and qualitative data to measure the user experience.<\/p><p>Benchmarking studies can be divided into two categories:<\/p><p><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\"><strong>Stand-alone Benchmarking:<\/strong> This type of benchmarking is an extremely effective method for establishing your own best practices and identifying problem areas by tracking your website&#8217;s evolution over time.<\/span><\/p><p><strong>Competitive analysis:<\/strong> this type of analysis is based on adding another component to the equation, usually your most important competitor, to help compare your site key performance indicators, such as:<\/p><ul><li style=\"text-align: left;\">success rates of revenue-driven tasks<\/li><li style=\"text-align: left;\">efficiency metrics such as time on tasks<\/li><\/ul><p>Net Promoter Scores (NPS) with competitors to recognize and see the areas that they need to focus on more in comparison to them.<\/p><h3 style=\"text-align: left;\">How to conduct a Benchmark?<\/h3><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9124\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/UX-benchmarking.png\" alt=\"\" width=\"681\" height=\"587\" \/><\/div><div class=\"blog_img\"><p style=\"text-align: center;\">Image source:<a href=\"https:\/\/fr.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\"> SlideShare<\/a><\/p><p><strong>1. Set a plan: <\/strong><\/p><ul><li style=\"text-align: left;\">Determine and define your comparators\u2014what you want to benchmark and why. For instance, it could be all your <a href=\"https:\/\/www.clearpointstrategy.com\/18-key-performance-indicators\/\">Key Performance Indicators (KPIs)<\/a> or just some of them.<\/li><\/ul><p>Examples of KPIs:<\/p><ul><li style=\"text-align: left;\">Satisfaction<\/li><li style=\"text-align: left;\">The average number of errors<\/li><li style=\"text-align: left;\">Task success rate<\/li><li style=\"text-align: left;\">The average time of tasks<\/li><li style=\"text-align: left;\">Define your target audience.<\/li><li style=\"text-align: left;\">Select competitors to benchmark against.<\/li><\/ul><p><strong>2. Conduct research using task-based testing:<\/strong><\/p><ul><li style=\"text-align: left;\">The rationale for choosing task-based testing is to ensure that your baseline metrics are available for later measurements.<\/li><\/ul><p><strong>3. Gather both quantitative and qualitative data: <\/strong><\/p><ul><li style=\"text-align: left;\">Use the quantitative data for testing.<\/li><li style=\"text-align: left;\">Use the qualitative data to support your findings and support the why.<\/li><\/ul><p><strong>4. Re-test and research at least twice a year: <\/strong>to measure and track the changes and see if your expectations are met.<\/p><h3 style=\"text-align: left;\">UX Benchmarking Studies in Action<\/h3><p><span style=\"box-sizing: border-box; margin: 0px; padding: 0px;\">In the following\u00a0<a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\" target=\"_blank\" rel=\"noopener\">case study<\/a>, you can see a UX benchmarking study conducted between American Airlines and Delta Airlines.<\/span><\/p><p><strong>The plan<\/strong><\/p><p>The plan for this study included pre-task questions, two tasks to be performed, and follow-up questions:<\/p><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9078\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/How-to-Conduct-UX-Benchmarking-the-plan.png\" alt=\"\" width=\"787\" height=\"343\" \/><\/div><div class=\"blog_img\"><p>Image source: <a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\">How to conduct UX Benchmarking<\/a><\/p><p><strong>The tasks<\/strong><\/p><p>The two tasks users had to perform were:<\/p><ol><li style=\"text-align: left;\">Go through the entire process of booking a flight.<\/li><li style=\"text-align: left;\">Locate the total price for checking in two bags.<\/li><\/ol><p>The post-tasks included:<\/p><ul><li style=\"text-align: left;\">Self-reported success<\/li><li style=\"text-align: left;\">How satisfied were you with the process of booking a flight?<\/li><li style=\"text-align: left;\">Ease of use<\/li><li style=\"text-align: left;\">Ease of navigation<\/li><li style=\"text-align: left;\">Clear where to start<\/li><li style=\"text-align: left;\">Satisfaction with the amount of time to complete the task<\/li><\/ul><p>The wrap-up included:<\/p><ul><li style=\"text-align: left;\">Overall rating<\/li><li style=\"text-align: left;\">Post-task branding attributes<\/li><li style=\"text-align: left;\">What did you like the most about the airline website?<\/li><li style=\"text-align: left;\">What did you like the least about the airline website?<\/li><li style=\"text-align: left;\">Likelihood to recommend<\/li><\/ul><p><strong>The results<\/strong><\/p><p>For the first task, most participants reported successfully completing the entire purchase process.<\/p><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9076\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/How-to-Conduct-UX-Benchmarking-task-1.png\" alt=\"\" width=\"764\" height=\"455\" \/><\/div><div class=\"blog_img\"><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\">How to conduct UX Benchmarking<\/a><\/p><\/div><\/div><div class=\"blog_img\"><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9075\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/How-to-Conduct-UX-Benchmarking-task-1-opinions.png\" alt=\"\" width=\"763\" height=\"442\" \/><\/div><div class=\"blog_img\"><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\">How to conduct UX Benchmarking<\/a><\/p><p>For the second task, most participants reported being unable to find the total price for checking two bags.<\/p><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9077\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/How-to-Conduct-UX-Benchmarking-task-2.png\" alt=\"\" width=\"739\" height=\"446\" \/><\/div><div class=\"blog_img\"><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\">How to conduct UX Benchmarking<\/a><\/p><p>These are the heatmaps of users\u2019 paths when trying to complete the second task:<\/p><div class=\"blog_img\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-9074\" src=\"https:\/\/www.invespcro.com\/blog\/images\/blog-images\/How-to-Conduct-UX-Benchmarking-heatmaps-second-task.png\" alt=\"\" width=\"787\" height=\"421\" \/><\/div><div class=\"blog_img\"><p style=\"text-align: center;\">Image source: <a href=\"https:\/\/www.slideshare.net\/UserZoom\/how-to-conduct-ux-benchmarking\">How to conduct UX Benchmarking<\/a><\/p><p>Both websites had negative recommendation scores. Most participants reported they would not recommend the sites to family and friends.<\/p><h3 style=\"text-align: left;\">Advantages of Usability Benchmarking<\/h3><ul><li style=\"text-align: left;\">Puts you in continuous improvement mode.<\/li><li style=\"text-align: left;\">It helps you understand how much improvement you need to achieve significant performance.<\/li><li style=\"text-align: left;\">Enables you to outperform your competitors.<\/li><\/ul><h3 style=\"text-align: left;\">Disadvantages of Usability Benchmarking<\/h3><ul><li style=\"text-align: left;\">Enables you to measure the overall effectiveness.<\/li><li style=\"text-align: left;\">It puts your business at risk if you choose the wrong type of competitor.<\/li><\/ul><p style=\"text-align: left;\"><strong>Over to You<\/strong><\/p><p>Choosing the most appropriate method to enhance the user experience on your website can be overwhelming.<\/p><p>Given the large number of methods out there, keep in mind that, no matter which one you choose, you need to make sure you have chosen the most feasible one for your situation.<\/p><p>Test for the right reasons, and you\u2019ll have a good chance of achieving great outcomes. Do the opposite, and you\u2019ll end up with some misleading insights, wasting hours, resources, and putting your whole business at risk.<\/p><\/div><\/div><\/div><\/div><\/div><\/div><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p><span class=\"span-reading-time rt-reading-time\" style=\"display: block;\"><span class=\"rt-label rt-prefix\">Reading Time: <\/span> <span class=\"rt-time\"> 16<\/span> <span class=\"rt-label rt-postfix\">minutes<\/span><\/span>There is no such thing as a perfect website. No designer, developer, or marketer can spot the full range of problems on a website alone. Why? One direct reason is that only real users can identify some of these problems. The market today is a fierce battlefield, as everyone is striving to deliver the best [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":9380,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36,18],"tags":[85,87,311,496,497],"class_list":["post-9071","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cro","category-ux","tag-beginner","tag-general","tag-list","tag-usability-problems","tag-website-conversion-rate"],"_links":{"self":[{"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/posts\/9071","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/comments?post=9071"}],"version-history":[{"count":3,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/posts\/9071\/revisions"}],"predecessor-version":[{"id":101808,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/posts\/9071\/revisions\/101808"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/media\/9380"}],"wp:attachment":[{"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/media?parent=9071"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/categories?post=9071"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.invespcro.com\/blog\/wp-json\/wp\/v2\/tags?post=9071"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}