Benchmarking Explained

Benchmarking is the practice of comparing business processes and performance metrics to industry bests and best practices from other companies. Dimensions typically measured are quality, time and cost.

Benchmarking is used to measure performance using a specific indicator (cost per unit of measure, productivity per unit of measure, cycle time of x per unit of measure or defects per unit of measure) resulting in a metric of performance that is then compared to others.^[1]

Also referred to as "best practice benchmarking" or "process benchmarking", this process is used in management in which organizations evaluate various aspects of their processes in relation to best-practice companies' processes, usually within a peer group defined for the purposes of comparison. This then allows organizations to develop plans on how to make improvements or adapt specific best practices, usually with the aim of increasing some aspect of performance. Benchmarking may be a one-off event, but is often treated as a continuous process in which organizations continually seek to improve their practices.

In project management benchmarking can also support the selection, planning and delivery of projects.^{[2] [3]}

In the process of best practice benchmarking, management identifies the best firms in their industry, or in another industry where similar processes exist, and compares the results and processes of those studied (the "targets") to one's own results and processes. In this way, they learn how well the targets perform and, more importantly, the business processes that explain why these firms are successful. According to National Council on Measurement in Education, benchmark assessments ^[4] are short assessments used by teachers at various times throughout the school year to monitor student progress in some area of the school curriculum. These also are known as interim government.

In 1994, one of the first technical journals named Benchmarking was published.

History

The term benchmark, originates from the history of guns and ammunition, in regards to the same aim as for the business term: comparison and improved performance. The introduction of gunpowder arms replaced the bow and arrow from the archer, who now had to learn to handle a gun. The new weapon left only a mark on the target, where the arrow used to be visible, and with the bow gone, the soldiers title changed to marksman, the man who put the mark. The gun improved in the early beginning with rifled barrels. With the industrialization of the weapon industry in the mid-1800s, the mass production of ammunition as a cartridge replaced the manual loading. Now, with standardized production of both the high-precision rifle and its cartridge, the marksman's accuracy became the bottleneck. With different qualities and specifications on rifles and ammunition, there grew a need to test both. The rifled weapon was fixed in a bench, making it possible to fire several identical shots at a target to measure the spread.

In 2008, a comprehensive survey^[5] on benchmarking was commissioned by The Global Benchmarking Network, a network of benchmarking centres representing 22 countries.

1. Mission and Vision Statements and Customer (Client) Surveys are the most used (by 77% of organizations) of 20 improvement tools, followed by SWOT analysis (strengths, weaknesses, opportunities, and threats) (72%), and Informal Benchmarking (68%). Performance Benchmarking was used by 49% and Best Practice Benchmarking by 39%.
2. The tools that are likely to increase in popularity the most over the next three years are Performance Benchmarking, Informal Benchmarking, SWOT, and Best Practice Benchmarking. Over 60% of organizations that are not currently using these tools indicated they are likely to use them in the next three years. Benchmarking mainly depends on SWOT analysis and will also be using in future for almost 4–5 years.

Procedure

There is no single benchmarking process that has been universally adopted. The wide appeal and acceptance of benchmarking has led to the emergence of benchmarking methodologies. One seminal book is Boxwell's Benchmarking for Competitive Advantage (1994).^[6] The first book on benchmarking, written and published by Kaiser Associates,^[7] is a practical guide and offers a seven-step approach. Robert Camp (who wrote one of the earliest books on benchmarking in 1989)^[8] developed a 12-stage approach to benchmarking.

The 12 stage methodology consists of:

1. Select subject
2. Define the process
3. Identify potential partners
4. Identify data sources
5. Collect data and select all partners
6. Determine the gap
7. Establish process differences
8. Target future performance
9. Communicate
10. Adjust goal
11. Implement
12. Review and recalibrate

The following is an example of a typical benchmarking methodology:

• Identify problem areas: Because benchmarking can be applied to any business process or function, a range of research techniques may be required. They include informal conversations with customers, employees, or suppliers; exploratory research techniques such as focus groups; or in-depth marketing research, quantitative research, surveys, questionnaires, re-engineering analysis, process mapping, quality control variance reports, financial ratio analysis, or simply reviewing cycle times or other performance indicators. Before embarking on comparison with other organizations it is essential to know the organization's function and processes; base lining performance provides a point against which improvement effort can be measured.
• Identify other industries that have similar processes: For instance, if one were interested in improving hand-offs in addiction treatment one would identify other fields that also have hand-off challenges. These could include air traffic control, cell phone switching between towers, transfer of patients from surgery to recovery rooms.
• Identify organizations that are leaders in these areas: Look for the very best in any industry and in any country. Consult customers, suppliers, financial analysts, trade associations, and magazines to determine which companies are worthy of study.
• Survey companies for measures and practices: Companies target specific business processes using detailed surveys of measures and practices used to identify business process alternatives and leading companies. Surveys are typically masked to protect confidential data by neutral associations and consultants.
• Visit the "best practice" companies to identify leading edge practices: Companies typically agree to mutually exchange information beneficial to all parties in a benchmarking group and share the results within the group.
• Implement new and improved business practices: Take the leading edge practices and develop implementation plans which include identification of specific opportunities, funding the project and selling the ideas to the organization for the purpose of gaining demonstrated value from the process.

Cost

The three main types of costs in benchmarking are:

• Visit Costs - This includes hotel rooms, travel costs, meals, a token gift, and lost labor time.
• Time Costs - Members of the benchmarking team will be investing time in researching problems, finding exceptional companies to study, visits, and implementation. This will take them away from their regular tasks for part of each day so additional staff might be required.
• Benchmarking Database Costs - Organizations that institutionalize benchmarking into their daily procedures find it is useful to create and maintain a database of best practices and the companies associated with each best practice now.

The cost of benchmarking can substantially be reduced through utilizing the many internet resources that have sprung up over the last few years. These aim to capture benchmarks and best practices from organizations, business sectors and countries to make the benchmarking process much quicker and cheaper.^[9]

Technical/product benchmarking

The technique initially used to compare existing corporate strategies with a view to achieving the best possible performance in new situations (see above), has recently been extended to the comparison of technical products. This process is usually referred to as "technical benchmarking" or "product benchmarking". Its use is well-developed within the automotive industry ("automotive benchmarking"), where it is vital to design products that match precise user expectations, at minimal cost, by applying the best technologies available worldwide. Data is obtained by fully disassembling existing cars and their systems. Such analyses were initially carried out in-house by car makers and their suppliers. However, as these analyses are expensive, they are increasingly being outsourced to companies who specialize in this area. Outsourcing has enabled a drastic decrease in costs for each company (by cost sharing) and the development of efficient tools (standards, software).

Types

Benchmarking can be internal (comparing performance between different groups or teams within an organization) or external (comparing performance with companies in a specific industry or across industries). Within these broader categories, there are three specific types of benchmarking: 1) Process benchmarking, 2) Performance benchmarking and 3) Strategic benchmarking. These can be further detailed as follows:

• Process benchmarking - the initiating firm focuses its observation and investigation of business processes with a goal of identifying and observing the best practices from one or more benchmark firms. Activity analysis will be required where the objective is to benchmark cost and efficiency; increasingly applied to back-office processes where outsourcing may be a consideration. Benchmarking is appropriate in nearly every case where process redesign or improvement is to be undertaking so long as the cost of the study does not exceed the expected benefit.
• Financial benchmarking - performing a financial analysis and comparing the results in an effort to assess your overall competitiveness and productivity.
• Benchmarking from an investor perspective- extending the benchmarking universe to also compare to peer companies that can be considered alternative investment opportunities from the perspective of an investor.
• Benchmarking in the public sector - functions as a tool for improvement and innovation in public administration, where state organizations invest efforts and resources to achieve quality, efficiency and effectiveness of the services they provide.^[10]
• Performance benchmarking - allows the initiator firm to assess their competitive position by comparing products and services with those of target firms.
• Product benchmarking - the process of designing new products or upgrades to current ones. This process can sometimes involve reverse engineering which is taking apart competitors products to find strengths and weaknesses.
• Strategic benchmarking - involves observing how others compete. This type is usually not industry specific, meaning it is best to look at other industries, i.e. Strategic Benchmarking with the help of PIMS (Profit impact of marketing strategy).
• Functional benchmarking - a company will focus its benchmarking on a single function to improve the operation of that particular function. Complex functions such as Human Resources, Finance and Accounting and Information and Communication Technology are unlikely to be directly comparable in cost and efficiency terms and may need to be disaggregated into processes to make valid comparison.
• Best-in-class benchmarking - involves studying the leading competitor or the company that best carries out a specific function.
• Operational benchmarking embraces everything from staffing and productivity to office flow and analysis of procedures performed.^[11]
• Energy benchmarking - process of collecting, analysing and relating energy performance data of comparable activities with the purpose of evaluating and comparing performance between or within entities.^[12] Entities can include processes, buildings or companies. Benchmarking may be internal between entities within a single organization, or - subject to confidentiality restrictions - external between competing entities.

Tools

Benchmarking software can be used to organize large and complex amounts of information. Software packages can extend the concept of benchmarking and competitive analysis by allowing individuals to handle such large and complex amounts or strategies. Such tools support different types of benchmarking (see above) and can reduce the above costs significantly.

The emerging technology of benchmarking engines automates the stage of going from data to noteworthy comparative insights, sometimes even expressing the insights in English sentences.

Metric benchmarking

Another approach to making comparisons involves using more aggregative cost or production information to identify strong and weak performing units. The two most common forms of quantitative analysis used in metric benchmarking are data envelopment analysis (DEA) and regression analysis. DEA estimates the cost level an efficient firm should be able to achieve in a particular market. In infrastructure regulation, DEA сan be used to reward companies/operators whose costs are near the efficient frontier with additional profits. Regression analysis estimates what the average firm should be able to achieve. With regression analysis, firms that performed better than average can be rewarded while firms that performed worse than average can be penalized. Such benchmarking studies are used to create yardstick comparisons, allowing outsiders to evaluate the performance of operators in an industry. Advanced statistical techniques, including stochastic frontier analysis, have been used to identify high and weak performers in industries, including applications to schools, hospitals, water utilities, and electric utilities.^[13]

One of the biggest challenges for metric benchmarking is the variety of metric definitions used among companies or divisions. Definitions may change over time within the same organization due to changes in leadership and priorities. The most useful comparisons can be made when metrics definitions are common between compared units and do not change so improvements can be changed.

Social media and benchmarking

Social media is beginning to penetrate more and more into existing business processes. In this sense, benchmarking is no exception. Because of their inherent characteristics, it can even be argued that social media will have a significant impact on benchmarking. Here are some of the benefits associated with this.

• Joint benchmarking is, in fact, a social activity, and social media provide many new and effective ways for social interaction.
• Social media opens the way to new additional sources of information and data collection channels.
• Benchmarking is becoming increasingly business-oriented, and social media is supporting this type of continuous engagement, different from working on individual projects.

See also

• Global Benchmarking Network
• Project management triangle
• Profit impact of marketing strategy

Notes and References

1. Fifer, R. M. (1989). Cost benchmarking functions in the value chain. Strategy & Leadership, 17(3), 18-19.
2. Invernizzi. Diletta Colette. Locatelli. Giorgio. Brookes. Naomi J.. 2017-08-01. How benchmarking can support the selection, planning and delivery of nuclear decommissioning projects. Progress in Nuclear Energy. 99. 155–164. 10.1016/j.pnucene.2017.05.002.
3. Invernizzi. Diletta Colette. Locatelli. Giorgio. Brookes. Naomi J.. 2018-03-05. A methodology based on benchmarking to learn across megaprojects: The case of nuclear decommissioning. International Journal of Managing Projects in Business. en. 11. 1. 104–121. 10.1108/IJMPB-05-2017-0054. 1753-8378.
4. National Council on Measurement in Education (USA) http://www.ncme.org/ncme/NCME/Resource_Center/Glossary/NCME/Resource_Center/Glossary1.aspx?hkey=4bb87415-44dc-4088-9ed9-e8515326a061#anchorB
5. Web site: Archived copy . 2013-12-04 . dead . https://web.archive.org/web/20140803220401/http://www.globalbenchmarking.ipk.fraunhofer.de/fileadmin/user_upload/GBN/PDF/2010_gbn_survey_business_improvement_and_benchmarking_web.pdf . 2014-08-03 .
6. Book: Boxwell Jr, Robert J. Benchmarking for Competitive Advantage . 1994 . McGraw-Hill . Robert J Boxwell Jr, New York . 0-07-006899-2 . 225 .
7. Book: Beating the competition: a practical guide to Benchmarking . 1988 . Kaiser Associates . Washington, DC . 978-1-56365-018-5 . 176 . 2009-07-14 . https://web.archive.org/web/20090827003927/http://www.kaiserassociates.com/cs/first_book_on_benchmarking . 2009-08-27 . dead .
8. Camp, R. (1989). The search for industry best practices that lead to superior performance. Productivity Press.
9. http://logisticsbureau.com/what-is-benchmarking-save-supply-chain-costs/ "What is Benchmarking? Save Supply Chain Costs"
10. http://sedici.unlp.edu.ar/bitstream/handle/10915/63316/Documento_completo.pdf-PDFA.pdf?sequence=1 Del Giorgio Solfa, F. (2017). Public Benchmarking: contributions for subnational governments and Benchmarking Design
11. Web site: Benchmarking: How to Make the Best Decisions for Your Practice. NueMD. 2013-12-13.
12. prEN16231:2011 Energy Efficiency Benchmarking Methodology, Brussels: CEN, 2011, p5 (Definition 3.2)
13. http://www.regulationbodyofknowledge.org/price-level-regulation/basic-forms-of-regulation/ Body of Knowledge on Infrastructure Regulation