1. Must-Know Trends and Next Practices in PR Measurement: Barcelona and Alternatives to AVE March 1, 2011 Angela Jeffrey, APR Vice President Integrated Media
8. COMMUNICATION / MARKETING FUNNEL The Valid Metrics Matrix P H A S E S Org/ Biz Result Awareness Knowledge/ Understanding Interest/ Consideration Preference/Support Action Public Relation Activity Intermediary Effect Target Audience Effect
9.
10.
11.
12. COMMUNICATION / MARKETING FUNNEL Applying the Approach to Other Objectives P H A S E S Org/ Biz Result Awareness Knowledge/ Understanding Interest/ Consideration Preference/Support Action Public Relation Activity Intermediary Effect Target Audience Effect
13.
14.
15.
16.
17.
18.
19.
Notes de l'éditeur
A very important “must know” practice for you today is the industry’s final push away from ad value equivalency and towards a new set of alternatives that have been designed to take its place. I’m sure most of you are familiar with the Barcelona Principles, which were approved by five international PR bodies in the summer of 2010, including PRSA, the IPR Commission on PR Measurement & Evaluation, and AMEC. Without question, the most famous of the seven principles is #5 – which states that AVE is not the value of public relations. So, as a follow-up to the Principles, a Task Force was created to identify a framework for determining possible metrics for individual PR programs. This new framework is called the Valid Metrics Guidelines, and is the topic of my brief discussion today!
Before we get started, I purposely left this slide in the deck to give credit this morning to Ruth Pestana of Hill and Knowlton, who chaired this task force, and did an outstanding job
The taskforce was comprised of five Agencies: Hill & Knowlton, Evolve 24, Chandler Chicco, Weber Shandwick, and Ketchum and four Research Providers: VMS, Dow Jones, Echo Research, Report International. Two primary challenges facing the AVE taskforce : The industry had become used to the beguiling singularity of AVEs PR addresses many different publics and has many different forms of impact, so we need more than one metric. To truly demonstrate the value of PR, metrics needed to be linked to the business objective of the program. The guidelines are based on PR measurement moving beyond measuring outputs to measuring outcomes. Therefore, the Task Force: PR measurement needs to be shown as a continuum of metrics – starting with outputs and ending ultimately with business results.
The Valid Metrics guidelines take the form of a MATRIX, which is applicable to a number of different types of campaigns. Within the matrix, three phases have been defined to reflect a (very) simplified breakdown of how Public Relations works. In essence, PR can be boiled down to three phases: The messages or story is created and told The story is disseminated via a third party/intermediary, such as journalists, influencers or bloggers The story is consumed by the target audience, which if successful leads to behavior change and the desired business result The matrix was constructed to reflect this simplified process: Public Relations Activity – metrics reflecting the process of producing or disseminating the desired messages Intermediary Effect – metrics reflecting the third party dissemination of the messages to the target audience Target Audience Effect – metrics showing that the target audience has received the communications and any resulting action-driven outcomes
The continuum concept was also applied horizontally to how communications are received by the target audience. This axis is based on what is commonly known as the Communication or Marketing Funnel . The stages of this funnel are awareness, understanding, interest/consideration, preference and action . Metrics have been grouped under these stages to help PR practitioners demonstrate how communications are absorbed, in nomenclature that marketers understand.
Now – you might be wondering whatever happened to Outputs, Outtakes and Outcomes, long preached by the measurement community. Well, they still fit, if you think about it. PR Activity wasn’t included in the old model, but the Intermediary step would really be what we consider Outputs to be, and the Target Audience step is really a mixture of Outtakes and Outcomes. So, we haven’t gone as far afield as it may seem at first.
Once the structure was set, the matrix was then applied to a series of grids, acknowledging the fact that the desired business result for different types of campaigns varies according to the objective. Each grid pertains to a different function of Public Relations/Public Affairs. They include Brand and Product Marketing , Reputation Building , Issues Advocacy and Support , Public Education , Employee Engagement , Investor Relations , and Crisis and Issues Management . While each grid outlines specific metrics for its campaign objectives, there is naturally some overlap. Most importantly however, the desired business result for each type of campaign is captured in the final box on the grid. Applying the Matrix Now – let’s work through one of the Matrices. There are five simple steps … starting with: 1. Choose the grid that is relevant to the campaign being measured.
In the row titled “Public Relations Activities”, determine the activities being conducted for the campaign and identify metrics for each. For example, for “Media Engagement”, potential metrics are: number of journalists briefed, number of press releases distributed and number of press kits created.
In the row titled “Intermediary Effect”, review the suggested metrics and determine which are appropriate to collect, given the resources available. Keep in mind, however, that these metrics do represent those most commonly used in media and blogger analysis, and it is recommended that as many as possible be included in the measurement program. There’s a real difference in the metrics as you go across the grid, with simpler metrics for awareness, and more complex for knowledge, consideration and preference. For instance …
In the row titled “Target Audience Effect”, review the suggested metrics and again determine which are appropriate given the resources available. Many of these metrics require a survey to be conducted, but this does not need to be a large drain on resources. Online polls are a cost-effective way to reach many audiences. Attitudes can also be gathered by reviewing the opinions expressed by members of the target audience through online communities . Web analytics (of the client’s site) can also be used to assess consideration and preference among the target audience. Finally, in the “Action” box, determine which of the business or organizational outcomes are relevant to the client and are feasible to track. Ideally at least one business/organizational outcome should be identified as the ultimate objective of the campaign.
Other points to note: Once selected, the metrics should be tracked over time to identify trends. Consider plotting outcome metrics from the “Target Audience Effect” row against metrics from the “Intermediary Effect” row to show correlations. Consider applying cost per thousand (CPM) calculations against the “Intermediary Effect” and “Target Audience Effect” metrics. CPM is calculated by dividing the total cost by the relevant number to get cost per message, cost per article, etc. Approaches using gross rating points (GRP), which measure reach against percent of total population, and target rating points (TRP), which measure reach against percent of targeted population, can also be applied to “Intermediary Effect” metrics if relevant population numbers are available. The grids are not exhaustive and there may be other metrics that are appropriate to the campaign being measured.
Replacing AVEs If you were using AVEs as the sole metric for evaluating PR success, there is no single replacement metric. Public Relations is a broad discipline that requires multiple metrics tied to well-defined objectives. These guidelines provide many alternatives to AVEs and are intended to help practitioners identify a palette of Valid Metrics that will deliver meaningful measurement to reflect the full contribution of Public Relations. If you were using AVEs to provide comparative media costs for PR in relation to other marketing disciplines, there are several metrics that can be appropriately used for evaluating earned media results against paid media results. These include earned impressions, which measures potential reach based on media impressions data; earned cost per thousand (CPM) impressions, which measures the efficiency of earning media coverage and enables comparison to the efficiency of other marketing vehicles; gross rating points (GRP); and target rating points (TRP). If you were using AVEs to provide a dollar/euro/yen or other financial denomination for PR results, there are several metrics that can be used appropriately to measure public relations in financial terms (where demonstrable). These include total value of sales/sales leads/revenue generated by PR activities; PR activities’ contribution to sales/sales leads/revenue (often calculated via marketing mix analysis); cost savings due to PR activities (e.g. reduced customer complaints, etc.); increased target market size due to expanded mindshare; and increased or decreased in market capitalization
The Valid Metrics guidelines are not intended to be a rulebook. Practitioners are free to select the metrics that fit their budget and, most importantly, their objectives. These grids are not intended to be all-encompassing. They simply represent a starting point on the journey to objectives-based measurement with a greater business focus and which will hopefully move the industry beyond AVEs.