PRSA’s release of the results of the 2011 Membership Satisfaction Study has generated some questions from members, particularly regarding methodology and data interpretation. Ketchum was pleased to manage the research for PRSA’s 2008 Membership Satisfaction Study, the Society’s 2009 Chapter Survey and the current study of PRSA’s members. As the person at Ketchum responsible for the research, I wanted to share a bit about the methodology and what we found.
First, the technical details:
- Sample size — 1,126 current members, 202 lapsed members and 584 people who have never been a member. To put that into perspective, most surveys you see in the news have a sample size of 1,000 for the entire American public. Results of this study are projectable to the overall populations within the respective margins of error at the 95-percent confidence level.
- Margin of error — Ninety-five (95) percent of the time if you were to repeat this same study 100 times, you would get answers within +/- 2.2 percent for members, +/- 6.9 percent for lapsed members, and +/- 4.0 percent for “never members.”
- Weighting — Responses were weighted to the overall profile of the PRSA membership in terms of tenure in the PR industry. This is to ensure results approximate the membership as closely as possible, and is a standard practice in survey research.
Second, how confident are we in the data? The short answer is very, particularly as it relates to making comparisons with the 2008 survey. With every survey you do, there can be bias. An example in a membership survey would be where those with stronger positive or negative feelings toward the organization are more likely to respond. Those should net each other out, but you do sometimes miss as many in the “swing voter” category as a result. However, this bias would be as much the case in the study we did in 2008 as it would this year, so in terms of looking at changes, we are fine.
What is the good news? What should PRSA continue doing?
- Pretty much all key metrics are up significantly over 2008. The organization is healthier from a member satisfaction, renewal, understanding and image perspective.
- There is a very high level of likely renewal and likelihood to recommend PRSA to a friend.
- Chapters are key to how members participate in, and view, PRSA.
- Professional development is a key area for the organization.
- The overall image of PRSA (if you were to think of it like the reputation of a corporation) is on par with very strong companies in the Fortune 500.
Are there opportunities for improvement? Yes. These include:
- Satisfaction is lower than likelihood to renew. The PRSA 2011 Membership Satisfaction Study did not explore the reason behind this finding. Further research should be conducted to understand the relationship between the two in greater detail.
- Loyalty among younger members. We did a very robust segmentation analysis of PRSA members. One finding from that analysis is those who are least connected to the organization tend to be the younger segments. While this is a very simplistic summary of what we found from the segmentation, there is a need to bring in the new generations of PRSA members.
- Value for the money is an important area of focus. PRSA, like many organizations, should continue to focus on providing as much value to its members as possible.
Every survey has its strengths and weaknesses. However, the work on the PRSA membership survey has statistical robustness, consistency over time and is a solid piece of work on which to drive the organization forward. No matter how you slice the data, or quibble with one number or another, the overall finding of “significant improvement over 2008 and high current levels of member engagement” holds true.
Of course, there are plenty of things to do to drive the organization and PR industry forward. From my personal perspective, the worst thing one can do is spend time trying to find what could be right or wrong in the data, versus taking action in continuing to move PRSA in the positive direction it is going.
David Rockland, Ph.D., is partner and managing director, global research, Ketchum, a unit of Omnicom Group, which operates in more than 65 countries. He is chair of the International Association for the Measurement and Evaluation of Communication (AMEC)’s U.S. Agency Leaders Research Group; a faculty member at the University of Maryland; and a former Chair of the Institute for Public Relations’ Commission on Public Relations Measurement & Evaluation.
