It’s a perennial question for researchers, policy makers and advocates in public health and social policy areas: how do we influence the real decision-makers? A recent study of senior US national security policymakers provides some valuable insights for people working in social policy and public health.
Croakey thanks Duncan Green, strategic adviser for Oxfam GB and author of ‘From Poverty to Power’, for looking at the findings through an NGO lens, and for permission to republish this post from his blog.
***
Duncan Green writes:
Interesting survey of US policymakers in December’s International Studies Quarterly journal. I’m not linking to it because it’s gated, thereby excluding more or less everyone outside a traditional academic institution (open data anyone?) but here’s a draft of What Do Policymakers Want From Us?, by Paul Avey and Michael Desch. The results are as relevant to NGO advocacy people trying to influence governments as they are to scholars. Maybe more so. I’ve added my own running translation in italics.
The authors surveyed all senior White House officials involved in national security under both George Bushes and Bill Clinton. 234 out of 915 responded (pretty good response rate for people this senior).
Conclusions?
‘The gap between the scientific aspirations of contemporary international relations scholarship and the needs of policymakers is greatest the higher one reaches in the policy world. More surprisingly, this gap tends to be greater the more educated the policymaker. This is consistent with the argument that familiarity with advanced techniques instills greater appreciation for both their promise and limits.
Translation: the more pols know about a subject, the less they believe ‘experts’
Another conclusion we draw from this survey is that a scholar’s broader visibility – both in government and among the public whether through previous government service or publication in broader venues –– enhances influence among policymakers more than his or her academic standing.
Translation: get blogging, people
The primary constraint policymakers face in digesting scholarly, or any other writings, is lack of time. As one respondent put it, “any research papers that exceed 10-15 pages” are not useful to policymakers. Another noted that “I do not have the time to read much so cannot cite” many examples of useful social science scholarship.
Translation: work on those elevator pitches
We were surprised by two other findings from our survey about how policymakers get their information: First, unclassified newspaper articles were as important to policymakers as the classified information generated inside the government. This fact opens up an important avenue for scholarly influence upon policy if scholars can condense and convey their findings via this route.
Second, the Internet has not yet become an important source of information for policymakers, despite its ease of accessibility and the generally succinct nature of the presentation of its content. It could be a just a matter of time until a more web-oriented generation reaches the pinnacle of national security decision-making authority but we also ought to consider whether the internet suffers from weaknesses vis-à-vis traditional print media that dilute its influence. The plethora of internet news and opinion outlets, many of questionable reliability, combined with the lack of an authoritative source among them, may mean that the internet will continue to lag behind the elite print media because it exacerbates the signals to noise problem for policymakers.
Translation: good old fashioned press work beats social media
But our most important findings concern what role policymakers think scholars ought to play in the policy process. Most recommended that scholars serve as “informal advisers” and as “creators of new knowledge.” There were two surprises for us here: First, policymakers ranked the educational and training role of scholars for future policymakers third behind these other two roles. They also confessed that they derived relatively little of their professional skills from their formal educations. (see pie chart) The main contribution of scholars, in their view, was research. Second, and again somewhat surprisingly, they expressed a preference for scholars to produce “arguments” (what we would call theories) over the generation of specific “evidence” (what we think of as facts). In other words, despite their jaundiced view of cutting-edge tools and rarefied theory, the thing policymakers most want from scholars are frameworks for making sense of the world they have to operate in.’
Translation: the best narrative (not the best evidence) wins
And the recommendations:
‘The most important roles for scholars to play are as both teachers and researchers, but our results suggest that both areas need careful rethinking. On the former, the findings of our survey should lead to some introspection about how we train students for careers in government service. We suspect that the focus on social science techniques and methods that dominates so much graduate, and increasingly undergraduate, training in political science is not useful across the board to policymakers. On the other hand, a purely descriptive, fact-based approach is not what policymakers seem to want from scholars either.
Three aspects of scholarship appear to be most important: First, policymakers appear to want mid-range theory. Policymakers do not reject methodologically sophisticated scholarship across the board but do seem to find much of it not useful. They prefer that scholars generate simple and straightforward frameworks that help them make sense of a complex world. They seem not so much to be looking for direct policy advice as for background knowledge to help them put particular events within a more general context. We interpret policymakers’ preference for theories over facts to the fact that like most busy people, they are cognitive economizers who need ways to make good decisions quickly and under great uncertainty. Along these lines, Henry Kissinger reportedly demanded of his subordinates: “Don’t tell me facts, tell me what they mean.”
Second, brevity is key for policymakers. We suspect that the reason that Op/Eds are so influential among policymakers is only partly due to where they are published; another important aspect of their influence is their short length. We are by no means suggesting that scholars only write in that format, but we strongly believe that research findings that cannot be presented in that format are unlikely to shape policy. Therefore, our recommended model is one in which a scholar publishes his or her findings in traditional scholar outlets such as books or journals but also writes shorter and more accessible pieces reporting the same findings and telegraphing their policy implications in policy journals, opinion pieces, or even on blogs.
Finally, a related issue is accessibility:
‘Policymakers find much current scholarly work – from across the methodological spectrum – inaccessible. Policymakers don’t want scholars to write in Greek or French, but rather just plain English.’
Translation: tell better, clearer, shorter stories and you may actually be listened to
