Reviewers

BROADER IMPACTS: WHAT ARE THEY AND HOW ARE THEY REVIEWED?

All NSF proposals are evaluated based on two criteria: Intellectual Merit and Broader Impacts. Intellectual Merit is reviewed on the value of the science, the potential for the planned investigation to result in impactful outcomes that advance knowledge, and the ability to assess success. But how does Broader Impacts work?

Occasionally, NSF Program Directors will see reviews of Broader impacts that say “The PI plans to do X, Y and Z broader impacts activities. This is a strength of the proposal.”  

We know this isn’t helpful for the PIs, and they aren’t helpful to the Program Director, so we ask reviewers to think about why Broader Impact efforts are a strength, how they benefit society or expand the reach of the science, and/or how they build capacity – either for the individual, their lab, or the institution.

We also want to know whether what the PI has laid out as a plan to accomplish those goals is doable and sufficiently resourced. Thoughtful evaluation of broader impacts will help the PI in carrying out their work, help NSF, and lead to better broader impacts activities with more benefit to society. MCB encourages reviewers to provide reviews that they themselves would find useful as PIs – constructive evaluations highlighting aspects of the proposed activity that were done “just right” as well as aspects that could be improved.  Good reviews help PIs improve not just their proposals, but also the works that eventually gets funded. 

In writing the Broader Impacts statement, we encourage the PI to be thoughtful in what they want to accomplish and how they will accomplish it. Is the activity something that interests them and has measurable outcomes? Are funds requested to support the activity or to help with assessment. Examples of Broader Impact efforts can include teaching, training, and learning; broadening participation of underrepresented groups; building or enhancing partnerships (including across multiple sectors); broad dissemination of the science or technological understanding; enhancements to infrastructure both at your home institution and in developing countries; and/or local impacts like policy or land use.

What are some resources to help think about Broader Impacts (and evaluate them if you are a reviewer)?

NSF provides PIs and reviewers with information about both merit review criteria in the Proposal and Award Policy and Procedure Guide (link).  Additional information on Broader Impacts activities can be found in this document or at this blog post. You can also view the recording and slides of MCB’s Broader Impacts Virtual Office Hour.

The NSF funded Center for Advancing Research Impacts in Society provides helpful guidance on how to evaluate broader impacts in this brochure.

And, of course, the MCB blog has posted about Broader Impacts – including some examples – in the past. You can read all the posts tagged as “Broader Impacts” at https://mcbblog.nsfbio.com/tag/broader-impacts/.