Assessing Sustainability Literacy: Challenges, Current Research, and Opportunities for Collaboration
Sustainability literacy is a topic of increasing interest among a growing number of higher education sustainability staff and faculty. Formal education programs and courses that address sustainability are becoming increasingly common. However, there currently exists no standardized tool or method to assess the sustainability literacy of students. Although the concept is not new, and discussions have occurred in the past, new conversations have emerged, in part because of preparation for STARS version 2.0 and research that other institutions have completed in this area.
This blog article focuses on current STARS data for ER 13: Sustainability Literacy Assessment. It also looks at the results from a recent campus survey from Ohio State University that was presented at AASHE 2012. Finally, it concludes with ideas and opportunities for collaboration.
The Challenges of Conducting Sustainability Literacy Assessment
| STARS Fact |
|---|
| Within the ER category of STARS, the lowest-scoring credit based on average percent of applicable points earned is ER 13: Sustainability Literacy Assessment. With two points available for the credit, one point is awarded for conducting an assessment of sustainability literacy of students, while two points are awarded for also conducting a follow-up assessment of the same student cohort. STARS reports showed that 21% of institutions conducted an assessment of student sustainability literacy, but only 12% of institutions received full points by also conducting a follow-up assessment. |
The challenges to conducting sustainability literacy assessment are numerous, at least partly explaining the low scores in ER credit 13.
- Developing an assessment and methodology that provides meaningful results can be difficult
- Analyzing and interpreting the results can be time-consuming
- Buy-in from administration may not be there
- Students may already be experiencing survey fatigue
- No central assessment tool currently exists
There exists room for improvement and fortunately, there is a growing interest and enthusiasm on the topic of sustainability literacy assessment. At the AASHE 2012 conference in Los Angeles, Adam Zwickle and Tom Koontz from the Ohio State University (OSU) engaged participants in a discussion and presentation on the research findings from OSU’s sustainability literacy survey.
Implementation: OSU’s Sustainability Literacy Survey
Faculty and students at OSU’s Environmental and Social Sustainability (ESS) Lab developed a sustainability literacy survey instrument to measure multiple domains of sustainability knowledge. STARS’ ER credit 13 was cited as among the drivers for developing the instrument.
OSU’s sustainability assessment measured knowledge of sustainability as well as student values and beliefs in two survey segments. The sustainability knowledge segment was is built upon a “triple bottom line” approach, including an equal number of environmental, social, and economic questions. This portion of the survey included 30-questions on sustainability literacy, though this was later reduced to 16 questions. With several value-based questions included, the survey was sent via email to 10,000+ undergraduate students at OSU. Although no participation incentive was used, non-response email follow-ups were sent to help boost participation.
Results: Sustainability Literacy at OSU
OSU’s survey ultimately garnered a 19.3% response rate – a higher-than-expected rate, according to OSU researchers. The overall average score for OSU undergraduates was 69%. On average, students answered correctly 73% of environmental questions, 71% of social questions, and 61% of economic questions. A gradual increase in scores according to class level was found to be significant, as depicted in the graph below.
OSU Sustainability Literacy Results by Class Level

OSU researchers are using data collected from both portions of the survey to test for correlations between sustainability literacy and student values, attitudes, and behaviors. The findings suggest that, although respondents tended to have slightly more liberal and environmentalist views, these differences were found to be non-significant. Researchers also found that students who took the survey only after complying with one or more requests for follow-up were slightly more likely to get a subset of the sustainability knowledge questions wrong.
Opportunities for Collaboration
An outcome of the discussion following the OSU presentation was a strong desire to collaborate in the development of a common assessment tool that could be used by numerous colleges and universities. OSU researchers have spoken with representatives from several institutions, though commitments have not yet been made. Through this blog, AASHE hopes to further raise awareness on the topic of sustainability literacy assessment, and continue the dialogue on collaboration for the development of a common tool.
Should AASHE take a role in leading the development of a common sustainability literacy assessment tool? If so, in what specific ways can AASHE assist in the process? Readers can contribute to the dialogue by providing feedback below, or they can ask questions and provide suggestions at stars@aashe.org.
Browse by Topic
- AASHE Biz
- aashe2008
- aashe2011
- aashe2012
- Buildings
- Climate
- Co-Curricular Education
- Community Engagement
- Connecting the Dots
- COP15-HE
- Curriculum
- Dining Services
- Diversity, Access, and Affordability
- Energy
- Events
- Faculty and Staff Development
- Financing
- Government & Legislation
- Grounds
- Human Resources
- International
- Interviews
- Podcast
- Presidents & Chancellors
- Purchasing
- Research
- Rio+20
- STARS
- Transportation
- Videos
- Waste
- Water

Yes!
I would LOVE to see AASHE play more of a leadership role in developing a standardized sustainability literacy assessment tool. The work that AASHE is doing with the sustainability module for NSSE is valuable and important but it is not a substitute for a measure of sustainability literacy.
Right now, in absence of leadership from AASHE, many institutions - including my own - are trying to muddle through this ourselves and it's enormously inefficient. Reviewing past efforts to measure sustainability or environmental literacy, examining the academic literature on the topic, and then getting folks on campus to agree on the assessment methodology and questions takes an incredible amount of time and, if we actually get to the implementation stage, we get results that aren't comparable to results at other campuses. Reducing this kind of reinvention of the wheel on every campus is exactly the kind of thing that AASHE is well-positioned to do.
Judging by my conversations at AASHE 2012, more and more campuses are looking for a way to evaluate the success of their sustainability education efforts. I worry that the longer AASHE waits to get involved, the harder it will be to get everyone on the same page.
In terms of the the "how," I think the development of this tool should proceed similar to how STARS was developed. Pull together a committee of experts (both academics and practioners) to review past efforts and develop a draft for public comment. Revise the draft based on the feedback and make it available for use. Continue to refine it over time in response to user feedback.
Thanks for the feedback,
Thanks for the feedback, Julian. I can see how a sustainability literacy assessment that is also comparable with other campuses would be immensely helpful. Let's hope that the project with NSSE will provide insights that will bring us steps closer to developing a standard tool. Like STARS, I imagine that this type of assessment tool would evolve over time after its release, requiring regular updates. A key challenge, therefore, will be developing a plan for implementation that will endure.
Sustainability Cultural Indicators Project at Univ. of Michigan
At U-M we have been working on the Sustainability Cultural Indicators Project (SCIP) for over a year. This efforts builds from our Campus Sustainability Integrated Assessment which identified 4 goal areas - Climate Action, Waste Prevention, Healthy Environments, and Community Awareness - more at: http://graham.umich.edu/ia/campus.php
After reviewing instruments from many other institutions and several national surveys such as the National Survey of Student Engagement and the Cooperative Institutional Research Program Freshman Survey we worked with our Institute for Social Research to develop a 60 question instrument for students and a similar instrument for faculty and staff.
We have just completed the first round of data collection and we plan for more than 4,000 students and 1,500 faculty and staff members to be surveyed annually for the nest 5 years about sustainability issues. Key areas of inquiry include transportation, waste prevention and conservation, the natural environment, climate change, campus initiatives, and participant demographics. Reports of survey findings will be provided to related units on an annual basis, so they may continuously monitor trends and developments in sustainability awareness and behavior on campus.
We are very interested in talking with other institutions about collaboration and whether a standard tool could be developed. More on SCIP at: http://graham.umich.edu/news/article.php?nid=2357
Thanks for sharing these
Thanks for sharing these resources, John. I look forward to learning more about the first round of assessment testing. We'll keep you posted about opportunities for collaboration as well!
Monika