​​​​​​​​​​​​​​​​​​​​​​​

What We Did​​

​​ Students in a lab

What We Did

While the CSU system graduates nearly 120,000 undergraduate and graduate students into the workforce each year and 13,000 students participate in nearly several hundred STEM service-learning courses, California does not have data on how service learning impacts common measures of student success, nor is it differentiated by type of student.

Improving the information available about the relationship between service-learning courses and students' academic development has the potential to inform faculty preparation along with support for students' overall academic success, career development and civic engagement. This deeper understanding has the capacity to inform curriculum standards, statewide policy, and formulas for funding and facilities allocation.​​​​​​​​​​​

What is Service Learning?

Service learning is an innovative form of experiential education in which learning occurs through a cycle of action and reflection as students work with others through a process of applying what they are learning to community issues. Students reflect upon their experiences as they seek to achieve real objectives for the community and deeper understanding and skills for themselves (CSU Chancellor's Office, 2020).

Why Study Service Learning in STEM Disciplines?

The CSU believes that service learning can provide engaging and meaningful experiences for our STEM students while actively creating a more skilled STEM workforce. A dynamic process, service learning is a collaborative experience that promotes skills associated with teamwork, community involvement and citizenship. Since 1998, the CSU has seen a 114 percent increase in service-learning courses across all disciplines.

The chart below highlights how service learning in STEM disciplines has developed since the CSU began a systemwide effort in 2010 to increase the number of STEM service-learning courses.

Undergraduate STEM Service Learning Courses 2009-2017 


Design & Study Phases

The original research study used a quasi-exp​​erimental design and mixed-methods approach to investigate the research questions. Due to a smaller sample size than expected, particularly in the control group, the original data collection efforts were enhanced by adding secondary data analyses using other CSU students that were not in the treatment group as carefully matched controls. With this new matched group longer term study outcomes were compared.  

Study Phases

The study was conducted in four phases beginning in summer 2014 through spring 2018.​

Su​mmer 2014​​​​
Fall 2014 – Fall 2016
Winter 2015 – Fall 2017
Fall 2017 – Spring 2018
Set-up and instrument development
Implementation and data collection
Analysis
Dissemination​

Back to Top ↑


​​​​Research Objectives & Questions

Understand the Landscape

  • How is service learning in STEM currently being implemented given the vast range of interpretations of service learning? See Findings
  • What are the common underlying elements in service learning implementation? See Findings
  • To what degree are the essential elements of high quality service learning present in participating courses? 

Determine How the Quality of SL Relates to Student Outcomes

  • Does service learning in STEM disciplines have a positive impact on student success in 3 outcome areas: academic achievement, career development, and civic engagement? See Findings
  • Are there differential results with respect to these outcome areas for students depending on the quality of the service-learning course experience? See Findings
  • Does service learning in STEM disciplines promote access to the professional realm for students or bring about meaningful change to the structure of undergraduate training, particularly for underserved populations?
Back to Top ↑

Study Instruments

Multiple measures were used to assess implementation of participating STEM service-learning courses.  

Understanding the Essential Elements of Service Learning

Eight essential elements of service learning emerged from the literature, student ratings and initial analysis.

The research team culled the literature on service learning and identified 15 key areas defined by the field such as reflection community need and linkages to learning outcomes. Survey items were developed for faculty and student surveys with the goal of statistically combining items into a smaller number of scales and determining which items were strongly related. Because no clear pattern emerged, the research team reviewed the survey items again and statistically tested whether item groupings represented distinct components of quality. Six components of quality were initially identified. 

Student ratings were then used to develop internal consistencies for components that had two of more questions, determining the relationship between the items that belonged together.  A reliability analysis was performed to determine multiple items for most categories outlined in the table below. 


 




Service Learning Elements & Reliability​ Coefficients

Future work would require researchers to develop more items in each category to increase the consistency of each element. See Michigan Journal of Community Service Learning article (Vol 26, Issue 2, Summer 2020) for more inform​ation.


​ ​​
Number of Questions
Reliability Alpha
Reflections
5
0.94​
Value Focus
4
0.92
Collaboration with Community
3
0.88
Addressing Community Need
3
0.83
Linked to Academic Content
2
0.83
Communication with Community
3
0.74​
Service-Learning Preparation
1
N/A​
Learning Objectives
1
​N/A​
​​​​



Study Measures: Faculty & Student Survey Instruments

Student Civic Engagement and STEM Career Interest Survey included the Civic Engagement scale (Doolittle & Faul, 2013) and STEM Career Interest scale (ITEST Program 2010).

Other Measures

  • Student academic achievement data from Institutional Research (IR) offices including student achievement data related to grades, retention, graduation, and student demographics.
  • Course syllabi: Each faculty member was required to submit a copy of their syllabus for each treatment course. These syllabi were coded by a service-learning content expert according to the Fundamentals of Service-Learning Course Construction (Heffernan, 2001).
  • 1-Year follow-up of student civic engagement attitudes & behaviors; career interest and awareness in STEM
Back to Top ↑

Study Samples

A descriptive overview of participants in the study are outlined below.

Campuses:

  • CSU Dominguez Hills
  • Fresno State
  • Cal State LA
  • CSU Monterey Bay
  • CSU Northridge
  • Cal Poly Pomona
  • Sacramento State
  • San Jose State 
  • CSU San Marcos
  • Stanislaus State
CSU campus map of california  
Back to Top ↑

STEM Disciplines In the Study

The National Science Foundation's definition of what constitutes as STEM was used to recruit faculty participants; however, CCE does not include social sciences in its definition.

Faculty & Student Participants

47 faculty members were recruited, some of whom taught multiple sections of the same course during the same term; therefore, faculty and student data across courses were combined, or clustered together.

Of the total number of student respondents, 2,065 were unique students (i.e., participated in the study one time), about 80% of whom were in the treatment group.