NSLLP

Goals

The National Study of Living-Learning Programs (NSLLP) is a national, multi-campus study of Living-Learning Programs (LLPs) in colleges and universities. Principal investigators (PIs) Drs. Karen Inkelas and Aaron Brower approached SSG to assess whether students who participate in these programs enjoy any measurable advantages over their non-LLP counterparts. They hoped to quantify the academic, social, and developmental outcomes of LLP participants by combining a theoretically grounded model of college student development with sound research methodology.

Comparing student outcomes within a particular institution was important to the research, but the PIs wanted to draw such comparisons between institutions across the country. They were particularly interested in consolidating this data to evaluate whether certain LLP practices correspond predictably to student outcomes.

Challenges

There were few resources of adequate quality upon which to model our efforts; although many individual assessments had been conducted, existing assessment tools were not specific enough for LLP outcomes, and there were no data or benchmarks for national comparison. Since surveys of general college student populations are often characterized by poor methodology, they proved similarly unreliable.

Solutions

SSG designed a study plan for online administration at multiple campuses. It featured:

  • Solid web survey design
  • Control sample of non-LLP students
  • Strong sampling methodology
  • Nonresponse weighting
  • Extensive documentation

We collaborated with the principal investigators to develop a questionnaire for online administration. The instrument, designed around the IEO (Inputs-Environments-Outcomes) model of student development (Astin, 2001), is theoretically grounded as well as methodologically rigorous.

This methodologically sound design was complemented by equally rigorous implementation and reporting strategies. SSG managed school participation across the entire project, including:

  • Recruitment
  • Orientation
  • Preparing for data collection
  • Daily monitoring and reporting response rates during data collection
  • Preparing and distributing individual reports
  • Assistance with data interpretation

Our assistance duration data collection—which also covered such diverse services as sample management and respondent support—allowed the PIs to focus on their research questions instead of struggling with the details of administering a study of this scale over multiple institutions.

After two years of data collection, the PIs were recognized with a significant grant (in excess of $1 million, or three years of funding) to study LLPs to expand their study of LLPs using qualitative methods. The NSLLP has been administered by more than 50 institutions and is now offered annually, with the option of a longitudinal administration to collect further data about previous respondents. It is constantly refined and updated to meet the needs of participating institutions—such as the new, optional module for assessing mental health issues.

Policy Decision