Learning Assessment Process Plan
In 2014, the Integrated Planning and Performance Excellence (IPPE) office implemented a new software platform, eLumen, to help achieve our assessment goal and help analyze the massive amounts of data anticipated when it came to reporting on student learning outcomes. Like other new initiatives, it took time for faculty and student success staff to adapt to this culture shift.
When eLumen was first launched, the faculty participation rate was 42%. However, through continued training, creation of quick guides and videos, and a marketing campaign, the adoption rate climbed to 95%. Through the implementation of eLumen, San Antonio College has been able to collect the evidence of direct assessment from faculty. However, faculty are only one part of the greater assessment conversation.
San Antonio College’s IPPE office leverages the strengths of the three offices within it, Institutional Research, Strategic Planning, and Learning Assessment to triangulate the data collected regarding learning assessment. This allows us to discover new perspectives to support all students.
San Antonio College currently implements assessment of Student Learning Outcomes (SLO) at the individual course and student level. Instructors assess every student’s mastery of each course-level learning outcomes according to a standard defined by the discipline. Course Student Learning Outcomes (CSLO) are mapped to the program competencies using standardized rubrics. The results of the individual student-outcome data, collected from every instructor, is aggregated to produce a measure of the attainment of program competencies. The data is collected throughout the semester and not later than the same day final grades are due through the use of the online software platform, eLumen.
Where possible, multiple direct measures will be utilized and supplemented with valid indirect measures for each core objective. Assessment methods and data will be integrated into existing assessment strategies and used for both core curriculum and degree-specific programmatic improvement.
Under each of the program competencies, San Antonio College has defined between four and seven “Focus Areas” that span the scope of the competency. To develop a curriculum map, San Antonio College has defined three categories for three levels (SLO, CSLO, and PSLO/Marketable Skills) at which a competency can be “engaged.” Link to MARKETABLE SKILLS Page
The mapping process begins when the SLOs are mapped to the PSLOs or Marketable Skills.
Because it is possible that a course may have multiple outcomes that address different Focus Areas of the same competency, there will be multiple ways to engage a competency in a specific category. Using this technique, San Antonio College will ensure that students get broad coverage of all the general education competencies by completing the core curriculum. It will also permit the college to identify and address “deficiencies” in the curriculum where one or more competencies fail to be covered comprehensively.
Academic Success: Faculty Assessment Timeline
Student Success: Department Assessment Timeline Link
Though only administered on a two-year cycle, specific items from the Community College Survey of Student Engagement (CCSSE), will serve as an indirect measure of attainment for the general education competencies supplementing the direct measures obtained from assessing course SLOs. On an annual basis, specific questions using the San Antonio College survey of graduates, student course evaluations, and the college’s Key Performance Indicators (KPIs) will also serve as indirect measures of competency attainment. Additionally, relevant non-periodic reports, ad-hoc focus groups, and other appropriate measures that may be identified later will be used to further supplement the other direct and indirect measures of competency attainment.
For more information, visit Evidence of Student Learning
The IPPE Learning Assessment office supports data informed decision making by producing annual, ad hoc, and real-time reporting. The office assists faculty, staff, program coordinators, academic chairs, and Student Success directors to generate and interpret reports from the eLumen assessment platform directly. The office also generates and updates reports.
Elumen Generated Reports
- SLO By Term report - Student learning outcomes per faculty course section
- SLO Performance by Dept, Course and CSLO - Breakdown of achievement of each SLO by rubric
- Faculty Participation Report – Faculty completion of assessing SLOs and scoring of assessments
- SLO Performance Report – Supports office generated reports
- SLO Performance Marketable Skills/PSLO with Courses – Supports office generated reports
Office Generated Reports
- Program Outcomes Report – Marketable Skills by program (AA, AS, AAT, AAT)
- Completion Report & DC Completion Report - Transparency – Faculty completion of assessing all SLOs for all sections by assessment due date. Completion reports by percentage completed from Fall 2016 to present
- Non-Complete report – History of faculty that have not completed assessment by the due date
- Graduate Report: Marketable Skills achievement by academic year graduates
- PSLO Outcomes report - Program Student Learning outcomes by program
- Marketable Skills Outcome Report - Marketable Skills achievement by Discipline Rubric
- Student Success Marketable Skills Reports – 1) By Area, 2) All context
For more information, visit Evidence of Student Learning
All of the Arts & Sciences programs develop a three-year assessment plan with direct and indirect measures, routinely complete a data collection and analysis process, identify areas for specific improvements, and prepare an annual learning outcomes assessment report. The annual program report documents the cycles of continuous improvement wherein assessment data are reviewed, areas of success and concern identified, and curricular improvements identified and recommended. Program faculty/staff then discuss and implement recommendations to “close the loop”.
For more information, visit the SAC SCORES webpage
To further engage student in understanding and exploring their learning outcomes, the IPPE Learning Assessment office seeks to launch SLO Badging in Fall 2020.
To get involved, contact: SAC-SLOS@alamo.edu