The Undergraduate Program Continuous Improvement Policy specifies the procedures that the Department follows to ensure continuous improvement of its undergraduate degree programs. The Department recognizes that in order to provide a high quality program that meets the needs of its undergraduates it must make use of multiple forms of feedback and assessment to collect the data it needs to evaluate the current status of the program and to make sound recommendations for improvement.
To guide this process, the Department has established a set of program outcomes and program objectives for the BS degree program. Outcomes are statements made about the skills and capabilities of senior Computer Science majors at the time they graduate. Objectives are statements made about the skills and capabilities of Computer Science alumni approximately three to five years after they graduate. The truth of these assertions is established via the assessment and evaluation mechanisms described by this policy.
The process used by the Department includes the following:
This information is then used by the Undergraduate Committee to make changes in the program to address problems and improve quality.
All undergraduate Computer Science courses (with the exception of special topics courses, independent study courses, and courses for non-majors) are required to implement the following policies related to course assessment:
Each undergraduate course will be assigned a course coordinator tasked with the goal of managing the course, setting course-related policies, establishing course objectives and learning goals, and ensuring consistency across different instances of the course. In addition, the course coordinator is responsible for following the policies stated here to ensure that changes to the course are applied in response to continuous improvement data. The specific responsibilities of a course coordinator are to
The Undergraduate Committee is in charge of maintaining this list of responsibilities and may make changes to it on a semester-by-semester basis.
The course profile includes the following information:
The course profile is used to track important information about a course and represents a contract as to what is taught in the course and what the Department can expect from students that successfully complete the course. The profile also provides information about a course that is needed during reviews of the Department by ABET (Accreditation Board for Engineering and Technology).
The Undergraduate Committee must review any changes to a course profile before these changes become official. This review ensures that consistency across courses is maintained and that any changes related to course outcomes do not adversely affect courses dependent on those outcomes.
Faculty Course Questionnaires (FCQs) are administered by the University every term for each instructor of each class taught. FCQs allow students to rate their instructors and courses and provide information to instructors for teaching improvement, to students for course selection, and to deans and chairs for management. Detailed FCQ results are available on the CU Faculty Course Questionnaire website, while summaries of FCQ results for Computer Science courses are available at Computer Science Faculty Course Questionnaires.
The course coordinator must review the FCQ results for the course as soon as the results are available each time the course is taught. FCQ results are usually available near the beginning of the following semester. The review must include:
The results of this review will be documented in the Course Assessment Document.
The course coordinator must update the Course Assessment Document of a course during the semester after an instance of the course is taught. This update should occur after the FCQ review is created as that review must be stored in the Course Assessment Document. In addition to the FCQ review, the course coordinator must discuss the performance of the class for each of the course objectives and provide evidence for this assessment.
As an example, if a course outcome is that:
Then the instructor must state what percentage of the students mastered this outcome and tie this assessment to evidence that backs the statement. For instance, for the previous outcome, an instructor might say
After discussing each course outcome, the coordinator must discuss the implications of these individual assessments on the course overall. For instance, if students are struggling to achieve certain outcomes, what changes will the instructor make to improve student performance the next time the course is taught?
The Course Assessment Document will be stored online in a manner that allows faculty to review previous versions of the document and to edit and/or upload new versions of the document each time the course is taught. The Undergraduate Committee is responsible for reminding faculty to update these documents in a timely fashion and to track the response rate until all updates for the previous semester are complete.
To assist in the Department's goal of improving the quality of its undergraduate program, the Undergraduate Committee is adopting a uniform policy with respect to the collection of course materials from undergraduate courses into course dossiers. These dossiers will be used in conjunction with the Course Assessment Document to provide tangible, external evidence that can be evaluated to assess the quality of each undergraduate course. This information is also useful for maintaining high-quality course dossiers that must be presented to ABET reviewers during an ABET site visit.
Course dossiers consist of the following items:
The course coordinator is tasked with acquiring representative examples of the above material and providing them to the Main Office Administrator in ECOT 727 for online storage each time the course is taught:
This should be done anytime course material changes significantly. Significant changes, of course, should be documented in the Course Assessment Document either in the semester before the change is made or, at the latest, in the semester after the change occurred.
Senior Thesis and project team-based courses have some additional guidelines for creating the course dossier:
The final thesis document of an undergraduate senior thesis must be submitted to the Main Office Administrator in electronic form to be stored online.
In project team-based courses, artifacts such as documents and source code often undergo multiple changes throughout the semester. Rather than collecting each version of each artifact, the course coordinator should collect only the completed project for each team for submission to the Main Office Administrator. Projects completed by three project teams -- representing low, medium, and high performing teams -- should be submitted. The course coordinator should make a best effort to conceal the identity of the team members with the understanding that this can sometimes be impractical given the size and nature of the material.
The Undergraduate Committee is responsible for coordinating with the Main Office Administrator to ensure that materials are collected for each instance of an undergraduate course and to assist in the process of collecting material from each course that was taught during the previous semester. In particular, a reminder asking for course materials will be sent at the end of the last week of classes. A second reminder will be sent at the start of the first week of classes of the next semester. Finally, a third reminder will be sent starting on the third week of the semester after a course has been taught, with weekly reminders sent until the required materials have been acquired.
Each year, the College of Engineering and Applied Science administers a number of surveys to collect information from various College stakeholders -- students, alumni and employers -- which can be used to assess the quality of the College's departments and programs. These surveys include the
The Undergraduate Committee will make use of the data from these surveys as one point of independent feedback concerning the quality of the BS degree program and whether or not the goals of the program as stated by the program outcomes and program objectives are being met.
In lieu of an exit exam, the Department will have aspects of its undergraduate program reviewed annually by an independent review board, typically comprised of members of the Department's Advisory Board and other qualified external reviewers. The board's job will be to provide external evaluation and feedback on the Department's goal of continuously improving its undergraduate program.