

PBA Home > Institutional Research & Analysis > Outcomes Assessment > Unit Summaries > University Mathematics Program University Mathematics Program The UMAP Program offers the college's main quantitative reasoning and mathematical skills course (QRMS1010/MATH 1012) as well as mathematics courses (MATH 1000 through 1100) given in a selfpaced module format. Mathematics Module Program: Students in this program take various numbers of onehour mathematics modules (e.g., college algebra, college trigonometry, etc.). The modules are mastery oriented, and students can make several attempts at different versions of each module's exams. In 199091 and 199192, students needed an average of 1.9 attempts to pass each exam, indicating that, in general, students were achieving minimum mastery levels without having to take exams an excessive number of times. In addition, students taking math module courses in 199192 and 199293 were surveyed to discover how the program could better provide services to them. In response to these statistics and other concerns regarding the number of attempts allowed, we will be reducing the number of repeated attempts at exams in Fall 1998 semester. Students from every department in the college take math module courses, each for his or her own reason. Further, students in any given module course can have widely varied backgrounds and preparations. The program's faculty advisory board planned to develop ways to group students coherently so that tailored sets of assessments can be used. As a first attempt, in Fall 1994 and Spring 1995, the program offered three sections of traditional nonmodular college algebra, specifically designed for students who have dropped math module courses several times in the past because they were unable to manage the selfpaced module format. About half of the 66 students in these sections had previously withdrawn from or failed selfpaced math modules. Only 4 dropped the instructorpaced course, and the average grade for those who had previously been unsuccessful in selfpaced modules was C+ in this course. Beginning in fall 1997, UMAP will again be offering this kind of traditional College Algebra course to meet the needs of those students who find the module method unworkable. Further attempts at reintroducing the traditional course structure have been unsuccessful. This is undoubtedly due primarily to the lack of resources that the program has to implement such a program without jeopardizing the current one. Pursuit of such resources will continue in hopes of achieving this goal. Currently, the administration of this program is trying to provide students with additional learning resources via the world wide web. We hope that response to this addition will be positive and will continue development in this direction as much as possible. Since fall 1996, the Math Module Testing Center has been offering two Math Placement Examinations on a walkin basis. The first determines readiness for entry level mathematics courses and the second is tailored to the first five Math Modules (college algebra and college trigonometry). In both cases, the scores of the students who take the exam are compared with their final exam scores in the corresponding Modules. Analysis of placement scores versus completion rates will be used to advise students in future semesters. Two additional placement examinations, Finite Mathematics and Business Calculus, are planned to be offered in the same manner to assist in assessing student performance in the six Business Mathematics Modules as well. QRMS 1010: In 199091 and 199192, pre and posttesting assessment was used in QRMS 1010. At the start of the term, a pretest of QRMS skills was given. The same questions were embedded in the final exam to serve as a posttest. The questions were written by teams of faculty members. Pretest and posttest scores of students who completed the course and took both exams were compared. In 199091, the minimum pretest score was 3 of 25 questions answered correctly, and the average score was 16.3 correct answers. The minimum on the posttest was 11 correct answers, with a mean of 19.1, showing that the students' skills had improved. 199192 results were similar. The UMAP Program suspended assessment of QRMS 1010 in 199293 and 199394 because of ongoing administrative and curricular restructuring of the course. The large lecture/lab format was dropped and replaced with one involving multiple small sections. Specific goal statements were developed for the revised course. These are:
Several assessment methods were piloted in 199495. The plan calls for assessing the skills mentioned in the first goal by including speciallywritten questions in the final exams of the various sections of QRMS1010. Exams and exercises were constructed cooperatively by all the instructors to keep evaluation fairly consistent across course sections that varied in their extramathematical content. In 199495, across sections, 95% of the students who enrolled completed the course, 5560% with grades of B or better. In 199596 across sections, 93% of the students who enrolled completed the course, 54% with grades of B or better. In assignments related to the second goal, students are asked to write papers devising questions from their own fields of study calling for quantitative analysis with the mathematical skills they have learned. A sample of these papers was evaluated by all QRMS instructors. Each instructor independently rated each paper in the sample, and their ratings were quite consistent with each other. Some students were very creative in thinking quantitatively within their own areas of interest; others were much less so. There did not seem to be any relationship between the students' mathematical skill levels (goal 1) and their creative application of their skills to their own fields of study. In 199596 sample papers were again independently rated by instructors. Surprising regularity was demonstrated this year as well. As a first attempt to evaluate progress toward the third goal, alleviating math anxiety, students in one fall 1994 QRMS 1010 section made pre and postcourse selfevaluations. At the start of each term in the past, QRMS 1010 students have been asked to comment on their own attitudes toward mathematics in general and this course in particular. In the selected section, a similar selfevaluation was made at the end of the term. Students' responses were categorized as negative, neutral, or positive. There were far fewer negative responses at the end of the term (2, vs 11 at the start) and far more positive ones (9 vs 1). This pilot comparison seemed promising. In 199596 pre and postcourse surveys were conducted in six of the nine sections. Three sections found the 199495 trend repeated: fewer negative responses (11, vs 40 at the start) and more positive ones (37, vs 18 at the start). Three other sections reported only changes in attitude: 34 students reported that their attitude improved, 17 that it remained the same, and 8 that it was worse as a result of taking the course. In future, an attempt will be made to extend the survey to all sections and to unify the style of reporting. Achieving the fourth goal, increased graduate student teaching skills, has been complicated by the fact that graduate instructors are assigned to the program for only a short time. Because only three of nine instructors continue from the Fall through the Spring, teacher training tends to focus on familiarizing new instructors with the goals and methods of QRMS 1010. With a constantly changing staff, there is little or no time to develop finer points of teaching style with those who do continue. To provide more stability, the QRMS 1010 director has suggested hiring at least two instructors that are not graduate students and requested that graduate student instructors be assigned to teach the class for two full years before rotating to other assignments. QRMS 1010 assessment was suspended in 199697 because of administrative changes in the program, and will resume in 199798. Due to further administrative changes occurring for 19971998, continuing the evaluative procedure outlined above proved difficult. Attempts to reinstate the meaningful methods used in previous semester are being made. In addition, much time has been exhausted on attempting to develop new methods of effective material presentation. Since these methods are still in development, full assessment of their effectiveness is not possible. As one example, an instructor, who taught one section in both Fall 97 and Spring 98, began moving towards a strictly webbased course. The intent is to provide the same skills as traditionally covered in the course and to open the door to further pursuits in various areas of interest, thereby addressing all 4 goal statements above. Although full implementation of the web has not been achieved and thus assessment of this method not yet possible, initial reactions from both students and instructor seem positive. It is hoped that a sound assessment can be created and, assuming positive response, that other sections might also incorporate this format for a larger assessment pool.
l:\ir\Outcomes\OA9798\ 
Last revision 07/12/02 PBA Home  Strategic Planning  Institutional Research & Analysis  Budget & Finances  Questions? Comments?  Legal & Trademarks  Privacy 15 UCB, University of Colorado Boulder, Boulder, CO 803090015, (303)4928631 © Regents of the University of Colorado 