ASSESSMENT PLAN
Revised (1994-95) The department
now has three capstone courses. CSIS 496 Seminar in Computer Science is the long-standing
capstone course for computer science majors, CS comprehensive majors, and Airway CS
majors. CSIS 497 is a new capstone course this year for computer information systems
majors and comprehensive CSI majors. CSIS 880 is the capstone course that is offered every
third summer for the CSIS component of the MSEd in Instructional Technology.
Students in the capstone courses produce
software packages or equivalent products of a marketable quality while demonstrating the
ability to work with team members, to analyze, design, program and maintain a system, and
to use the tools of the field. The later includes selection of and proficiency in an
appropriate computer languages, computer assisted software engineering tools, operating
environment, and project management software. Students are also required to demonstrate
professionalism while engaging in their team work and presenting the team's results at
year end.
Capstones courses culminate in formal
presentations to which the entire campus community is invited. Oral questions and written
evaluations are solicited from all present. The senior faculty then evaluates the projects
and suggests any program upgrade that is indicated. Capstone Course (1992-94) Students in
the capstone courses, CSIS 496, produce software packages of marketable quality while
demonstrating the ability to work with team members, to analyze, design, program, and
maintain a system, to use the tools of the field, i.e. selection of and proficiency in a
language, selection of and use of computer assisted software engineering, and selection
and ability to use an operating environment, and to display professional attitudes for
presentations. The capstones culminate in a campus wide presentation of the projects.
Questions and evaluations, both oral and written are solicited from all present. The
senior faculty then evaluates the projects and suggests any program upgrade that is
indicated. |
2000-2001 ASSESSMENT
In spring 2001, 33 students completed the capstone Senior Seminar in Computer Information
Systems class and 17 students completed the Senior Seminar in Computer Science class. A
major component of each of these classes is a team project that involves the development
of a software system for a client. Clients are solicited from both departments on campus
and local businesses. Eleven different software systems were developed for 11 separate
clients.
At the conclusion of the semester the students demonstrated their projects in a public
forum attended by clients, departmental faculty members, and students. All attendees were
asked to complete an evaluation form at the end of each presentation. Over 565 evaluation
forms were collected and analyzed. Evaluators were asked to rate each project and
presentation on a Likert scale. Analysis of the table below indicates that the overall
rating of the projects was excellent. Over 80% of the respondents rated the products and
presentations as either above average or superior. Only about 2.5% of the respondents
rated the products and presentations as inferior or below average.
Percentage
of evaluations in each category |
Question |
Inferior |
Below
average |
Average |
Above
average |
Superior |
How would you rate the quality of the
product? |
1.2% |
1.2% |
16.7% |
46.2% |
34.6% |
How would you rate the quality of the
presentation? |
0.0% |
2.5% |
12.35% |
41.98% |
43.2% |
From the information
described above the faculty of the department concluded that students in their senior year
are able to assess a clients needs, build a high quality software product, and effectively
present that product to a varied audience. |
1999-2000 ASSESSMENT
In spring 2000, twelve computer science students and thirty-one computer information
systems students enrolled in and completed CSIS496 Seminar in Computer Science or CSIS497
Seminar in Computer Information Systems. In addition to engaging in a deep study of ethics
in the information age, the students worked in teams to accomplish live, complex projects.
At the end of the semester, they presented the results of their efforts to be judged by
the CSIS faculty, by professionals from the university and the community, and by their
peers.One
team created the web site for the Buffalo County Offices.
Two groups reversed-engineered and recreated software for campus offices; one was a
payroll package for the Calvin T. Ryan Library; the other, a database for the Student
Employment Services office. Five teams accomplished projects for Kearney Public Schools.
Some of those related to the maintenance work order system that was built by seminar teams
in 1999. Others revolved around a new system to handle employment applications. The KPS
projects involved creating or expanding database applications or building web interfaces
for those applications. The economic impact of such projects is $120,000, using
conservative estimates of 300 man-hours per project and a $50 per hour rate that a
consultant might have charged for the same projects.
Computer science senior seminar students
performed as well as teams had in past years, with an average grade of "A" and
the lowest grade of a "B." Therefore, the CSIS faculty judged that the computer
science portion of the department is operating as it is designed. However, the grade
distribution for the computer information systems senior seminar class was somewhat
disappointing. The class average was a "B" and only four students earned grades
of "A." Many students would have received higher grades except for their
performance on the project. The faculty will examine the situation closely in the fall to
determine whether the grade distribution was an anomaly or whether program changes are in
order. |
1998-99 ASSESSMENT
Over the past year, thirty-one students enrolled in and completed capstone courses.One of the capstone courses, CSIS880 Seminar in
Educational Technology, was not offered in 1998-99 as there were no students in the
M.S.Ed. in Instructional Technology program ready for that course.
In spring 1999, sixteen computer science
students in three teams completed CSIS496 Seminar in Computer Science. One team worked on
web-based software for Nebraska Public Power District and for UNK offices. The other two
teams worked on various aspects of elaborate programs for a firm in Austin, Texas.
Also in spring 1998, fifteen computer
information systems students in three teams completed CSIS497 Seminar in Computer
Information Systems. Two teams created software for Kearney Public Schools to manage work
orders and to track inventory. The third team reverse engineered and upgraded a software
package for Nebraska Public Power District.
All seminar teams performed very well and
students effectively demonstrated their prerequisite knowledge to the facultys
satisfaction. The final projects were well done and the presentations were thorough. The
outcomes of these capstone courses indicate that the curriculum is fundamentally sound and
no major changes are in store. |
1997-98 ASSESSMENT
Over the past year, fifty-five students enrolled in and completed capstone courses. In July 1997, twenty-eight students participated
in CSIS 880 Seminar in Educational Technology, cooperating in six teams to create
templates to be used to package courses for on-line and web-based delivery. Team members
demonstrated well their grasp of the fundamentals of the CSIS courses in the MSEd in
Instructional Technology program, as well as considerable creativity as they generated six
widely differing templates.
In spring 1998, eleven CS students in two
teams in CSIS 496 Seminar in Computer Science greatly expanded upon the concepts designed
by the CSIS 880 students. They created a template for UNK Natural and Social Science
departments to use to build their departmental web pages, some of which will include
web-based instructional materials. The CS seminar teams also developed the web sites for
several campus departments (Economics, Alumni Association, Intramural Sports) as well as
outstanding UNK campus and UNK web site maps.
Also in spring 1998, sixteen CIS students
completed CSIS 497 Seminar in Computer Information Systems. As two teams, they completed
two complex systems for Kearney Public Schools. The inventory control system and the
maintenance request tracking system were each written in File Maker Pro database system
(the choice of KPS) and are designed to allow administrators from each school building to
interface with the system through the web.
All seminar teams performed very well and
students effectively demonstrated their prerequisite knowledge to the faculty's
satisfaction.
The final project presentations in
CSIS496 and CSIS497 were extremely creative and the consensus was that all four were among
the all-time best seminar presentations. The outcome of these capstone courses indicate
that the curriculum is fundamentally sound and no major changes are in store. |
1996-97 ASSESSMENT
This past spring, fourteen computer science students and fifteen computer information
systems students participated in the capstone courses taught be Drs. Jussel and
Messersmith, respectively. All
senior seminar group projects were very well done. CIS students developed three separate
accounting information systems. The systems were for payroll, accounts receivable and
accounts payable applications.
CS students engaged in projects to
implement UNK's new world wide web page format. One activity was to develop templates
which allow campus departments to easily create and maintain departmental pages in
compliance with the new UNK standards. Other activities included creation of more
elaborate pages for specific departments such as admissions and the graduate office. Those
pages allow prospective students to submit information via the web to get additional
enrollment information. |
1995-96 ASSESSMENT
Seven students completed CSIS496 Seminar in Computer Science and eight completed CSIS497
Seminar in Computer Information Systems. The average grades for both courses were B+/A-
and the lowest grade was a C.
That indicates that the students were prepared by previous courses to succeed in seminar
and on the job. In 1995-96, minor
changes have been made to several courses based on student performance in capstone
courses. The patterns of course offerings has also been changed to better prepare students
for their future successes. |
1994-95 ASSESSMENT
In the 1994-95 school year, forty-three students engaged in capstone courses. Twenty-five
MSEd in Instructional Technology students successfully completed CSIS880 Seminar in
Instructional Technology. There were fourteen students in CSIS496 Seminar in Computer
Science and four in the inaugural offering of CSIS497 Seminar in Computer Information
Systems The CSIS880, CSIS496 and
CSIS497 students combined a 2-3 person team approach to the study of ethics in the
information age. The teams researched and led the class in discussing specific topics in
ethics. In all cases, the students were capable of performing this task. The lowest grade
for these presentations was a "B" and "A-" was the average grade.
In CSIS880, students worked individually
to apply their knowledge of their chosen academic discipline, the knowledge of curriculum
development, and their skills in using the technology of the Internet to develop
Internet-based lesson plans. All performed very well in this effort. The result is a
collection of lesson plans for which the intention is to interest a publisher, with
students receiving credit for their efforts and monetary proceeds retained to support the
department in similar future efforts.
In CSIS496 and CSIS497, students worked
together in teams of four or five to create realistic software systems. The four CIS
(CSIS497) students analyzed, designed and constructed a mainframe COBOL accounts
receivable system. The emphasis of that project was on analysis and design. Three teams of
CS (CSIS496) students worked on projects that was more oriented toward engineering of
complex algorithms using object-oriented programming concepts and the TechoJock Pascal
code generator. The three projects were
- The Solicitor, a system for use by a
university foundation in its telephone gift solicitation campaign,
- The Grader, a system for use by university
faculty to maintain grade book pages and perform extensive cross analysis of students,
classes, and graded items, and
- The Evaluator, a system for use by
department chairs to analyze student evaluations of faculty in a wide variety of ways.
All CSIS496 and CSIS497 projects were
done well, judged to be at the "A" or "A-" level. The contribution of
individual team members was relatively consistent, with most students earning grades of
from "A" to "B" and a couple at the "C" level. When project
and ethics presentation grades were combined, all students passed CSIS496 or 497 with a
grade of "C" or higher.
Two significant problems arose with the
senior seminar team projects. First, teams had some trouble getting and staying on track
causing faculty to determine students' project management skills need to be addresses.
Toward that end, Professors Jussel and Carpenter had consulted to Nebraska Educational
Television Consortium for Higher Education (NETCHE) to create a 30-minute video called
"Making Your Team Work." Unfortunately, the video, which was supposed to be
ready for the beginning of the semester, did not arrive until final week. It will be very
useful in the future to improve the teamwork aspect of senior seminar classes.
The other problem arose in the final team
project presentations. Only one team made its presentation without significant computer
system problems. Ironically, that was the team which appeared to be the best prepared to
handle such problems.
Obviously, there needs to be better
instruction and more preparation for the team presentations. To facilitate that, the
presentations were video taped to be shown to next subsequent years' seminar students. To
overcome computer hardware and software difficulties, the CSIS department will plan to
replace classroom presentation systems before the next time the seminar courses are
taught. The entire university community was invited to the team project presentation
session. Those who attended were asked to evaluate the quality of the students' projects
and the quality of the presentations. Approximately sixty evaluation forms were turned in.
Most of the audience rated the quality of the presentations lower than the quality of the
systems being presented. Audience ratings of the projects were lower than the rating of
the course instructors. Obviously, the instructors knew the software more intimately than
did the audience, which formed its opinion based on brief exposure. The lower ratings
provide additional evidence that more work needs to go into preparing for the
presentations. The low quality of the presentation apparently adversely affected the
perception of the quality of the overall project. |
1993-94 ASSESSMENT
Sixteen students enrolled in and successfully completed CSIS496 Seminar in Computer
Science in Spring 1994. Students working in teams of two to research and lead class
discussions were evaluated by their peers and by the instructor; the lowest grade earned
for leading those discussions was a B and the average grade was an A-. The sixteen
students were each assigned to one of two project teams to complete a software maintenance
project. Each senior seminar student was required to evaluate the contribution of fellow
team members with most earning an A for this factor in the overall grade. No student
earned less than a grade of C for his/her contribution to the team. The two software maintenance projects were
performed very well and both packages are judged to be marketable. Both of the new
software projects undertaken by senior seminar students this year still need additional
work in order to be fully complete. One was judged by the instructor to be of A quality,
while the other was judged to be a C quality project overall.
Senior seminar students, were required to
give a twenty minute presentation on each of the four packages in a public session at the
end of the semester. Written feedback was solicited from those in attendance who were not
senior seminar students. Thirty-one evaluation forms were submitted, with evaluators asked
to rate on a five point scale the quality of the software and the quality of the
presentation. Ratings and other written comments align with the instructor's evaluation
discussed above. Three of the packages were judged to be quite good, with two of those
deemed to be marketable. The fourth package was rated to be an average product. Comments
were generally favorable regarding the four student presentations.
The various methods of evaluating the
skills portion of the senior seminar course all indicate that graduating seniors indeed
had been well prepared by their prerequisite course work. All of the senior seminar
students passed the course with at least a C and with the class average grade of an A-.
A similar computer information systems
senior seminar course has been added recently and will be offered in Spring 1995. |
|
assessment
home | department means
| department home
17 May 2005
academicpublications@unk.edu |