ASSESSMENT PLAN
All mass communications majors will be required to select and compile relevant materials
(stories, photos, audio tapes, video tapes, advertisements) which chronicle proficiency in
their chosen areas of expertise. |
2000-2001 ASSESSMENT
This was the fifth complete year that portfolios were evaluated the
semester prior to each Journalism and Mass Communications student's
graduation. A total of 36 students had portfolios reviewed this
year. The percentage of evaluators selecting each of the responses
is shown on the evaluation instrument below. The scale for each item
was Strongly agree, Agree, Neither agree nor disagree, Disagree and
Strongly disagree.
PORTFOLIO EVALUATION STANDARDS
|
|
|
1998-99
Data |
|
1999-00
Data |
|
2000-01
Data |
|
2001-02
Data |
| Appearance |
| 1. |
"The portfolio is neat in appearance." |
|
Strongly agree/Agree |
|
84% |
|
97% |
|
94% |
|
96% |
|
Neither agree nor disagree |
|
9% |
|
1% |
|
0% |
|
0% |
|
Strongly disagree/Disagree |
|
7% |
|
2% |
|
6% |
|
4% |
| Organization |
| 2. |
"The portfolio is well-organized." |
|
Strongly agree/Agree |
|
75% |
|
80% |
|
82% |
|
69% |
|
Neither agree nor disagree |
|
5% |
|
12% |
|
6% |
|
18% |
|
Strongly disagree/Disagree |
|
20% |
|
6% |
|
12% |
|
13% |
| Content |
| 3. |
"The materials in the portfolio indicate that the student is able to use
proper grammar, spelling and form in written work." |
|
Strongly agree/Agree |
|
75% |
|
80% |
|
73% |
|
75% |
|
Neither agree nor disagree |
|
5% |
|
12% |
|
15% |
|
4% |
|
Strongly disagree/Disagree |
|
20% |
|
6% |
|
12% |
|
21% |
| 4. |
"The materials in the portfolio indicate that the student can produce
purposeful, well-researched and organized written presentations." |
|
Strongly agree/Agree |
|
82% |
|
84% |
|
85% |
|
85% |
|
Neither agree nor disagree |
|
16% |
|
15% |
|
13% |
|
11% |
|
Strongly disagree/Disagree |
|
2% |
|
0% |
|
2% |
|
4% |
| 5. |
"The materials in the portfolio indicate that the student can create
mediated messages career field." |
|
Strongly agree/Agree |
|
86% |
|
90% |
|
86% |
|
86% |
|
Neither agree nor disagree |
|
11% |
|
7% |
|
12% |
|
5% |
|
Strongly disagree/Disagree |
|
4% |
|
3% |
|
2% |
|
8% |
| 6. |
"The portfolio indicates that the student understands the roles and
functions of the mass media in society." |
|
Strongly agree/Agree |
|
79% |
|
84% |
|
83% |
|
83% |
|
Neither agree nor disagree |
|
21% |
|
16% |
|
17% |
|
17% |
|
Strongly disagree/Disagree |
|
0% |
|
0% |
|
0% |
|
0% |
| Achievement |
| 7. |
"This portfolio represents achievement on the part of the student." |
|
Strongly agree/Agree |
|
80% |
|
83% |
|
75% |
|
72% |
|
Neither agree nor disagree |
|
16% |
|
15% |
|
20% |
|
21% |
|
Strongly disagree/Disagree |
|
4% |
|
2% |
|
5% |
|
6% |
| Representativeness |
| 8. |
"This portfolio will demonstrate to people outside of the department that
the student is competent." |
|
Strongly agree/Agree |
|
74% |
|
78% |
|
73% |
|
68% |
|
Neither agree nor disagree |
|
17% |
|
13% |
|
20% |
|
19% |
|
Strongly disagree/Disagree |
|
9% |
|
8% |
|
7% |
|
13% |
| Overall Evaluation |
| 9. |
"This portfolio will demonstrate to people outside of the department that
the student is competent." |
|
Strongly agree/Agree |
|
48% |
|
67% |
|
60% |
|
46% |
|
Neither agree nor disagree |
|
48% |
|
32% |
|
32% |
|
46% |
|
Strongly disagree/Disagree |
|
4% |
|
1% |
|
8% |
|
8% |
Interpretation of
the results is difficult as a new group of reviewers is selected
each semester and they evaluate a different class of graduating
seniors.
Positive responses (Strongly agree/Agree percentages) on the part of
reviewers are nearly identical in terms of percentages to last
year's data with the exception of items addressing "organization," "representativeness"
and "overall evaluation." The greatest decrease from last year in
the Strongly Agree/Agree category concerned "organization" which
possibly influenced perceptions of competence and the overall
evaluation.
An attempt will be made to produce a sample portfolio for students
to examine prior to submitting their own for review. This example
should help them to visualize how to organize their work plus it
will help them to see what kinds of materials should be included.
|
2000-2001 ASSESSMENT
A total of 27 students had portfolios reviewed this year. The percentage of evaluators'
selecting each of the responses is shown on the evaluation instrument below. The scale for
each item was Strongly agree, Agree, Neither agree nor disagree, Disagree and Strongly
disagree.
PORTFOLIO EVALUATION STANDARDS
|
|
|
1998-99
Data |
|
1999-00
Data |
|
2000-01
Data |
| Appearance |
| 1. |
"The portfolio is neat in appearance." |
|
Strongly agree/Agree |
|
84% |
|
97% |
|
94% |
|
Neither agree nor disagree |
|
9% |
|
1% |
|
0% |
|
Strongly disagree/Disagree |
|
7% |
|
2% |
|
6% |
| Organization |
| 2. |
"The portfolio is well-organized." |
|
Strongly agree/Agree |
|
75% |
|
80% |
|
82% |
|
Neither agree nor disagree |
|
5% |
|
12% |
|
6% |
|
Strongly disagree/Disagree |
|
20% |
|
6% |
|
12% |
| Content |
| 3. |
"The materials in the portfolio indicate that the student is able to use
proper grammar, spelling and form in written work." |
|
Strongly agree/Agree |
|
75% |
|
80% |
|
73% |
|
Neither agree nor disagree |
|
5% |
|
12% |
|
15% |
|
Strongly disagree/Disagree |
|
20% |
|
6% |
|
12% |
| 4. |
"The materials in the portfolio indicate that the student can produce
purposeful, well-researched and organized written presentations." |
|
Strongly agree/Agree |
|
82% |
|
84% |
|
85% |
|
Neither agree nor disagree |
|
16% |
|
15% |
|
13% |
|
Strongly disagree/Disagree |
|
2% |
|
0% |
|
2% |
| 5. |
"The materials in the portfolio indicate that the student can create
mediated messages career field." |
|
Strongly agree/Agree |
|
86% |
|
90% |
|
86% |
|
Neither agree nor disagree |
|
11% |
|
7% |
|
12% |
|
Strongly disagree/Disagree |
|
4% |
|
3% |
|
2% |
| 6. |
"The portfolio indicates that the student understands the roles and
functions of the mass media in society." |
|
Strongly agree/Agree |
|
79% |
|
84% |
|
83% |
|
Neither agree nor disagree |
|
21% |
|
16% |
|
17% |
|
Strongly disagree/Disagree |
|
0% |
|
0% |
|
0% |
| Achievement |
| 7. |
"This portfolio represents achievement on the part of the student." |
|
Strongly agree/Agree |
|
80% |
|
83% |
|
75% |
|
Neither agree nor disagree |
|
16% |
|
15% |
|
20% |
|
Strongly disagree/Disagree |
|
4% |
|
2% |
|
5% |
| Representativeness |
| 8. |
"This portfolio will demonstrate to people outside of the department that
the student is competent." |
|
Strongly agree/Agree |
|
74% |
|
78% |
|
73% |
|
Neither agree nor disagree |
|
17% |
|
13% |
|
20% |
|
Strongly disagree/Disagree |
|
9% |
|
8% |
|
7% |
| Overall Evaluation |
| 9. |
"This portfolio will demonstrate to people outside of the department that
the student is competent." |
|
Strongly agree/Agree |
|
48% |
|
67% |
|
60% |
|
Neither agree nor disagree |
|
48% |
|
32% |
|
32% |
|
Strongly disagree/Disagree |
|
4% |
|
1% |
|
8% |
Interpretation of the results is
difficult as a new group of reviewers is selected each semester and they evaluate a
different class of graduating seniors.
Many of the positive responses (Strongly agree/Agree percentages) on the part of reviewers
are slightly lower than last year's data. This may be more a function of a relatively
large and very competent group of students who graduated May and December of 2000 rather
than a weakness of those who experienced the portfolio review process this academic year.
The lowest rated areas concerned items 3 (grammar, spelling and form) and 7 (achievement).
Weaknesses in any of items 1 - 6 on the evaluation carry over into or impact item 8
(competence). The faculty have and will continue to demand that students strive for
excellence in the production of written materials. |
1998-2000 ASSESSMENT
This was the third complete year that portfolios were evaluated the semester prior to each
Journalism and Mass Communications student's graduation. A total of 40 students had
portfolios reviewed this year. The percentage of evaluators' selecting each of the
responses is shown on the evaluation instrument below. The scale for each item was
Strongly agree, Agree, Neither agree nor disagree, Disagree and Strongly disagree.
PORTFOLIO EVALUATION STANDARDS
|
|
|
1998-99
Data |
|
1999-00
Data |
| Appearance |
| 1. |
"The
portfolio is neat in appearance." |
|
Strongly
agree/Agree |
|
84% |
|
97% |
|
Neither agree
nor disagree |
|
9% |
|
1% |
|
Strongly
disagree/Disagree |
|
7% |
|
2% |
| Organization |
| 2. |
"The portfolio is well-organized." |
|
Strongly
agree/Agree |
|
75% |
|
80% |
|
Neither agree
nor disagree |
|
5% |
|
12% |
|
Strongly
disagree/Disagree |
|
20% |
|
6% |
| Content |
| 3. |
"The
materials in the portfolio indicate that the student is able to use proper grammar,
spelling and form in written work." |
|
Strongly
agree/Agree |
|
75% |
|
80% |
|
Neither agree
nor disagree |
|
5% |
|
12% |
|
Strongly
disagree/Disagree |
|
20% |
|
6% |
| 4. |
"The
materials in the portfolio indicate that the student can produce purposeful,
well-researched and organized written presentations." |
|
Strongly
agree/Agree |
|
82% |
|
84% |
|
Neither agree
nor disagree |
|
16% |
|
15% |
|
Strongly
disagree/Disagree |
|
2% |
|
0% |
| 5. |
"The
materials in the portfolio indicate that the student can create mediated messages specific
to his/her chosen career field." |
|
Strongly
agree/Agree |
|
86% |
|
90% |
|
Neither agree
nor disagree |
|
11% |
|
7% |
|
Strongly
disagree/Disagree |
|
4% |
|
3% |
| 6. |
"The
portfolio indicates that the student understands the roles and functions of the mass media
in society." |
|
Strongly
agree/Agree |
|
79% |
|
84% |
|
Neither agree
nor disagree |
|
21% |
|
16% |
|
Strongly
disagree/Disagree |
|
0% |
|
0% |
| Achievement |
| 7. |
"This
portfolio represents achievement on the part of the student." |
|
Strongly
agree/Agree |
|
80% |
|
83% |
|
Neither agree
nor disagree |
|
16% |
|
15% |
|
Strongly
disagree/Disagree |
|
4% |
|
2% |
| Representativeness |
| 8. |
"This
portfolio will demonstrate to people outside of the department that the student is
competent." |
|
Strongly
agree/Agree |
|
74% |
|
78% |
|
Neither agree
nor disagree |
|
17% |
|
13% |
|
Strongly
disagree/Disagree |
|
9% |
|
8% |
| Overall
Evaluation |
| 9. |
"This
portfolio will demonstrate to people outside of the department that the student is
competent." |
|
Strongly
agree/Agree |
|
48% |
|
67% |
|
Neither agree
nor disagree |
|
48% |
|
32% |
|
Strongly
disagree/Disagree |
|
4% |
|
1% |
Interpretation of the results is
difficult as a new group of reviewers is selected each semester and they evaluate a
different class of graduating seniors.
It appears that there were, overall, slight improvements in many of the areas. Again,
smaller percentages of evaluators' scores this year were in the "Disagree" or
"Strongly disagree" categories on all of the first eight survey items compared
to last year. The greatest improvements were on items #1("The portfolio is neat in
appearance") and #3 ("The materials in the portfolio indicate that the student
is able to use proper grammar, spelling and form in written work.").
Continued emphasis will be placed on helping students improve their writing skills.
|
1997-98 ASSESSMENT
This was the second complete year that portfolios were evaluated the semester prior to
each Journalism and Mass Communications student's graduation. A total of 19 students had
portfolios reviewed this year. A summary of evaluator responses to each of the nine
Likert-scale items on the portfolio evaluation instrument follows. The response scale for
each item was Strongly agree, Agree, Neither agree nor disagree, Disagree and Strongly
disagree.
| Portfolio Evaluation
Standards |
strongly
agree
or agree |
neither
agree
nor disagree |
disagree
or
strongly disagree |
| Appearance |
| The portfolio is neat in appearance. |
84% |
9% |
7% |
| Organization |
| The portfolio is well-organized. |
75% |
5% |
20% |
| Content |
| The materials in the portfolio indicate
that the student is able to use proper grammar, spelling, and form in written work. |
70% |
19% |
11% |
| The materials in the portfolio indicate
that the student can produce purposeful, well-researched and organized written
presentations. |
82% |
16% |
2% |
| The materials in the portfolio indicate
that the student can create mediated messages specific to his/her chosen career field. |
86% |
11% |
4% |
| The portfolio indicates that the student
understands the roles and functions of the mass media in society. |
79% |
21% |
| Achievement |
| This portfolio represents achievement on
the part of the student. |
80% |
16% |
4% |
| Representativeness |
| This portfolio will demonstrate to
people outside of the department that the student is competent. |
74% |
17% |
9% |
Overall Evaluation |
This portfolio is:
48% of the evaluators considered the portfolios
"acceptable as is"
48% were "acceptable with modifications"
4% considered the portfolios reviewed as
"unacceptable" |
Interpretation of the
results is difficult as a new group of reviewers is selected each semester and they
evaluate a different class of graduating seniors.
Compared to last year's assessment
report, smaller percentages of evaluators rated the students' portfolios as
"Disagree" or "Strongly disagree" on many of the first eight survey
items. There was a slight increase in the percentage of positive scores on item #3
("The materials in the portfolio indicate that the student is able to use proper
grammar, spelling and form in written work.") and a decrease in the percentage of
negative ratings.
This probably influenced in the same
manner percentages of evaluators ratings on item #8 ("This portfolio will demonstrate
to people outside of the department that the student is competent.")
Continued emphasis will be placed on
helping students improve their writing skills. |
|
assessment
home | department means
| department home
17 May 2005
academicpublications@unk.edu |
