Motlow State Community College

positiveriverManagement

Nov 20, 2013 (3 years and 6 months ago)

163 views

Motlow State Community College

Action Plan & Outcome Assessment Report for
Institutional Effectiveness

Planning Year: July 1, 2013


June 30, 2014

Assessing Year: July 1, 2012


June 30, 2013

Unit:

Business & Technology


Related Strategic Goal
:

3.1
Monitor and improve the effectiveness of educational programs and services.



Action Plan #
:

BTCH
-
0
1


Action Plan
Title
:

Business Technology Field Test


Desired

Outcome:


Students in the Business Technology major will achieve a minimum mean of
70
percent on the Business Technology Field Test.


Description of A
ction Plan

and Related Activities
:


The purpose of the
B
usiness Technology Major Field
Test is to measure program learning outcomes and examine basic competencies expected of Business
Te
chnology majors completing a two
-
year Associate of Applied Science Degree.

Within the general area
of business, the
test covers
four different areas of concentration: Accounting, Business Computer
Applications,

Business Computer Programming and Business
Management.

C
onsist
ing
of 100 multiple
choice questions
, t
he majority of the test (80%) is comprised of questions developed from the courses
included in the basic core of common business courses. The remainder of the test (20%) consists of
questions from

the core of concentration
-
oriented courses. Questions from the core of concentration
-
oriented courses are designed to emphasize the individuality of the different concentrations.



The
t
est is administered annually at the end of each spring semester to
all graduating business students
pursuing one of the four business areas of concentration under the Business Technology Major. The
results of each test are retained and evaluated by the Business and Technology Department faculty as a
measure of student pe
rformance relative to the program learning outcomes. Predicated on each year’s
results, the department faculty will evaluate the individual business areas of concentration to ensure
that course content is applicable and appropriate, and that the proper em
phasis is being placed on
course material/content pertaining to the expected outcomes. As necessary, course material/content
will be modified and/or the proper instructional emphasis will be applied in the applicable areas to
ensure the accomplishment of
the established program learning outcomes.



Approximately 20% of all major fields are tested each year in April. Business Technology majors
preparing to graduate are tested once during the five
-
year performance funding cycle. The Chair of
Business and T
echnology meets with faculty to analyze test results. Specific elements that are identified
include:




Item analysis to determine areas of content weakness.



Length of time between tests and start of students' programs.



Content of courses within the Busines
s Technology Major.



Courses required within the major field.



Length of time between courses that affect particular items or categories of items and the
time
of the Business field test.


Timeline
:

Annually reviewed



Est
.

Cost:

$
500

Budgeted
:

Included in current budget


Evidence of Success
:



Business Technology Field Test scores will show MSCC students achieve a
minimum mean of 70 percent.



Current Status
:

On Schedule


Data
was
collected and reported at the end of the spring 201
3

semester.

Department faculty will
conduct a complete analysis of the data during the fall 2013 semester.


Describe Progress Below



2013

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores
(# Graduates)


74

(8)



64

(3)





68

(1)



79

(
4
)

Overall Average Score
for Total Participants
(# Graduates)



73



(
16
)




Analysis and/or Use of Results
: The expected/desired over
all average score was achieved. However, the expected/desired
average score was

not

achieved in each of the program areas that had students completing the test. It should be noted that
the number of students participating in the field test
increased

from
the
previous year
. The results of the 2012

field test
were distributed to the depa
rtment faculty. A detailed question analysis and review of the associated course material and
content was completed. Faculty worked independently with the department test coordinator to change and update the test
questions.


Corrective Action(s)
: No
ne required at this time; however, the overall field test will be reviewed again by the departm
ent
faculty during the fall 2013

semester.



2012

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business
Management

Average
Concentration Test
Scores
(# Graduates)


N/A



71

(2)






N/A



75.8

(5)

Overall Average Score
for Total Participants
(# Graduates)



74

(7)




Analysis and/or Use of Results
: The expected/desired overall average score was achieved. Not only was the overall
expected/desired average score achieved, but the
expected/desired average score was achieved in each of the program
areas that had students completing the test. It should be noted that the number of students participating in the field test
dropped significantly from previous years. The results of the 2
011 field test were

distributed to the
department faculty.
A
detailed question analysis and review of the associated course material and content
was completed. Faculty worked
independently with the department test coordinator to change and update the test

questions.



Corrective Action(s)
:

None required at this time; however, the overall field test will be reviewed again by the department
faculty during the fall 2012 semester.






2011

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores
(# Graduates)


67.7

(10)




68

(1)



64.5

(2)



68.5

(10)

Overall Average Score
for Total Participants
(# Graduates)



67.7

(23)





Analysis and/or Use of Results
: The expected/desired overall average score was not achieved. Not only was the overall
expected/desired average score not achieved, but the expected/desired average score was not achieved in any of the
program areas.


Note
: The results of the 2011 fi
eld test were received on 05/04/2011. A detailed question analysis and review of the
associated course material and content will now be undertaken. Predicated on the results of that work, a determination will
be made as to the appropriate corrective acti
on.


Corrective Action(s
)
: Pending.



2010

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores

(# Graduates)


73

(2)



64

(4)



66.50

(2)



72

(12)

Overall Average Score
for Total Participants

(#
Graduates)



70

(20)




Analysis and Use of Results
:
The expected/desired
overall average score

was achieved. Not only was the overall
expected/desired

average score achieved, but the expected/desired average score was also achieved in two of the four
programs. However, in the two programs were the expected/desired score was not achieved, the average scores dropped
from last year by two to three percent
age points. During the fall 2010 semester, the Business and Technology Department
faculty will continue to analyze and review all questions to ensure their validity to the material and course content.
Additionally, the material included in the review doc
ument will continue to be analyzed and checked. Since beginning to use
the test review packet (last four years), the expected/desired overall average score has been achieved in three of the four
years. The one year in which the expected/desired overall a
verage score was not achieved, 2009, there was a problem in
getting the review packets distributed in a timely fashion, which we think let to the low scores.


2009

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores

(# Graduates)


N/A


66.00
(5)


69.50

(2)


63.40
(10)

Overall Average Score
for Total Participants

(# Graduates)



64.88
(17)




Analysis and Use of Results
:
The expected/desired
overall average score

was not achieved, nor was it achieved on any of
the individual tests.

During the fall 2009 semester, the Business and Technology Department faculty will analyze and review
all questions to ensure their validity to the material and course content. Additionally, the material included in the review

document will be analyzed a
nd checked. Since beginning to use the test review packet (last two years), the
expected/desired overall average score has been achieved. There was a slight problem in getting the review packets
distributed in a timely fashion prior to the 2009 test. A
review will be made to determine if this contributed to the lower
scores.



2008

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores

(# Graduates)


72.00
(5)


61.00
(2)



N/A


75.11
(9)

Overall Average Score
for Total Participants

(# Graduates)


72.38
(16)




Analysis and Use of Results
:
The expected/desired
overall aver
age score

was achieved. All questions have been analyzed
and reviewed to ensure their validity to the material and course content. Additionally, the material included in the review
document has been analyzed and checked.
It appears that the test review packets that are distributed to the students prior
to the test are
proving
beneficial; consequently, we will continue to distribute the review information.





2007

Programs of Study

Accounting

Business Computer
Applications

Business Computer
Programming

Business Management

Average
Concentration Test
Scores

(# Graduates)


73.44
(9)



67.60
(6)


N/A


74.27
(11)


Overall Average Score
for Total Participants

(# Graduates)


72.64
(26)




Analysis and Use of Results
:
For the first time since implementing the field test, the expected/desired
overall average score

was achieved
. The test questions associated with the four programs of study (concentrations) were again analyzed and
reviewed to ensure their validity to the material and course content, as was the material included in the review document.


Describe Needed
Changes
:

Reference the information provided under
Analysis and Use of Results

for
each year.


List of Supporting Documentation:

Business and Technology Department Business Technology Major
Field Test Results

shown above


Date Last Updated:

June 1
4
,
2013