Using Mobile Computing Strategies to
Enhance Student Learning and
Probability and Statistics
A Proposal for Mobile Computing
S. Kellogg and F. Matejcik, Industrial Engineering
The Need for Change
As a result of a global economy and the
move to lean enterprises, industry has taken a stronger stance in
asking for a different type of engineering graduate that has the leadership and complex thinking skil
by today's industry. T
o maintain the nation’s economic competitiveness and imp
rove the quality of life for
people around the world, engineering educators and curriculum developers must anticipate dramatic changes
in engineering practice and a
heir programs accordingly .
This report from the National Academy of
written by a group of distinguished educators and practicing engineers from diverse backgrounds,
includes various scenarios for the future based on current scie
ntific and technological
. This report and a
companion phase II report  identifies som
e of the
ideal attributes of the engineer of 2020
as well as
recommendations for curricular innovations that begin to address these attributes.
Further, this is not an
The Accreditation Board for Engineering and Technology (ABET) implemen
ted a revolutionary
approach to accreditation by focusing on what is learned rather than what is taught, thereby fostering
is rapidly becoming a researc
h discipline in its own right with
substantial support b
y the National Academy of Engineering and the National Science Foundation.
Dakota is one of a handful of states that has joined a new consortium to promote development of workforce
skills needed for the 21
Over and over, we are heari
ng the same repetitive cries for development
of team skills, leadership skills, a better understanding of business processes, an ability to innovate and think
outside of the box, and an ability to communicate effectively and organize work in a diverse envi
for example, [
In short, industry needs engineering graduates that can help solve and implement
solutions to the complex problems industry is faced with today.
Department Transformational Initiative
The industrial engineering
department adopted a long term strategy to respond to these changes and to
develop a more cohesive and systemic approach to engineering education. The holistic learner development
different aspects of student development [
technical skills through a
thoughtful application of
engineering best practices for student engagement
More specifically, the
department seeks to improve student learning through four pill
ars of undergraduate education that provide an
nal curricular focus for
student development and engineering education
Figure 1 below
s Engineer of 2020 Initiative and
provides a conceptual framework for skill
development for the
engineer of 2020.
While Figure 1 below display
s the skills and attributes for the engineer of 2020, it provides only a limited
framework for development of these skills. In this regard, the department has
a research based approach on
engineering education, assessment, and best practices. For nearly
a decade the department has adopted a
best practice approach for pedagogies of engagement , intellectual diversity [5, 16], and intellectual
13]. Department courses routinely integrate cases, role plays, simulations,
disciplinary team projects,
and service learning components.
In short, the
department has adopted pedagogies that replace lectures and passive learning with active hands
on and real
world learning. This has been a huge effort, but
esults have been staggering. Over seven years of data
suggests a new culture that embraces diverse learners, alternative modes of intellectual inquiry, improved
team skills, and better complex thinking skills (see, for example,
for a summary of this data).
Figure 1. Four Pillars
Development of the Engineer of 2020
While department assessment results are quite impressive (intellectual gains are nearly a half
step higher than
our peer group), thus far we have only initiated one step of a long term multi
step process for true curricular
transformation and continuous im
provement. The next step of this process is to create a dynamically
interactive classroom through
classroom inversion and mobile computing.
Enhancing Student Learning and Motivation in Probability and Statistics
The goal of this project is to expand
on earlier lessons by using elements of classroom inversion and mobile
technologies to facilitate an interactive, content rich, open
ended problem solving classroom in probability and
statistics. This particular course is ch
osen for a number of reasons.
hile significant gains have been
made in some curricular areas, fewer of these active learning elements have been successfully incorporated in
quantitative courses that stress technical skills. While the development effort is substantial,
it is also
likely that gains through classroom inversion and active learning are likely to be substantial as well.
A second reason for this course is that
while important for most engineers,
for the industrial
engineering and the engineering management
disciplines, a solid foundation of statistical reasoning is critical.
While Fundamentals of Engineering (FE) analysis and course assessments indicate that, in general, student
technical skills are good, a weakness remains in students’ abilities to transl
ate information and skill sets from
one Carnegie unit (context) to another. This is particularly problematic for industrial engineering students who
complete 6 credits in probability and statistics, but have difficulty translating that information to indu
engineering applications in simulation, quality control, stochastic models, work measurements, and human
factors. Indeed, long term tracking over 6 years utilizing the Fundamentals of Engineering and a Concepts
Inventory show little, if any, gains
in statistical reasoning (see Figure 2 below).
Conceptual difficulty in
probability and statistics is not limited to SDSMT students. Difficulties in learning basic concepts in probability
and statistics and the implications for open
ended design and anal
ysis are well established .
Figure 2. Probability and Statistics Concept Inventory Results (2003, 2008)
A wholly self
serving reason for selection of probability and statistics is that the department has already
developed a number of
simulations and interactions for this area (
Doing a full classroom inversion for a course of this nature requires an enormous effort and is beyond the
this rfp. Nevertheless, we believe that substantial progress and subsequent gains can be made by
leveraging much of the work already in place.
Finally, conceptual gains in probability and statistics
of significant interest to the industrial enginee
and broader engineering community. Indeed, there is now a whole host of research in the engineering
community focused entirely on understanding, and ultimately correcting, student misperceptions in a variety
of disciplines [18,
. Results gained f
rom this project and lessons learned
will likely be of significant
interest to the engineering community. If the project demonstrates even a modicum of success, results will be
incorporated into a large multi
institutional NSF cyber
The basic project may be summarized in Figure 3 below.
Figure 3. Project Summary for Enhancing Student Learning and Motivation in Probability and Statistics
Phase I: Inverting the Classroom
The first phase of this project is to create a content rich interactive set of materials for classroom inversion.
the traditional classroom, students are assigned a section of a textbook to read before class, though quite of
few of them do not. Follow
ing this passive, if it occurs at all, interaction with the material, students attend
Results of Concepts Inventory(Spr 03)
Results of Concepts Inventory(Fall 08)
class where they are passive recipients of a lecture. Following the lecture, students are assigned homework. It
is on their own, interacting with their homework, where
students first engage actively with the course
classroom, we move the active content engagement from post
class to in
class. The first
systematic attempts at classroom inversion
came from economics education [20
]. In the earl
y attempts, the
focus was on creating an environment where “events that have traditionally taken place
now take place
the classroom and vice
Using mobile technologies not only expand learning to
beyond the confines of
the classroom, but provide students with the true flexibility they desire to control the
time, place, and pace of their learning .
Phase I of the project will be accomplished in the first year of 2010 and will ultimately replace use of a
open content that will help to shift the learning environment by providing opportunities to find,
evaluate, and put new information to use . Phase I will deal with exploration and evaluation of open
source content materials
such as Carnegie Mellon Un
iversity’s Open Learning Initiative and MIT’s
OpenCourseWare as well as expansion and development of existing interactions. A final deliverable will be a
collection of materials, references, and interactions that allow faculty and students to build a comm
Phase II: Development of Active Learning Kits
Phase II of the project will be accomplished in the summer of 2011 and will focus on building hands
open ended problems
probability and statistics.
Hands on kit
s will allow students to measure, analyze, and
define appropriate experimental methods for applications in engineering reliability, manufacturing, human
engineering, and quality control. Open ended problem sets will allow students to build on the resource
information library established in phase I to explore research methodologies and alternative experimental
designs to solve real world
ended problem sets
To the extent possible,
students will make extensive use
of the IE Professional Handbook [
23] and model eliciting activities  to
fully engage students in
problem sets in an environment that encourages use of mobile technologies to identify variables,
explore alternative experimental designs, and to seek and evaluate add
to solve the
Assessment of the project will measure self
and conceptual understanding. It is
not uncommon for student beliefs in their ability to use math and science to solve engineering diminishes over
time spent. If successful, an inverted approach to probability and statistics will lead to greater confiden
understanding of how to translate basic concepts from one engineering context to another. Measurement will
include a pre and post measurement of self
Student attitudes towards probability and statistics will be measured using an online
Assessment of Learning Gains (SALG)
new NSF sponsored inventory
specifically designed to
address a number of issues of inte
rest to undergraduate research will be explored for possible inclusion.
Student typology is critical for
certain types of learning. While it is neither reasonable nor practical to
develop different protocols for different typologies, it would be useful to
know which type of student values
the inverted format over the traditional format. The department utili
zes the HBDI profile . Profiles will be
correlated with student attitude measures and conceptual gains.
Student conceptual understanding of probability and statistics is limited in all engineering disciplines and
is critical for industrial engineeri
ng and engineering management students. Limited student conceptual
understanding of critical material can not only slow gains of technical content but limit intellectual growth as
well. Hestenes attempt to understand student conceptions (or misconceptio
ns) utilizing the force concepts
inventory  has led to a whole series of
to aid our understanding of conceptual gains. We
will utilize and pre and post assessment utilizing the concepts inventory for probability and statistics .
Several sections of Introduction to Probability and Statistics are offered each year. The material
developed under this project will be available for use by all interested faculty in mathematics and industrial
engineering. In addition to a pre and pos
t assessment of conceptual understanding, the project and course
structure is ideally suited to allow for an experimental and control group. Given appropriate understanding
and support of the mathematics faculty, we propose offering two sections in one ye
ar by one of the project
If an experimental/control analysis is not available locally, then the investigators will seek
options through the Oglala Lakota College or through other researchers at other universities with similar
Define Important Concepts
Review Open Content
Develop Basic Material
Pilot Phase I Course
Expand library resources
Pilot Phase II Course
HBDI (from IENG 241)
Figure 4. Gantt Chart for Proposed Work
At the very least, curricular modifications and assessment results will be published through appropriate
sources recognizing both the discipline area (probability and statistics) and the delivery media. No less than
one paper will be submitted to the Amer
ican Society for Engineering Education, the Frontiers in Education
Advances in Engineering Education, or similar outlet. In addition, the department is
actively seeking a multi
institutional NSF funded project to con
duct rigorous research
classroom inversion and mobile technologies as a mechanism for active engagement in probability and
statistics, engineering management, structures, and materials engineering. Assessment results and lessons
learned from th
is project will be incorporated in a formal NSF STC proposal.
We are requesting $51,500 for the two year project duration. Budget items by year follow.
Dr. Kellogg (1 month summer)
Dr. Matejcik (1.5 month summer)
ndergraduate (2 @ 400 hrs @ $10
Programmer (400 hrs @ $10)
PDA, IPad, Smart Phone
Conference (1 faculty, 1 student)
Drs. Kellogg and Matejcik will
devote 1.5 to 2.5 months in the summer towards this project. This project
capitalizes on considerable development work already accomplished for online support and interactions. Dr.
Kellogg has full funding an
d can receive no additional funds for this project. Development work will be
accomplished during the summer. Assessment and library expansion will occur during the academic year.
Dr. Matejcik will receive 1.5 months of summer support each summer.
accomplished during the
academic year will be covered by reduced teaching load.
Undergraduate students will be employed to find and evaluate open content and open source interactions.
Students will also find, evaluate, and help develop mobile library r
esources. Finally, students will be used to
review course material. Student programmers will be used to develop interactions for alternative mobile
Life is easier if one recognizes that
different hardware/software configurations do not always
work as planned.
The mobile zoo will be used to test material, library resources, and online interactions on different mobile
The project will support one faculty member and one student to at least one professional conference each
The Engineer of 2020: Visions of Engineering in the New Century
, National Academy of Engineering,
National Academy Press, 2004.
Educating the Engineer of 2020: Adapting Engineering Education to the New Century, National Academy
of Engineering, National Academy Press, 2005.
Accreditation Board for Engineering and Technology
Partnership for 21
Century Skills web site,
Felder, Richard, "Reaching the Second Tier: Learning and Te
aching Styles in College Science Education."
Journal of College Science Teaching, 23
Smith, K. Sheppard, S., Johnson, D., and Johnson, R., “Pedagogies of Engagement: Classroom
Journal of Engineering Education
, 94 (1), pp. 87
102, January 2005.
Felder, R.M. and Brent, R., “Understanding Student Differences,”
Journal of Engineering Education
(1), pp. 87
102, January 2005.
Genalo, L. J., D. A. Schmidt, and M. Schiltz, “Piaget and Engineering Edu
Proceedings of the
American Society for Engineering Education
, June 2004.
Karlin, J. and Kellogg, S.,
"Seeing the Forest and the Trees:
Holistic Learner Development,"
Research in Engineering Education Symposium (REES)
avos Switzerland, July 2008.
Karlin, J. and Kellogg, S.,
"Metrics and the Holistic Learner,"
Proceedings of the Research in Engineering
Education Symposium (REES)
, Cairns, Australia, 2009.
Perry, W. G., Jr.,
Forms of Intellectual and Ethical
Development in the College Years
, Holt, Rinehart and
Winston, Inc., New York, 1970.
King, P. M. and K. S. Kitchener,
Developing Reflective Judgment
Bass Publishers, San Francisco,
Lynch, C. L. , S. K. Wolcott, and G. E. Huber
, “Steps for Better Thinking: A Developmental Problem Solving
Belenky, M.F., B.M. Clinchy, N
.R. Goldberger, and J.M. Tarule,
Women’s Ways of Knowing: The
Development of Self, Voice and Mind
, New York: Basic Books, Inc.
The Art of Changing the Brain
Stylus Publishing, Sterling, VA, 2002
The Creative Brain
, The Ned Herrmann Group: Brain Books, 1995.
, J. and Ahlgren, A., “Difficulties in Learning Basic Concepts in Probability and Statistics:
Implications for Research, Journal for Research in Mathematics Education, 19 (1), pp. 44
Streveler, R. A., Olds, B. M., Miller, R. L., and Nelso
n, M. A., “
Using a Delphi Study to Identify the Most
for Students to Master in Thermal and Transport Science
American Society for Engineering Education
, Nashville, TN, 2003.
Allen, K., Stone, A., Reed
T., and Murphy, T., “The Statistics Concepts Inventory: Developing a
alid and Reliable Instrument,”
Proceedings of the American Society for Engineering Education,
City, UT, 2004.
Lage, M.J., Platt, G. J., and Treglia, M., “Inverting the
Classroom: A Gateway to Creating an Inclusive
Learning Environment,” Journal of Economic Education, 31(1), 30
43, Winter 2000.
Mellow, P., “The Media Generation: Maximise Learning by Getting Mobile,”
Proceedings of the
Australian Society for Com
puters in Learning in Tertiary Education
New Media Consortium and the Educause Learning Initiative,
The 2010 Horizon Report
, The New Media
IIE Professional Handbook
Dux, H., Moore, T., Follman
, D., Zawajewski, J., and Imbrie, P.K., “A Framework for Posing Open
Ended Engineering Problems: Model Eliciting Activities,”, Savannah GA, 2004.
Student Assessment of Learning Gains web site,
Hestenes, D., Wells, M., Swackhamer, G., “Force Concepts Inventory,”
The Physics Teacher
, Vol. 30, 141
158, March 1992.