Assessment/Retention
Meeting Agenda and Moving along on a Grant
Proposal
November 1, 2007 11:28:25 AM
Dear Christy and Mark,
As was true for Christy, I also felt the meeting was of minds taken
with combining technology and education. I've added more comments and
topics to Christy's draft list.
I note here how quickly in our discussion education words -- raised by
Christy -- seemed immediately valuable to the whole discussion. My most
important addition to Christy's message may be that of sending us off
on a path to searching for a proposal and getting campus support for
the proposal. This is Item V below.
Perhaps the second most important addition -- and tougher to write
about -- used our discussion yesterday on curriculum to give a picture
of exactly where assessment enters. This is Item II below.
Here is a list of the topics below:
- PROBLEM DEFINITION:
- SEEING ASSESSMENT
IN CURRICULAR TERMS:
- USE OF
TECHNOLOGY AND HOW IT SERVES EDUCATION GOALS:
- SOME PHRASES
FROM OUR DISCUSSION:
- OUR NEXT STEPS
AND CAMPUS SUPPORT:
I. PROBLEM DEFINITION:
Retention Rates Aspect: We could serve many faculty, Billings and the
State of Montana if we could help MSU-Billings increase enrollment and
retention within Upper Division courses. We must document that
statement with numbers. The goal would be to suggest why
science/math/engineering are well-served by having complete majors
within the MSU-B campus.
Assessment Aspect: MSU-Billings students -- even those who are
"traditional" -- come with confidence problems. They need serious
support from faculty. My previous experience documents how much support
that initially requires. Assessment can handle two issues that face
students with an academic profile typical of MSU-Billings. II continues
this topic.
II. SEEING ASSESSMENT
IN CURRICULAR TERMS:
To justify the effort to granting agencies and the university, we
should use assessment that can monitor the value-added to our students.
If a student has an SAT score of 495 in mathematics, it is a job
well-done to get them through 1st year calculus. For students under 550
on mathematics SATs it is a challenge to get them through the first
semester of several variable calculus.
I comment on several variable calculus, a misunderstood subject. This
is a sophomore course at most schools. Here, however, it is not often
taught. Further, when it is, it is not typically a sophomore course.
Forming an aptitude for math and science requires three dimensional
thinking; even when the topic is about areas on a sheet of paper.
Reason: Functions (inputs versus outputs) is the data tracking
mechanism in math/science. Any output dependent on more than one input
puts you at "three – or more – dimensions." That is exactly the topic
of several
variable calculus.
Christy mentioned her niece's experience with
"weather." Weather people are example heavy users of several variable
calculus.
III. USE OF
TECHNOLOGY AND HOW IT SERVES EDUCATION GOALS:
Our meeting yesterday affirmed this group's comfort with using
technology. We would elaborate on the use of such tools as Hyperstudio
and Unix. The elaboration would show how they us the programming
environment to carry out our assessment and monitoring strategies.
Hyperstudio is an excellent example of a proto-typing tool. Unix
provides "easy" programming languages (shell and pearl) that can help
our small group accomplish much. Once we get going I would like to show
you what I mean.
It does not mean that people who use these things will have to learn to
program. They would use the programs by getting an e-mail sending them
to a URL which would have them click on things to run already written
programs.
To demonstrate the potential of programming, for us in running an
assessment operation, I often start by showing how e-mail interactions
between faculty and
students become student "portfolios of interaction." People talk e-mail
but there are many bottlenecks to using it well.
f you have intense
interactions with 20 (or as I often have had, with 85) students, you go
crazy without technology. I won't explain further here. Yet, that is a
major topic, for understanding that allows getting started with
assessment very quickly.
Assessment tools such as WebWorks (mastery learning) and
I(nteractive)Q(uestionnaire)s (IQs: reading, analysis and step
thinking) combine -- with some programming -- to create automatic
reports that monitor the value-added to such students in most
curricular areas.
These same assessment tools also provide a "scaffold" of support to
encourage students to trust their academic environment will not fail
them. Such support will help them reach new heights, as my paper on IQs
posted on my web site notes.
Taking students from mastery learning to Step Thinking is really the
big issue. It is what makes the biggest difference between humanities
and science.
We live in an age of "knowledge explosion." That gives
people the feeling that only the latest data counts. That you must
learn more now than you ever did before. The result of this has two
negatives, and they don't compute to a positive.
- "Facts," rather than understanding the relation between
facts, ends
up dominating peoples' memories.
- There is an undercurrent message that it's all somewhat
hopeless
anyway. All you ever hear about is the latest information, and you can
never have confidence in what we learned from "the past."
Assessment tools like IQs show how wrong is #2. The skills hidden in
science and math haven't been usurped by a long shot. Further, such
assessment tools reinforce changes in learning that quickly counter #1.
They do that – especially IQs – by dropping the amount of
memorization required to understand complicated processes.
IV. SOME PHRASES
FROM OUR DISCUSSION:
We would expect a grant proposal would comment substantively on all of
these.
- Value added results
- feedback--continuous/instantaneous through Interactive
Questionnaires
- Master Learning/Zone of Proximal Development/Scaffolding
- Assessment opportunities and using our assessment tools to
compare
results with other campuses
- Dual enrollment, and COT involvement
- How successful assessment tools work, say by developing students'
"mental energy"
- Use of the Education Dept, say as a conduit for students going
from
Math to Education
V. OUR NEXT STEPS
AND CAMPUS SUPPORT:
At the Dean level we affirmed going to Tasneem Kahleel and Mary Susan
Fishbaugh. Mark suggested having other people become aware of our
efforts, for their support and (dare we hope) contributing actions.
These included:
Stuart Snider, Jim Baron and Mike Havens. We expect Mike Barber might
take to anything that gets off the ground.
Here quickly, then are three beginning steps.
- Work this present message into something expressing our common
feelings of what we might try to accomplish.
- Explore with Dave McGinniss, and then granting agencies, like
NSF
and Sloan, possible projects. We expect these to also satisfy our
personal needs to be doing something we believe in. Sloan tends to have
interest in innovative projects. NSF has a reputation that it cares
more about large coalitions, something we will (at least initially)
find it difficult to put together.
- Tell people on campus -- to garner their support -- once we
have
identified a proposal, and what it will take for us to put together
something using our collaboration.
For item #c, we need to feel the campus will care. We also need to
check territory issues, nipping in the bud anyone's concern for our
usurping their domain. In our meeting I did suggest -- with some humor
intended -- we be prepared to do short skits for Tasneem and Mary Susan
on what we are about.