ATS New Faculty 2017: Assessment of Student Learning

DC
by Debbie Creamer39 views·Updated Apr 3, 2018
Powered by AI

Need to present on this topic?

Create your own polished presentation in minutes. Just describe what you need.

Free to try, no credit card required

Transcript

Resources

Assessment for your institution

Other resources:

ATS resources

Closing the loop

www.ats.edu

  • The reason for doing assessment is not "to do assessment"

Learning objectives

  • On a good day, ask "why am I doing what I'm doing?" (also: we)

Direct measures of learning

" At the end of a program, can students do what they’re supposed to be able to do? How do you know? Where they’re falling short, what are you planning to do about it? "

  • Indirect (perception) measures are valuable, but have limits.

Remember your motivation:

  • quality assurance

cookies!

"Assessment is a natural, inescapable, human, and scholarly act. When we spend time teaching students how to shape an argument or solve an equation, we naturally ask, 'Well, did they learn it?' "

(Barbara E. Walvoord, Assessment Clear and Simple)

  • quality improvement

What will you do with what you learn?

Just for fun: curiosity projects:

(program assessment)

  • What if each faculty member put all their textbooks (etc) on a table in the center of a faculty meeting -- what would you learn about the curriculum as a whole?
  • What if each faculty member wrote the top skills/knowledge/characteristics of ideal graduates on post-it notes, and you grouped those on a wall. What trends/discrepancies would you see?
  • Syllabus audit: what is each class teaching, where are the gaps and expectations?
  • Curricular map: how do required courses support degree learning goals? Any gaps?

(this includes surveys and course evals)

Just for fun: collaboration projects:

(program assessment)

  • Invite faculty who teach early in a degree program to observe a class with students later in the program (e.g., 1st year to 3rd year): what do they remember/use? Are you satisfied?
  • Spend an afternoon with alumni, ask them to describe where their seminary education was helpful and where there were gaps. What would they change -- and absolutely not change?
  • Talk to congregations, mentors, and employers, about degree program strengths and needs.
  • Try a "recital" (like music): allow students to "perform" what you're trying to teach (case-studies, role play, person-on-the-street).

Next steps?

What (interesting/meaningful) direct measures might you draw on?

Can you be surprised? Is it helpful? Does it help you think and talk about teaching and learning?

If not, stop and do something else!

  • Read your school's assessment plan or talk to coordinator.
  • Think about backwards design and artifacts in your next syllabus.
  • Ask what do you (collectively) want your students to learn (know, be, do, etc.), and how would you know if they learned it?
  • Simplify your course/assignment assessment strategies.
  • Apply assessment principles to your own vocational journey.

A few key points (in the ATS context):

Assessment is always linked to mission and context.

Accreditation focuses on degree program assessment.

Emphasis on simple, sustainable, and sufficient.

Assessment is the responsibility of the faculty, because curriculum is the responsibility of the faculty.

Assessment as a teacher

And...

Why care about assessment?

  • it can make you a better teacher

Because ATS member schools believe assessment is important (and, you're part of that now)

  • it can make make your workload lighter

But also...

  • you're probably already doing it (and, perhaps, could do it better)
  • To attend to diversity of learners
  • To support new educational models
  • your school will probably call on you to do it institutionally at some point
  • Out of integrity for your students, your stakeholders, and your community
  • it can enhance your own professional journey (tenure portfolio; job security)
  • Because you care about what you're teaching
  • To model it to your students, who themselves need assessment skills
  • it doesn't have to be painful or complicated; it can be fun (or, at least, interesting)

What is assessment?

Backwards design

(begin with the end in mind)

As an aside, the same can be said about accreditation:

Course evaluations

(for better or worse...)

See, for example, "Bias in Student Course Evaluations" in Inside Higher Education, Conditionally Accepted, June 17, 2016.

https://www.insidehighered.com/advice/2016/06/17/removing-bias-student-evaluations-faculty-members-essay#.Wdj5FCD9yCA.link

Grading vs. Feedback

(which do you prefer?)

Excessive work that administrators, accreditors, and other bureaucrats make us do, and that takes us away from the important work of faculty, which is ___________ .

  • it's not meant to be scary

but remember that you can't control for everything,

that teaching has limits (and sometimes accidents are the best part), and that students are co-responsible.

  • it's not meant to be bureaucratic

Rubrics

(a.k.a., divide and conquer)

note that rubrics help students too -- and can speed up your grading!

(well, at least the boring parts!)

  • it's all about educators who care about quality assurance and quality improvement

OR

Curiosity + Passion + Expertise

Three landscapes for assessment:

  • As a teacher: how do you know that your students have learned what you want them to have learned? How do you decide what you would like them to learn?

1) What are you trying to do (outcomes) and how do you ~ and others ~ know you are doing it (assessment/evaluation)

2) How can you do it more effectively and thoughtfully (improvement)

  • As an institution: how does your school demonstrate that the degree program and/or overall curriculum is effective/meaningful/valuable? How will you know (and show) how your piece fits into the overall whole?
  • As an individual: how will you navigate your own journey, make the case that you are sufficient/valuable (e.g., contract renewal or tenure), set your own goals and evaluate/revise your plans, make choices about the demands on your time?

Assessment of Student Learning

Debbie Creamer @drdcreamer

Director of Accreditation

and Institutional Evaluation

Association of Theological Schools

New Faculty Roundtable 2017