Assessment for New Deans 2016

DC
by Debbie Creamer0 views·Updated Dec 9, 2017
Powered by AI

Need to present on this topic?

Create your own polished presentation in minutes. Just describe what you need.

Free to try, no credit card required

Transcript

Other resources:

  • ATS website

http://www.ats.edu/resources/administrators/assessment-coordinators

and

http://www.ats.edu/accrediting/self-study-and-assessment

(includes links to assessment guide and spring 2015 webinar)

  • ATS listserv for assessment folks
  • Wabash Center for Teaching and Learning
  • Assessment conferences by other accreditors/agencies
  • Indiana University Assessment Institute (Annually in October)

http://assessmentinstitute.iupui.edu/

(includes all conference handouts!)

  • National Institute for Learning Outcomes Assessment

http://www.learningoutcomeassessment.org/

  • Association for the Assessment of Learning in Higher Education

http://www.aalhe.org/resource-room/

http://assessmentcommons.org/

(includes a massive number of resources)

Question 1:

"What is assessment?"

Question 3:

Why do you suppose we

are talking about

assessment today?

Question 2:

How do you feel about assessment?

What's your biggest challenge?

What's your best idea or experience around assessment?

Perhaps two things:

Good assessment processes help you tell YOUR school's unique story,

instead of a generic/idealized story (e.g., what it is that makes your school or or alumni/ae special)

1) What are you trying to do (outcomes) and how do you and others know you are doing it (assessment)

2) How can you do it more effectively and thoughtfully (improvement)

Good assessment processes help you know your unique story so you can improve, based on your best hopes and commitments.

The Academic Dean

and Assessment

How about your faculty?

Another way to think of it is: How can you tell your story?

And also an issue of integrity, for your students and other stakeholders: is the educational experience what you describe it to be?

Debbie Creamer,

Association of Theological Schools

Assessment of Student Learning Outcomes

Assessment and Vocation

Assessment and Accreditation

Creative Commons License: This image is in the public domain in the United States because it was first published outside the United States prior to January 1, 1923.

"The primary purpose of assessment is to provide feedback to students and teacher so that learning can be facilitated" (McKeachie's Teaching Tips, p. 81)

"Assessment is a natural, inescapable, human, and scholarly act. When we spend time teaching students how to shape an argument or solve an equation, we naturally ask, 'Well, did they learn it?'

(Barbara E. Walvoord, Assessment Clear and Simple)

Question 4:

Can you imagine assessment as part of your vocation (or professional identity / calling / gift / etc?)

What if:

assessment

=

curiosity

+

passion

+

expertise?

Educational Standard ES.6.4.1

Evaluation of student learning is the responsibility of the faculty

Educational Standard ES.6

"The type of assessment most likely to improve teaching and learning is that conducted by faculty to answer questions they themselves have formulated in response to issues or problems in their own teaching" (Classroom Asssessment Techniques, p. 9)

Assessment of student learning requires schools to be able to demonstrate the extent to which students have achieved the various goals of the degree programs they have completed

General Institutional Standard 1.2

General Institutional Standard 1.2.2.2

Evaluation is a critical element in support of integrity to institutional planning and mission fulfillment

Institutions shall develop and implement ongoing evaluation procedures for educational effectiveness as required by individual degree program

standards

Question 5:

What, if anything, do you think is unique about assessment in theological education?

"Authentic forms of assessment have the best potential to capture what diverse students know and have learned and to guide a teacher's day-to-day teaching" (Doing Multicultural Education for Achievement and Equity, p. 202)

Jossey Bass, 2010. $32

A few more assessment terms and themes:

An effective plan of assessment should be as simple and sustainable as possible... (ES.6.1)

Assessment requires both direct (performance based) and indirect (perception based) measures of

student learning (ES.6.3.2)

...while adequate to answer fundamental questions about educational effectiveness. (ES.6.1)

Assessment should utilize both qualitative and quantitative kinds of information (ES.6.3.1)

How many

cookies?

Were they any good?

"Debbie made three dozen yummy cookies"

"79% of our graduates were ranked by their lay committees as being excellent preachers"

Blackboard used by Albert Einstein in a 1931 lecture in Oxford

Creative Commons License: This image was originally posted to Flickr by kimberlykv at http://flickr.com/photos/87542849@N00/4643536339. It was reviewed on 28 September 2010 by the FlickreviewR robot and was confirmed to be licensed under the terms of the cc-by-2.0.

Creative Commons License: this image is in the public domain.

http://en.wikipedia.org/wiki/File:Einstein_blackboard.jpg

Other significant ideas:

Rubrics

Portfolios

Artifacts

ESQ, GSQ, AQ, PoM, SIR, IPPR, ATS

Learning outcomes

Backwards design

Culture of assessment

Educational experiment or exception

Others?

Assessment matters at a variety of levels:

Closing the loop (this is why it matters):

"The process and goals of assessment shall be conducted in ways that are congruent with the educational mission of the school" (ES.6.2.1)

Note that this is an ONGOING PROCESS

  • Individual student
  • Individual course
  • Degree program assessment (degree program standards)
  • Educational effectiveness (educational standards)
  • Institutional evaluation (general institutional standards)

Assessment plans should:

1) identify degree learning goals/outcomes;

2) gather information;

3) evaluate the degree program based on this information; and

4) establish revised goals or activities based on this assessment

Assessment plans also need to be assessed/revised!

Remember that the goal of assessment is excellence and improvement, not busywork. What helps you know whether and how to improve?

DO THAT!!!

Degree Program vs. Individual Course or Student Assessment

Internship

Co-curricular

experiences

Course

Course

student

student

Course

Degree Program

student

Course

Formation

Mentoring

1

Note: grading is rarely an adequate form of assessment...

2

Note that many of our schools are very good at assessing individual students, but the goal here is program assessment.

3

...and course assessments are of limited value, too.