Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Technology Use in Assessment, Evaluation, and Grading

No description
by

Vince McIntosh

on 3 December 2013

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Technology Use in Assessment, Evaluation, and Grading

Technology Use in Assessment, Evaluation, and Grading
Introduction
Technology
What is your definition of "technology"?
Grading
Grade reporting
Grading software
Test generators

Assessment

Pre-assessment
http://bit.ly/1b6DkTP
What is an example of technology you might use for assessment, evaluation, or grading?
Formative assessment
Summative Assessment
Midpoint
http://bit.ly/1c3YCiN
One thing I still want to know about technology use in assessment and evaluation...
Diagnostic or Pre-Assessments are used for
Determine prior knowledge or what students already know

Determine student skill levels

Identify student misconceptions

Identify students’ interests

Examples: Brain drains, drawings, surveys, and non-graded quizes

Formative Assessments
Used during learning to check student progress toward mastery of material

On-going and continuous
Provides information on where students are on the path to learning the concepts

Guides teachers so they can plan instruction to help students master concepts

Examples: Individual student conferences, observation, and rubrics
Summative Assessments
End of the learning process when you believe students have mastered the content

Sum as the total

Assessments OF Learning and are graded

Grading should be based on student achievement toward the designated CSO, not other things such as attendance, cooperation, or extra credit

Should be prepared before the instructional piece of the lesson is planned

Examples: Praxis exams,course finals, driver’s exam, state required standardized assessments, performance assessments like as a band or choral program, and authentic assessments like, such as a play or drama performance

Feedback
Students need specific, constructive feedback

Good feedback must be timely, specific, understandable and allow for self-adjustment

Evaluation
Discussion & Conclusion

Lap application:
Apply one of the models above to evaluate an educational technology project.

Novelty
How new is the technology?
What are its technical capabilities?
Speed
How quickly can courses be created and distributed with this technology?
How quickly can materials be changed?

Models of Evaluation

4. Results
Measures the success of the program in terms that managers and decision-makers can understand.
Examples are, increased production, improved quality, decreased costs, reduced frequency of accidents, increased sales, and even higher profits or return on investment.

Kirkpatrick’s Model

2. Learning
It measures students’ learning results and whether students actually learn the knowledge, skills, and attitudes the program was supposed to teach, or not.

Kirkpatrick’s Model

Kirkpatrick’s Model: The best known model

A Model is a hypothetical description of a complex entity or process.

In educational technology, an evaluation model is used to provide a framework for selecting, evaluating and improving the learning process.

Models of Evaluation

Week 4
Models of Evaluation in Educational Technology

TECH4102

Evaluation in Educational Technology

EITIMI Model: A Medical Course Example

EITIMI Model Elements

Models of Evaluation

EITIMI Model (1999)
A three-step model considers the elements of the learning process and used for selection and evaluation of technologies to enhance the quality of teaching and learning.

Models of Evaluation

Interactivity and User-friendliness
What kind of interaction does this technology enable?
How easy is it to use and learn?
Organizational Issues
What are the organizational requirements to provide stability and support?
What are the barriers to using this technology successfully within the institution?
What changes need to be made within the organization to incorporate the technology?

Models of Evaluation

Costs
What is the cost structure of each technology?
What is the unit cost per student?
What are the opportunity costs vs. other technology choices?
Teaching and Learning
What instructional approaches will best meet these needs?
Can the content be adapted to the technology?
What skills does the technology develop?

Models of Evaluation

Bates’ ACTIONS Model (1995)
A generic framework developed at the British Open University to help in analyzing and selecting the appropriate technology.
Access
How accessible is a particular technology for learners?
How flexible is it for a particular target group?

Models of Evaluation

3. Behavior/Transfer in the Workplace
Attempts to answer whether or not students’ behaviors actually change as a result of new learning technology, and conducted three to six months after the program.


Kirkpatrick’s Model

1. Reaction
It measures how well students liked the program and technology, and includes questions about:
The relevance of the objectives.
The ability of the course to maintain interest.
The appropriateness of interactive exercises.
The ease of navigation.
The perceived value.

Kirkpatrick’s Model

Models of Evaluation in Educational Technology.

Kirkpatrick’s Four-Level Model (1975)
Bates’ ACTIONS Model (1995)
EITIMI Model (1999)

Models of Evaluation

Dr. Alaa Sadik
Department of Instructional & Learning Technologies

www.alaasadik.net
alaasadik@squ.edu.om

TECH4102

Evaluation in Educational Technology

Kirkpatrick’s Four-Level Model (1975)
A four-step model used to evaluate technology-based training as well as traditional forms of delivery.
Reaction
Learning
Behavior
Results

Models of Evaluation

Try to answer the following questions with your team, then share the findings with us.

What makes quality teaching and learning?
What are the variables that affect technology-based learning and need to be evaluated?
What instruments can be used to evaluate the quality of technology-based learning and provide designers with information for improvement?

Before Evaluation…

verb
1. To put into words: articulate, communicate, convey, declare, express, say, talk, tell, utter, vent, verbalize, vocalize, voice. Idiom: give tongue (or vent) (or voice) to.
2. To utter publicly: air, express, put, vent, ventilate. Idiom: come out with. To declare by way of a systematic statement: enounce, enunciate.
3. To put into words positively and with conviction: affirm, allege, argue, assert, asseverate, aver, avouch, avow, claim, content, declare, hold, maintain, say. Idiom: have it.

STATE – Synonyms

noun
11. the operations or activities of a central civil government: affairs of state.
12. (initial capital letter ) Also called State Department. Informal the Department of State.
13. Printing a set of copies of an edition of a publication which differ from others of the same printing because of additions, corrections, or transpositions made during printing or at any time before publication.
14. the States, Informal. the United States (usually used outside its borders): After a year's study in Spain, he returned to the States.

STATE – Multiple Meanings

noun
6. an abnormally tense, nervous, or perturbed condition: He's been in a state since hearing about his brother's death.
7. a politically unified people occupying a definite territory; nation.
8. the territory, or one of the territories, of a government.
9. (sometimes initial capital letter ) any of the bodies politic which together make up a federal union, as in the United States of America.
10. the body politic as organized for civil rule and government ( distinguished from church).

STATE – Multiple Meanings

"Having emerged from the poverty and obscurity in which I was born and bred, to a
state
of affluence and some degree of reputation in the world, and having gone so far through life with a considerable share of felicity, the conducing means I made use of, which with the blessing of God so well succeeded, my posterity may like to know, as they may find some of them suitable to their own situations, and therefore fit to be imitated.“

--The Autobiography of Benjamin Franklin

Research & WV select most valid operational prompts

Rubric
Anchor Papers & Training Papers
Artificial Intelligence Engine Training


Training the Engine (Computer)

How Does a Computer Score Writing?

Content Category: Education/Finance/Outdoors
Spelling Error Ratio
Sentences with Verbs
Character/Word Count Ratio
Sentence/Paragraph Ratio
Grammar errors/Sentence Ratio
Raw Word Count & Root Word Count
Adverb Count
Thousands more …

A Few Examples of Dimensions

noun
1. the condition of a person or thing, as with respect to circumstances or attributes: a state of health.
2. the condition of matter with respect to structure, form, constitution, phase, or the like: water in a gaseous state.
3. status, rank, or position in life; station: He dresses in a manner befitting his state.
4. the style of living befitting a person of wealth and high rank: to travel in state.
5. a particular condition of mind or feeling: to be in an excited state

STATE – Multiple Meanings

A Peek Behind the Curtain of Computer-Based Essay Scoring

How Writing is Assessed
Full transcript