Program Evaluation as a Research Method

Hello, everyone.

My name is Jeremy Middleton, and today I'm going to

be talking to you and or introducing YouTube program evaluation

as a means for research method.

Um, just a little bit of the background.

So program evaluation was created by the C.

D. C.

However, educational institutions across the nation have used this, uh,

this evaluation method or this research method.

Um, you know, there are so many different avenues for

research. Uh, and as it comes to what institutions use

for programs, this is one way that institutions can stay

on top of different changes and different trends, Um, and

also have good quality control about the things that they're

presenting to their students.

Um, as we know that that is important.

It's not.

It's more than just giving out data and giving out

information. That's also how good is that information that we

are giving out the students?

That is key.

So, um, some of the major components that, uh, that

are related to program evaluation number one is their evaluation

steps. Okay.

The program evaluation has specific steps that you have to

do, um, in order to move on to the next

step and each time you're doing one step, you're gathering

information and you're putting data where it needs to go

in order to fulfill all of your necessary points before

moving forward.

Um, I think that this is a major component because

it helps structure the research.

Um, in a good way.

Um, you know, you have way more opportunities for, um

organization when you can't move forward until this step is

complete. You can't go here until one thing is done.

And so, um, this really allows for efficiency and operational

measures to be measures to be above reproach.

So another major component would be the standards used for

evaluation. Um, so during throughout the entire research process, there

are specific standards that can and will be used in

order to make sure that the research is done properly,

the means by which the data is being collected and

all other aspects of the research is being done properly.

Um, now there are many different standards of approximately 30.

But, um, the majority have been grouped down into four

common groups which is called or the groups are utility

standards, feasibility standards, proprietary standards and accountability standards.

And all of those four standards are important to each

aspect of of research.

And I think it's like it's very crucial that we

understand that although there are 30 standards, these are the

four more commonly used standards.

But to have evaluation standards in research allows for, um

those who are not involved in the research to understand

why this research is being done.

Um, who is it impacting?

How efficient and effective was that research was it flawed?

And these standards kind of help with that.

Another major component is logic models.

Um, so this is good because it shows the process

and correlations.

Um, first you talk about like the reasoning is behind

the research and what process and steps will be taken

to do it.

But then, more importantly, what correlations from the research can

be found, how can we determine that?

What we're what we're actually doing?

Research on it correlates to what we're needing for now

or in the future.

So having logic models is very crucial.

Another major component is the indicators that come from this

research method.

Okay, um, some of the indicators are there literally used

as determining the efficacy of the program.

So these indicators are based on outcome.

How how important or how good was the outcome as

it relates to what was the intended outcome or what

is being done and properly within the program?

Um, the process.

How these indicators can tell us what is being done

in terms of step by step.

Is it following the right necessary protocols to make sure

that the process is being done correctly?

Or is it off?

And we need to make changes and input what data

is being used?

What data is being put into the research to make

sure that the research is correct and efficient?

And those are some of the indicators some of the

strengths and weaknesses for the program evaluation being used as

a resource method?

Our list to hear, um, one strength and I think

that it is important to note, is at the end

of the day, this is going to be more consistent

and more active amongst higher education.

And what I mean by that is you can always

do program evaluation.

You can do it every year.

You can do it every semester.

You can do it every week.

If you really wanted to crunch those numbers all the

time. Um, you and I say that because some admissions

programs use program evaluation to sit there and monitor.

How good did we do this week in terms of

getting communication and letters out to students and receiving said

in communication and letters back?

Um, another thing that's great about the strength for this

is the strategic planning models colleges and universities across the

nation have to, in order to be accredited, have to

understand that, um, we live in a time where if

you're not accredited, your degree doesn't matter, so to speak.

And I think it's very key and crucial that we're

showing the accreditation board that we're using these models in

our strategic planning that are going to last over years

or over the next one year over the next semester,

whatever it is that we place in our strategic planning

models, um, and that's used for accreditation for have you

know, whatever cycle institutions have, some have force and have

three. Some have seven stuff like that.

One of the weaknesses for this is the fact that

it takes time depending upon what you are studying, and

it also has political implications and I really wanted to

touch on that just a little bit.

The potential political implications are not what you're maybe thinking.

And it is more based on, um, what the school

thinks is important.

For example, a private school may feel that, um, a

biblical education is more important than a public school.

And so if a private school group of students or

organization is trying to put on this program and the

public private entity is like, No, this goes against the

Bible where this goes against, um, something else And our

board members won't like that, then that's the politics that

I mean by a weakness.

Um, there's some kind of bias.

Sometimes in that, um and then so what applications do

we have for educational research?

I think that this I couldn't break it down into

one because I think it's used it so it can

be used everywhere.

So on the left, we have, you know, academic, and

this is pretty much open and shut.

It can be used academically because not only do colleges

and universities have degrees, but they also have specialties.

I e.

Honors programs, so we can really look at how good

and how efficiently honest program is over a course of

time over a cohort, which most of them have started

to do.

Those now and so we can follow those along and

see what things need to be changed.

But things are good.

What? Things can be better etcetera.

Um, in the middle we have a picture of a

dorm, and we talk about residents life.

I used to work in residence life, and I think

that I use program evaluation every semester on what things

can be traditional programs, which means that they last over

each year, or things that are semester based on what

things can be done that can prove that we have

retention in residence life.

Most residents halls are auxiliary, and they make sure that

in order to make money, we have to have students

and beds.

So therefore, you need to make sure that students are

coming back and wanting to come back, and these programs

evaluation methods can do that.

Finally, it can be used in the admissions process aspect

where it be, um, how the communication is going out

to students and what's being brought back in our students

accepting of the letters that they're receiving or the emails

and phone calls?

Or are they upset that they're getting their phones or

emails blown up from the institution about?

Please come join us?

And so, um, another form of value program evaluation That's

key and can be used across the board in terms

higher. It, um, I really like this whenever I was

doing research.

And according to Welch, program evaluation is crucial for institutional

quality control and program improvement.

And here's why.

This is important.

And I believe that not only are we looking at

future programs where we are also looking at what we're

doing now, sometimes the wheel doesn't need to be fixed.

Sometimes it does, and so how can we continue to

have a good working well or how can we fix

a broken wheel?

And I think that's crucial because at any given time

there's a new set of students coming in, and they're

bringing in a new dynamic, a new aspect to a

student body, a new personality, a new form of technology

and all these things play a role in how programs

will work for us now and in the future.

And so that's why I think that this is important.

Uh, and below are my references.

And thank you for sitting in listening to my presentation

about program evaluation.

Program Evaluation as a Research Method

Chapters

Audio TranscriptAuto-generated