EDCI/EDLS 736 Dr. Van Cleave's Week 6 Video: Qualitative and PE

JV
by Jessica Van Cleave30 views·Updated Sep 26, 2023

Audio TranscriptAuto-generated

  1. Hi y'all and welcome to week six in this video.
  2. I'm going to talk to you about the qualitative and program evaluation portions
  3. and responsibilities, our readings, our discussion board post,
  4. all that kind of stuff going on with week six.
  5. Ok.
  6. So um the first thing I'm going to do is go
  7. ahead and share my screen so that you all can see
  8. um
  9. the blackboard shell week here and click on that.
  10. So at the top of the week, you'll notice our readings here for qualitative.
  11. We're going to do um something a little bit different.
  12. One is that um there's an eight minute video, excuse me,
  13. a six minute video about qualitative analysis.
  14. So when you have interview data as you all just collected,
  15. then you're going to um need to analyze it obviously.
  16. And that's what we're going to spend
  17. the bulk of our weekend too. Really talking about is doing some data analysis
  18. with the transcripts that you all have submitted.
  19. So
  20. you're going to watch that video.
  21. And then the next thing you're going to do is to read chapters, one and two of the salon
  22. text.
  23. And I'm going to go ahead and show you this text, we haven't gotten into the salon
  24. text
  25. yet.
  26. Um So this is our first week where we're reading out of this textbook.
  27. And as it, as it says, it's called the Coding Manual for qualitative researchers.
  28. So if you plan to use qualitative data in
  29. your dissertation research or in your program evaluation,
  30. then this text is going to be really useful.
  31. So chapter one is just an introduction to coding.
  32. It's gonna tell you what codes are, what the process of coding is like.
  33. And give you kind of an overview.
  34. Then chapter two
  35. is going to talk to you about some fundamental um coding methods and techniques.
  36. So it delves a little bit more deeply into that over the next few weeks,
  37. we'll be reading some more and getting some additional information.
  38. We'll also spend some time in weekend
  39. three talking about particular coding approaches.
  40. But chapters one and two are going to give you an introduction there.
  41. So
  42. as you'll note here,
  43. it's going to be really important to complete that reading before our weekend too.
  44. So um we will see you on September 30th and October 1st and I
  45. need you to have read chapters one and two prior to that happening.
  46. OK.
  47. So let's take a look in our qualitative folder and see what else is there.
  48. So you may not might notice, excuse me that this is a change from previously,
  49. originally in week six,
  50. I was going to ask you to go ahead and craft your focus group protocol,
  51. conduct your focus group and have that transcript available.
  52. However, there's just not enough time to do that and do that well,
  53. all within the same week, particularly if we wanted to have that done by weekend too.
  54. So what I'm asking you to do instead is to craft a focus group protocol.
  55. Um And I would like for you to get that done prior to um the weekend
  56. because I want us to spend a little time doing what we did in zoom with
  57. our interview protocols and breaking down those focus
  58. group protocols so that we can revise them
  59. and then go ahead and conduct that focus group in week seven for moving forward.
  60. OK.
  61. So
  62. that is,
  63. that's the main task for for this week for qualitative is to read
  64. those two chapters and to draft with your group a um a protocol.
  65. So what,
  66. what I want to do now is take a few minutes to,
  67. to talk about what's different about a
  68. focus group protocol versus an interview protocol.
  69. Now,
  70. hopefully you watched last week's instructional video that compared
  71. and contrasted interview and focus groups in general.
  72. But um what we want to talk about this week is more specific to designing a protocol.
  73. So we talked broadly about the different functions
  74. of a focus group um and an interview last week in that instructional video, but
  75. we want to talk a little bit about
  76. what's going to look different in the introduction,
  77. for example.
  78. So in a focus group introduction, you are going to want to include
  79. basically four main things.
  80. The welcome the overview of the topic, the ground rules for the focus group.
  81. And that's the main difference and then the first question.
  82. So an example would be good evening and welcome to our session.
  83. Thank you so much for taking the time to talk about what your topic is.
  84. Um give your name and if there's anyone else there with you
  85. and what what we really want to know is blah, blah, blah, blah blah, right?
  86. So you're going to talk about that.
  87. Um What you want to emphasize in a focus group is that there are no wrong answers,
  88. but there are differing points of view.
  89. So you want
  90. to make people feel welcome to share their point of view, even if it
  91. differs, excuse me, from what others have said.
  92. And we are just as interested in negative comments as positive comments.
  93. We're just as interested in support as um
  94. you know, like critique
  95. and sometimes those things that may sound more,
  96. more negative can be some of the most helpful.
  97. So you're also going to note that it will be recorded um because we don't,
  98. you don't want to miss any of the comments that are said,
  99. people often say really important and useful things in the context
  100. of a focus group and you don't want to miss anything.
  101. So we're recording it. Ok?
  102. And then you can say, all right, let's go ahead and get started.
  103. You can be assured about confidentiality and do some of those, um, notes around IRB.
  104. And then
  105. a lot of times that initial question is,
  106. let's go around the room and hear from everyone
  107. um, what your name is and the name that you would like to share and why you're here,
  108. what your role is something like that.
  109. So kind of those um ice breaker questions similar to what you had in the interview.
  110. So then another thing that you often want to do is to have reflection type questions.
  111. So we talked about open ended questions,
  112. both with regard to an individual interview and to a focus group.
  113. But sometimes for focus groups,
  114. you want to provide an additional opportunity for people
  115. to put themselves in the correct mind frame.
  116. So reflection questions like think about a time when or picture
  117. in your mind or think about to when can allow you to
  118. get your um your participants really in the right place mentally before you
  119. give that prompt or that question that you actually want them to answer.
  120. So think about a time when
  121. you saw a student really struggle after COVID in using
  122. technology or in interacting with um with other kids,
  123. what did that look like?
  124. What was going on?
  125. So you're trying to put people in a time
  126. and place so that they can recount some information.
  127. OK.
  128. The next type of question,
  129. our analysis questions.
  130. So um for analysis questions,
  131. this is a way that you can get folks to
  132. talk to each other about positive experiences or perceptions,
  133. negative experiences or
  134. perceptions a time. That was disappointing.
  135. What they thought the most important takeaway was about a time or event.
  136. And um those analysis questions really give an
  137. opportunity for multiple people to speak to an issue
  138. And prompts become just as important in focus
  139. groups as they are in individual interviews.
  140. So thinking about something like
  141. tell me more about that or I'd be really interested.
  142. Has anyone else had a similar kind of experience if things shut down a little bit,
  143. but in a focus group, you want to not speak as much as possible.
  144. The important thing that you're trying to do is
  145. to get that interaction between and among participants.
  146. All right, then as you get to the end of your focus group,
  147. sometimes you want to ask some overarching
  148. kind of questions that ask your participants
  149. to really reflect on some of the main content or what we do with
  150. the next moments in light of what the conversation has just been.
  151. So you might have something like suppose you had one minute to speak
  152. to the superintendent about the most pressing issues in the wake of COVID.
  153. So some kind of prompt that lets people really
  154. speak to their overall their summary kind of sense of
  155. what the takeaways are and what the impact was or
  156. if you were leading a discussion with beginning teachers,
  157. what do they need to know about teaching post COVID?
  158. So, rather than thinking through,
  159. um, a broad question, you, you always want to ask that,
  160. does anyone have anything else they would like to share or is there something I
  161. haven't asked that I should have asked those
  162. kinds of things are still very important,
  163. but
  164. they aren't something that you necessarily um have to end with
  165. if you'd like to get some summation from your participants.
  166. So
  167. that's when it's really actually important to think through. Um
  168. Sorry, my, my um little thing there is getting kind of funky, but that's,
  169. that's the part where you really want to think through
  170. what are your participants making of the conversation and
  171. not just what you are making of the conversation.
  172. So this is an opportunity to be able to do that.
  173. OK.
  174. So
  175. again, that's what you're gonna be doing with qualitative.
  176. Um And with the program evaluation,
  177. let me switch this back over to
  178. um
  179. to showing the blackboard shell.
  180. But for program evaluation, let's go ahead and take a look at what we're doing next.
  181. So I'm going to click back to our main week six so that we can see here.
  182. And in program evaluation,
  183. you are going to be reading chapters 14 and 15 in our program evaluation text.
  184. So you all have used this uh quite a lot.
  185. We're getting into kind of getting into the weeds and the
  186. details of um what comes next in our program evaluation.
  187. So, um
  188. chapter 14 and 15,
  189. they are going to take us through some of the nuts and bolts of our planning.
  190. So 14 is planning how to conduct an evaluation.
  191. And Chapter 15 is about design sampling and cost analysis.
  192. Cost isn't something that you're really going to have to think about much.
  193. But the design is, and this is where we start getting into.
  194. Like I said, the weeds that are going to lead you to your chapter two.
  195. So let's take a look down in the program evaluation folder.
  196. Um
  197. and I'll make that larger again, so you all can see.
  198. And in week six, our plan is to submit chapter two for formative assessment.
  199. So this is a really quick turnaround, right? That we did
  200. chapter one in week five, chapter two in week six.
  201. So Doctor Porter and I want to give you the opportunity to take
  202. a little bit more time if you need a little bit more time.
  203. Um So you can interpret that to be chapter or I'm sorry, week six or week seven.
  204. So if you need a few extra days,
  205. um all the way into the end of week seven in order to get your chapter,
  206. chapter two completed and drafted and ready to submit, that's OK.
  207. Um Chapter two is incredibly important because
  208. that's where you're figuring out those design concerns
  209. that you're going to see in chapter 14 and 15 of your program evaluation text.
  210. So it's where you are deciding what's your data collection method.
  211. How are you going to analy
  212. it?
  213. And you need to be able to talk to your
  214. program evaluation team in order to make those determinations.
  215. So if you need a little bit more time with that,
  216. then you can take a little bit more time.
  217. So
  218. um the sooner you get it submitted, the sooner you're going to get feedback,
  219. obviously.
  220. But again, we know some flexibility can be really helpful,
  221. especially if you want to do your very best work on the evidences.
  222. So if you need some time into week seven, in order to complete your chapter two,
  223. then you can have it.
  224. OK?
  225. So that brings us back to our main page on blackboard
  226. and that's all there is to talk about with qualitative.
  227. I know I went on a little bit because I
  228. wanted to clarify some things about the focus group.
  229. So for qualitative, you have readings in the
  230. coding text by Johnny Saldana.
  231. Then you have that short video to watch and then you are going
  232. to draft a focus group protocol and you need to bring that protocol
  233. or submit that protocol by this weekend because we're going to be using
  234. those um and breaking them down so that we can revise them.
  235. Then for program evaluation,
  236. you have two chapters to read and then you're going to be working on your chapter two,
  237. whether you decide to go ahead and submit it during
  238. week six or take some additional time into week seven.
  239. you should still really be getting into the weeds and into that work for chapter two.
  240. If you have any questions about qualitative or program evaluation,
  241. please don't hesitate to reach out and, um, we will see you all this weekend.
  242. Thanks.