An Overview of Research Methods of Gain

An Overview of Research Methods of Gain

Future plans

Literature

Acknowledgments

• Investigate gain in Science Centers

• Lectures? Individual visitors?

• -> It has to be individualized for concrete S.C.

• Tests, well structured interviews?

• Translation of Calculus Concept Inventory

• FYKOS' camps (& maybe in introductory math courses on MFF UK, Albeř...)

• Masterclasses

The study was supported by the Charles University in Prague, project GA UK No 188515.

Karel Kolář

Charles University in Prague

Faculty of Mathematics and Physics

Standardized tests

• high validity and reliability

Concept inventories

• multiple choice (closed) questions

• usually already used on thousands of students

• test basic concepts in their fields

Effects of testing conditions on conceptual survey results (Lin, Reay, Lee, Bao; 2008)

Other concept inventories

The Force Concept Inventory (FCI)

• Assessment Instrument Evaluation Page

• http://www.ncsu.edu/per/TestInfo.html

• Databáza konceptuálných a postojových testov

• http://physedu.science.upjs.sk/metody/testy.html

• The Mechanics Baseline Test (Hestenes & Wells)

• The Thermal Concept Evaluation (Yeo & Zadnik)

• The Heat and Temperature Concept Evaluation (Thornton & Sokoloff)

• The Electric Circuits Concept Evaluation (Sokoloff)

• Conceptual Survey in Electricity and Magnetism (

• probably best known concept inventory

• tests basic concepts of newton's physics

Dividing the Force Concept Inventory into two equivalent half-length tests (Han et al., 2015)

The Calculus Concept Inventory (CCI)

• Jerome Epsein

• basic concepts in calculus (derivatives)

• not yet translated into Czech

Development and validation of the Calculus Concept Inventory (Epstein)

The calculus concept inventory-measurement of the effect of teaching methodology in mathematics (Epstein)

Questionnaire/Survey

• question types

• open (verbal), list, category, ranking, quantity, grid, scale (Likert)

• question wording

• precision of statements, assuptions, memory, knowledge, double questions, leading, presuming, hypothetical

• piloting

f. e. The Maryland Physics Expectations Survey (MPEX)

Qualitative

• Analysis of documentary evidence

• Curricular documents, programs of activities, lists of participants, selfevaluation, annul reports, even confidential papers...

• Observation

• Passive vs. active, (coding, sampling)

• Interview

• Conversational, general, standardized, structured (fixed- response)

• Case study

Research methods

(Mixed)

Quantitative

Qualitative

- need for large representative sample

+ we can use a. n. gain

+- should be objective

+ repeatable under similar circumstances

+- small sample

+- gain isn't well defined

- depends on the researcher (more complicated work in teams)

- not repeatable, cannot be falsified

Thank you

for your attention

Research methods

Gain

Description of literature search

• Standardized tests (pre-test, post-test) = (Hake's) average normalized gain

• For other purposes: gain of activity = what an participant learned during that activity thanks to that activity (added value)

• basic sources (Gavora, Ferjenčík, Skálová, Bell)

• Web of Science

• topic: gain, physics, education, method

• 48 results from 2005 - 2014

• additional sources (for ex. WDS)

Introduction

• Topic of my dissertation

• Informal activities, popularization, outreach of science and especially physics

• What is gain? Why to study it?

• How can be gain studied? Research methods

• Future plans

• Science Centres, Masterclasses

• Calculus concept inventory

Popularization of science // outreach

Topic of my dissertation

and motivation for the research

Effectiveness

of popularization activities

(How much does it cost?)

• More economical problem, problematic to obtain information of their budget...

• May be discussed within faculty (in the Long-term plan of faculty)

What participants learn?

(gain)

How is their attitude changed?

Motivation for further participation, further study...

• Topic: Research on effectivity of outreach in physics

• Experiences in the field of informal education

• 5 years in TALNET

• 6 years in FYKOS - The Internet Physics Competition

• diploma theses

• interest in newly emerging Science Centers in Czech R.

• numberless activities

• technical museums, Science Centers

• competitions, seminars, courses

• days with science

• ...

• targets all ages (maybe mostly primary and secondary school pupils; ISCED 2011 1-3)

• claims that teaches science/physics

• interactive engagement vs. traditional

Week of Doctoral Students 2015

3. 6. 2015 Prague, Czech Republic