Send the link below via email or IMCopy
Present to your audienceStart remote presentation
- Invited audience members will follow you as you navigate and present
- People invited to a presentation do not need a Prezi account
- This link expires 10 minutes after you close the presentation
- A maximum of 30 users can follow your presentation
- Learn more about this feature in our knowledge base article
Do you really want to delete this prezi?
Neither you, nor the coeditors you shared it with will be able to recover it again.
Make your likes visible on Facebook?
You can change this under Settings & Account at any time.
Reliability and Validity
Transcript of Reliability and Validity
Sample There are also quite a few ways of trying to assess or measure validity and reliability. Add to this the general tendency for people to see methodological issues as dull and secondary to the main event and the whole thing starts to look like a bit of a ... & Ok, so you can have lots of different kinds of validity because there are so many different ways you can mess up drawing your conclusions, I get it! But what about reliability? A good question Mr Skinner, but perhaps it's no surprise from someone as concerned with methods as you are! If you used a number of different rulers and tape measures to measure a person's height you would expect there to be a bit of variation in the results. These variations are down to the sorts of inaccuracies we find in any measurement instrument We'd say the rulers and tape measures were unreliable Experimental scientists put a lot of effort into working out how much error this kind of unreliability can cause so that we can clearly state the limits of accuracy in our measurements This is a bit like stating the Alpha values in an inferential test. It's all about being able to quantify our confidence in our findings . Well, I can see that this makes rulers unreliable, but social scientists don't use a lot of rulers, or at least not when they are measuring the things they think are important. Maybe we don't use a lot of rulers but we use lots of different things to make all sorts of different kinds of measurements. Questionnaires to collect opinion. Trait Inventories to measure personalities Heart rate and blood pressure to measure key indicators of healthy function. Observations like those used in the assessment of child development that measure things like anxiety or attachment security FMRI and CAT scans to measure brain activity Different observers will not be completely consistent in their judgements about the behaviour being observed Questionnaire items may not be understood in the same way by different respondents Physical apparatus like these are always going to produce different levels of reaction from different participants that it is hard to allow for. So, the very act of taking a blood pressure reading will increase blood pressure in most people but the amount of increase is difficult to predict and control for. Participants rapidly gain insight into the traits being measured (ah hah! so you think I'm either an introvert or and extravert). This introduces demand characteristics which are hard to allow for and control. Any mechanical device used for taking measurements or making scans with are subject to calibration issues and work with different levels of sensitivity. These differences are usually well documented and so can be controlled. However, as a source of error and inconsistency they cannot be completely ruled out. In short, there are no completely reliable procedures, techniques or research instruments. So we have to work with the different sources of unreliability and try to make allowances for them. Ultimately, the fact that we can never completely rule out the effect of unreliable methods means that we must always state our conclusions with caution if we are going to minimise potential criticisms of invalidity. A schoolboy designed an experiment to show that spiders hear with their knees. First, he placed the spider on a desk and slapped a ruler on the desktop next to the spider and observed it jump. Then he took a pair of nail scissors and cut off the spiders legs. When he slapped the ruler down a second time the spider remained still. "See," the school boy cried. "The spider hears with its knees!" Give the subject a list of stimulus material to review. Take the stimulus material away after a fixed amount of time. Ask the subject to count backwards in threes from a high number for a fixed amount of time. Record how many items of stimulus material that they can accurately recall. Who ever uses their short term memory in such a weird way??? Issues in internal validity are usually a matter of poor control of extraneous variables. This is just a fancy word that you might see in the literature it means "to make measurable"