Experimental Design

IV between-subjects or within-subjects?

Between
IV manipulated or subject variable?

Within
IV manipulated or subject variable?

Manipulated

Subject

Manipulated by definition

Forming equivalent groups by

Groups intrinsically not equal Possible matching to reduce nonequivalence

How often tested per condition?

Random assignment

Matching

Once

> Once

Full/partial counterbalance
Independent groups 1-factor design Matched groups 1-factor design

Reverse/block counterbalance

Nonequivalent groups 1-factor design Repeated measures 1-factor design

One Factor-Two Levels

Between-Subjects, Single-Factor Designs Within-Subjects, Single-Factor Designs

Cont

Analyzing Single Factor, Two-Level Designs

t test for independent groups Independent groups design Nonequivalent groups design t test for dependent groups Matched groups design Repeated-measures design

One Factor-More Than Two Levels

Between Subjects, Multilevel Designs Within Subjects, Multilevel Designs

Cont

Presenting the Data

Types of Graphs

If continuous

line graph preferred, bar graph OK

If discrete bar graph preferred, line graph inappropriate (with some exception)

Cont

Analyzing Single Factor, Multilevel Designs

One-Way Analysis of Variance or ANOVA (ANalysis Of Variance) one-way means one independent variable To determine precisely where the significance lies subsequent testing or post hoc (after the fact) analysis is required. If ANOVA does not find any significance, subsequent testing is normally not done. The one-way ANOVA yields an F score or an F ratio.

More Than One FactorFactorial Designs

Identifying Factorials 23 factorial design, read as two by three Two independent variables; the first has two levels, the second has three. 345 factorial has three independent variables, with three, four, and five levels, respectively.

Cont
22 Factorial Matrix Factor B

Level B1
Level A1 Factor A
Condition A1B1 Condition A2B1

Level B2
Condition A1B2 Condition A2B2

Level A2

Cont
Main Effects Refers to whether or not statistically significant differences exist between the levels of an independent variable in a factorial design.

Example

Presentation rate 2-sec/word 4-sec/word 17 Type of training Imagery No Imagery 12 18 23

Cont
Interaction In a factorial design, occurs when the effect of one independent variable depends on the level of another independent variable.

Cont
Varieties

of Factorials Between-subjects variable + Withinsubjects variable Mixed Factorial design

Manipulated

independent variable + Subject variable PE (Person by Environment) Factorial Designs

Cont

Analyzing Factorial Designs

Analyzed with N-way ANOVAs - N referring to the number of independent variables involved. 23 factorial two-way ANOVA 222 factorial three-way ANOVA More than one F-ratios calculation For example for ABC, seven F-ratios calculation Three for main effects of A, B, and C, Three more for the two-way interaction effects of AB, BC, and AC, plus One for the three-way interactions, ABC

Cont

Subsequent testing

23 ANOVA significant F for the factor with three levels compare the overall performance of levels 1 and 2, 1 and 3, and 2 and 3.