Documentos de Académico
Documentos de Profesional
Documentos de Cultura
discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/258047593
CITATIONS
READS
735
3 AUTHORS:
Angelo Brandelli Costa
30 PUBLICATIONS 31 CITATIONS
SEE PROFILE
SEE PROFILE
bs_bs_banner
Abstract
Since its conceptualization, the construct of homophobia has been the subject of
many speculations about its specificity, reach, and possibility of empirical assessment. Several instruments have been created aiming to measure the prejudice
against homosexuals. Peer-reviewed articles of studies using measures to assess
homophobia and related constructs were systematically reviewed in 4 databases
(Medline, PsycINFO, ERIC, JSTOR). The articles were classified as they displayed
evidence of the instruments validity, reliability, or both. Finally, the instruments
were rated according to that evidence. Out of 1076 results, 115 studies between 1993
and 2010 were identified as relevant. Those studies used 47 different instruments.
This review focused in 5 instruments that concentrated the majority of the citations.
Psychometric properties were acceptable.
Lesbian/gay/bisexual/transgender.
Method
Aiming to develop or adapt an instrument, we systematically
reviewed articles of studies using tests and measures assessing
homophobia and related constructs. The articles were classified as they displayed evidence of the instruments validity,
reliability, or both. Finally, the instruments were rated
according to that evidence.
Procedure
We conducted a systematic review in Medline, PsycINFO,
ERIC, and JSTOR in May 2010, seeking peer-reviewed articles
in indexed journals from 1993 on, because of the existence of
a review that includes studies published from that date
(Schawanberg, 1993) to 2010. Since 1982, the American Psychological Association has suggested substituting the term
homophobia for attitudes toward homosexuality. However,
as several constructs referring to the same phenomenon were
found, we chose to use all of those terms. An initial search was
performed to confirm the presence or absence of articles
using each of the terms. We kept the terms that returned some
result. The string used in the final search was as follows:
(homosexual prejudice OR homosexuality prejudice
OR attitudes toward homosexual OR homophobia OR
homonegativity OR homonegativism OR antihomosexualism OR antihomosexuality OR heterosexism
OR heteronormativity OR homophobic OR homosexphobia OR attitudes toward homosexuality) AND
(measurement OR test OR scale OR inventory OR
assessment)
Search Strategies
The search returned 1076 articles. Of those articles, 234 were
removed as they were duplicates, and 229 were removed as
they were published prior to 1993. We kept articles that were
published in 1993 or later. The abstracts of the 613 studies
Journal of Applied Social Psychology 2013, , pp.
Costa et al.
Table 1
Validity/Reliability
1. Theoretical clarity
2. Content validity
3. Convergent and
discriminant validity
4. Relation to instruments
that assess the same
construct
5. Criterion validity
6. Face validity
7. Other validities
8. Factor analysis
9. Temporal stability
Definition
Stated clearly the underlying theory
guiding the construction of the
instrument
Described the procedures to select
relevant items, specifying details
and reasons for the classifications
in areas, domains, and subscales
These measures of validity are based
on the principle that theoretically
related constructs should present a
high correlation (convergent) and
unrelated constructs should not
(discriminant),
The degree of relationship between
instruments that assess the same
construct
The degree to which the test predicts
the performance of a group of
subjects in relation to an external
evaluation, their future behavior, or
a contrasting group
A measure of how the test appears to
measure the evaluated construct.
This category grouped other
validation techniques as
experimental interventions and
structural equations modeling.
Involves statistical analysis to identify
the factor structures of the test.
Generally involves items of a
subscale that correlate strongly
with each other and weakly with
other items of the test.
The tendency of the test to produce
the same result in the same
individuals in different occasions
A measure that tells how different
parts of a test, when related,
produce consistent results
Results
We identified 47 different instruments, 30 of which were cited
by only one article. The majority of the instruments were
published in recent years and originated in the United States.
Most of the instruments were self-report questionnaires,
except for one that was a computer-assisted categorization
task. The instruments evaluate a broad spectrum of the construct of homophobia, including modern homophobia;
implicit and explicit homophobia; internalized and externalized homophobia; homopositivity; homonegativity; causes
of homosexuality; and attitudes toward lesbians and bisexuals. They also evaluate different psychological aspects of the
construct, such as emotions; explicit and implicit attitudes;
behaviors; and beliefs. Besides the fact that most of the studies
were carried out in the educational environment, the context
of evaluation also varies from health to religious and military
institutions. As we were looking for evidence that supports
the good quality of the instruments, we chose those that
included the largest number of studies. We started reviewing
five instruments; however, one of them (i.e., Index of Attitudes Toward Homosexuals [IAH]) turned out to be the
renaming of another instrument that was also being reviewed
(i.e., Index of Homophobia [IHP]). Consequently, the final
review contained four instruments.
First, we present a summary describing the instruments
that contain the largest number of studies (see Table 2).
Second, we present a table that summarizes those studies, the
sample that was used, and an inference about the evidence of
validity and reliability that it represents (see Table 3). For
the scale evaluation process, we chose to rate the quality
of evidence related to the AERA/APA/NCME domains
(content/validity/reliability/internal structure) in Likerttype scale. The instruments were rated on a 10 point-scale,
punctuatingregardless of the number of studiesif they
Journal of Applied Social Psychology 2013, , pp.
Final pool
N = 54
Figure 1
Table 2
Search strategies.
Instrument
Index of Attitudes toward
Homosexuals
(IAH) / Index of
Homophobia (IHP)
Attitudes Toward Lesbians
and Gays Scale (ATLG)
Homophobia Scale
Implicit Association
Test (IAT)
Year of
publication
Country of
origin
Method of
data collection
Number of
scale items
Construct
Sample items
1980
USA
Self-report
questionnaire
25
Homonegativity
1988
USA
20
Negative attitudes
1999
USA
Self-report
questionnaire
Self-report
questionnaire
25
Homophobia
2001
Germany
Implicit attitudes
Computer-assisted
categorization
task
Costa et al.
Table 3
Classification of Samples and Evidence of Validity and Reliability by Instruments and Studies
Instrument
Study
Sample
Validity/Reliability
Undergraduate students
Undergraduate and graduate students
Nursing students and faculty teachers
Health students
Undergraduate students
Undergraduate students
Turkish undergraduate students
Turkish undergraduate students
Undergraduate and graduate students
Asian and American undergraduate students
Turkish undergraduate students
Nurse students
Male undergraduate and graduate students
Undergraduate students
Social workers
Men (unspecified)
Heterosexual men
Undergraduate students
Undergraduate students and staff
Undergraduate students
College students
Australian undergraduate students
College students
Psychiatric nurses
Undergraduate students
Undergraduate students
Nurses
Chilean undergraduate students
Undergraduate students
Undergraduate students
Undergraduate students
Irish undergraduate students
Undergraduate students
Counselors
Sample of the Dutch population
Undergraduate students
Military men
Postsecondary, undergraduate,
and graduate students
College students
Undergraduate students
Social workers
Undergraduate students
Psychiatric nurses
Undergraduate students
College students
Undergraduate students
Heterosexual men
Undergraduate students
Undergraduate students
Undergraduate students
High school students
Undergraduate students
University students
Undergraduate students
Undergraduate students
University students
7
3; 4; 8; 10
4
5; 10
3; 4
5; 7
2; 3; 6; 10
2; 3; 7; 8
9
5
2; 3; 8
3
3; 5
3; 4
3; 4
5; 7
7
3
3
3
7
4; 6; 8; 10
3
5
1; 2; 3; 5; 6; 8; 10
7
5; 7; 8
2; 3; 4; 5; 8; 10
3
3
5; 8
4
3
5
2; 5; 8; 10
3
4
3; 5; 7
Attitudes Toward
Lesbians and
Gays Scale
Homophobia Scale
Implicit Association
Test
Franklin (2000)
Smith & Gordon (1998)
Berkman & Zinberg (1997)
Waldo & Kemp (1997)
Smith (1993)
Herek (1988)
Lewis & White (2009)
Rogers, McRee, & Arntz (2009)
Bernat, Calhoun, Adams, & Zeichner (2001)
Wright, Adams, & Bernat (1999)
Tsang & Rowatt (2007)
Boysen, Vogel, & Madon (2006)
Rohner & Bjrklund (2006)
Rowatt et al. (2006)
Steffens (2005)
Jellison, McConnell, & Gabriel (2004)
Steffens & Buchner (2003)
Banse, Seise, & Zerbes (2001)
4; 5; 10
3; 10
3; 4
7
5
1; 2; 3; 5; 10
3
3; 7
7
1; 2; 4; 5; 8; 9; 10
3; 4
7
5; 7
4; 3
3; 4; 10
3; 4; 5
4; 7; 10
1; 2; 3; 4; 5; 7; 10
Note. For Sample, if the nationality of the sample is not mentioned, the assessed population is North American.
Table 4
Instrument
Quality
Pros
Cons
10
Several evidences
Homophobia Scale
Implicit Association Test
9
9
9
Discussion
The fact that the development of homophobia scales has been
concentrated in the United States is significant. This finding
probably reflects the fact that the notion of homophobia and
the contemporary political movement around it came from
the U.S. However, we were able to identify some studies conducted in other locations, as well as cross-cultural studies
conducted in the U.S. It is also interesting to note that all of
the reviewed scales were further scrutinized by reviewers
other than those who created the scales. This is an important
process that shows additional data, criticism, and the acceptance of the scales.
The Implicit Association Test (IAT) is a good scale to
measure attitudes, as it can detect homophobia in circumstances in which explicit attitudes tests would not detect it.
The IAT was developed by Banse, Seise, and Zerbes (2001),
and it assesses implicit attitudes in conformity with priming
procedures that measure the influence of automatic attitudes
in thoughts, feelings, and behaviors. The test assesses the
strength of automatic associations between concepts using a
computer-assisted categorization task. Participants are timed
as they associate symbols representing a group (e.g., pictures
of heterosexual or homosexual couples) with positive and
negative words (e.g., homosexual + good, heterosexual +
bad). It is assumed that homophobic persons associate more
quickly images that represent gay people with unpleasant
words (homosexual + bad) and images representing heterosexuals with pleasant words (heterosexual + good) and vice
versa. We found that this instrument has good validity and
content properties; however, the studies by Banse, Seise, and
Zerbes (2001) and Steffens and Buchner (2003) showed that
it has no temporal stability, which may call into question the
construct that the instrument is supposedly evaluating.
Dealing with explicit attitudes, the Homophobia Scale
(Wright, Adams, & Bernat, 1999) is newer and more complex
2013 Wiley Periodicals, Inc.
Few evidences
Lack of temporal stability
Costa et al.
References
Abramovay, M., Cunha, A. L., & Calaf, P. P.
(2009). Revelando tramas, descobrindo
segredos: Violncia e convivncia nas
escolas [Revealing plots, discovering
secrets: Violence and conviviality in
schools]. Braslia, Brazil: Rede de Informao Tecnolgica Latino Americana,
Secretaria de Estado de Educao do
Distrito Federal.
Adams, H. E., Wright, L. W., & Lohr, B. A.
(1996). Is homophobia associated with
homosexual arousal? Journal of Abnormal Psychology, 105, 440445.
American Educational Research Association (AERA)/American Psychological
Association/National Council on Measurement in Education. (1999). Standards
for educational and psychological testing.
Washington, DC: AERA.
Banse, R., Seise, J., & Zerbes, N. (2001).
Implicit attitudes towards homosexuality: Reliability, validity, and controllability of the IAT. Zeitschrift fur
Experimentelle Psychologie, 48, 145160.
Bell, N. (1989). AIDS and women: Remaining ethical issues. AIDS Education and
Prevention, 1, 2230.
2013 Wiley Periodicals, Inc.
Costa et al.