1

FYES REAL-LIFE INFORMATION LITERACY

SCENARIOS

EVALUATION PLAN

EDIT 6200
FALL 2015

Table of Contents
Introduction .....................................................................................................................................3
Project Background ..........................................................................................................................3
Introduction/Summary.....................................................................................................................3
Alpha Test .........................................................................................................................................5
Purpose ............................................................................................................................................ 5
Procedure ..........................................................................................................................................5
Assessment Criteria ..........................................................................................................................5
Beta Test ...........................................................................................................................................6
Purpose .............................................................................................................................................6
Procedure ..........................................................................................................................................
6
Assessment Criteria ..........................................................................................................................6
Appendix A: Alpha Testing Questionnaire (Usability) ....................................................................7
Appendix B: Beta Testing Questionnaire (Content) ........................................................................8

3
INTRODUCTION
This project will create an online training course that will provide real-world scenarios for the
student to evaluate information, the credibility of an author, and the motivation or bias of an
author.

PROJECT BACKGROUND
Like many colleges and universities, Middle Georgia State University has a Freshman
Orientation course. Ours is called FYES 1001 (First Year Experience). As it stands right now,
there is a library component to the FYE course that includes two mandatory library visits,
during which time we (the librarians) focus on specific information literacy concepts during
each session. The students complete an activity that is graded by the librarian (using a rubric
that we have designed) to assess the effectiveness of the session. Due in part to the fact that
Middle Georgia State University has five campuses spread out all over Middle Georgia, the need
to create instructional materials that support what is already happening in the two mandatory
library sessions is a must. More specifically, these materials will be created in a manner that
allows them to be easily incorporated into Desire2Learn (our LMS). This is crucial to buy-in
from both students and faculty. The materials themselves will be used both before and after
these required library sessions to prepare and reinforce the concepts that are discussed in both
required library sessions.

SUMMARY
The goal of this course is to provide reinforcement of concepts that are dealt with in two face-toface sessions for MGAs FYES class. After several years of this program, the data shows that
students struggle with several of the concepts and this one will focus on evaluating information
for bias, appropriateness and authority.

Goals and Objectives

1. Students will be able to evaluate the credentials of an author.
2. Students will be able to evaluate the appropriateness of information for a specific
purpose.
3. Student will be able to identify bias in a source.

By the end of the training:

The learner will be able to choose the best information for a particular real world
situation.

The content of this module will be asynchronous, but it will support and reinforce the concepts
of the face-to-face, synchronous library instruction sessions. The asynchronous portion will be
embedded in a larger Library component of the eLc in an effort to support and reinforce the
face to face meetings, not replace them. With the idea that this content will be static and
asynchronous, the materials will need to be interactive, i.e. not a simple click through tutorial.
It will also need to be easily embedded into the school eLc to increase ease of use and integration
for the faculty members. This is crucial to buy-in from both students and faculty. The materials
themselves will be used both before and after these required library sessions to prepare and
reinforce the concepts that are discussed in both required library sessions.

5
Alpha Test
Purpose:
The purpose of this Alpha Test is to identify potential challenges with the User Interface.

Reviewers
Name
Liz Riley
FYES Student
FYES Student
FYES Student
FYES Student

Gender
F
TBD

Education
PhD

Job Title
Professor

Area
Instruction

TBD
TBD

Procedure
The reviews will perform a test run of the module with the designer (Chris) observing.

Assessment Criteria
The reviewers will be focusing on:

Usability of the module

The layout of the module
The amount of content per slide (too much or too little)

Instruments
The reviewers will submit a questionnaire. The designer will also observe and take notes as the
reviewers use the module.

6
Beta Test
Purpose:
The purpose of this test is to determine if the lesson supports the learning outcomes.
Reviewers
Name
Liz Riley
FYES student
FYES Student
FYES Student

Gender
F
TBD
TBD
TBD

Education
PhD

Job Title
Professor

Area
FYES

Procedure
The reviewers will be given access to the new module. The reviewers will be given a written pretest that discusses the learning objectives. Once the written test is complete, the reviewers will
view the learning content in the module, answer all of the questions in the module and share
their results with the designer. The results of the pre-test and the online quizzes will be reviewed
to see if the learning objectives were met. The reviewers will also complete an exit questionnaire
that will provide them with the opportunity to share responses to open ended questions.
Assessment Criteria
The reviewers will be focusing on:

Learning outcomes.
Learners experience.

7
Appendix A: Alpha Test Exit questionnaire

Directions:
Please take a moment to give provide some feedback.

Evaluation Scale: 1=Poor 2=Fair 3=Good 4=Excellent 5=Superior

Overall look and feel

Layout

Question placement/readability

Feedback within the module

Ease of use

Navigation

Additional comments/suggestions/concerns:

8
Appendix B: Beta Test
Survey
Directions:
Please take a moment to give provide some feedback.

Evaluation Scale: 1=Poor 2=Fair 3=Good 4=Excellent 5=Superior

Overall look and feel

Questions/scenario effectiveness

Question order/arrangement

Meets lesson objectives

Navigation

Additional comments/suggestions/concerns: