Evaluation

My project Form address

https://docs.google.com/forms/d/1zklbi6UQI5ESXrnWilPlWPZzt5fFdNJDAcqPAWHX
COE/viewform
Testers: 5 people in total have been reviewed by the project form and were asked
to provide additional comments regarding the design specification and the
animated video.
Teen:
-

David Nicolet:

Calista Konnings:

Swapnil Nair:

Kid:
-

Thuc Uyen:

Adult:
-

Hieu Nghia:

Evaluate against my specification

My series animations is going to show the effects of stereotype and racism

by examples, what it has done to its victim and the statistics.

Did it achieve this specification?

According to viewers/testers/target market:
-

4/5 testers agreed there was sufficient information presented (clear

statistics, evidence compared against myth etc)
3/5 testers commented the need to explain better (at the British/American
part), more specific evidence
5/5 testers was able to identify all mentioned effects of stereotypes and
what it has on the victim
2/5 commented the need to provide evidence for this part (effects of
stereotypes)
5/5 testers was able to identify all mentioned stereotypes (Black/White
people comparison, American/British comparison)

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved
Comment: although this specification was achieved, according to reviews it can
be improved, particularly by adding more evidence at the stereotype between
British/Americans.
It could also go a bit more in-depth at what stereotypes does to its victims
(provide reason as to why stereotypes have that effect) so that this specification
could be improved

My animated videos will appeal to as many different ages as possible,

especially the younger audience as they still have time to change and are
going to be the influence of the world later on.

According to viewers/testers/target market:

- 4/5 said the video was easy enough to understand and follow

- 1/5 said the guide speak too fast sometimes

- 5/5 agreed the video appeals to both young and mature people
Total amount of people marked this as completed: 5/5
Conclusion: this specification has been achieved
Comment: in my data collection, I reviewed people from different ages, as with
my classmates who is at teen age, my sister, who is 3 years younger than me,
and my fathers colleague, who is an adult. I am aware of the possible bias
towards my product when I ask my sister to review it but I do not know anyone of
younger age here to serve as the even younger target market.
According to the testers, I speak too fast sometime and it is hard for them to
understand me. Slowing down when speaking would be an improvement to be
made.

It is also going to present ways to combat stereotype and racism that

begins with yourself and hopefully reach out to people around you,
potentially those who apply stereotypes on to other people.

According to viewers/testers/target market:

- 5/5 commented that they understood why stereotypes exist from the video
- 5/5 commented that the video helped them evaluate themselves about
stereotypes
Total amount of people marked this as completed: 5/5
Conclusion: this specification has been achieved
Comment: addition comment from the testers reveals that most, if not all of
them have a bias listed on the part do you use stereotypes? and some
commented that they have not realised this before watching this animation
(source: my sister, calista) and the others realised that it is necessary to change.
This proves that this specification has been achieved because either the testers
have learnt more about themselves things they thought knew before or they
realised that they needed to change.
However, it is noted that some of the reviewers commented that I did not
specifically state how you can reach out to other people and influence them and I
should make that part more detailed.

My final design will only consist of colours black and white because it is
more efficient to draw more frames, wrong usage of colours can lead to
terrible visuals even if frame without colour looks nice

According to viewers/testers/target market:

-

5/5 said most of the video was black and white, however, there was 2
separate parts where colours was used, isnt a negative.
o 2/5 critically evaluated that it however, did not follow the
specification, the others took it as a minor but appropriate
adjustment.
4/5 liked the fact that it was minimalistic. The other did not comment

Total amount of people marked this as completed: 3/5

Conclusion: unclear/ partially achieved
Comment:
The decision to change the specification into partially colour was so for 2 reason,
during the making f the video I compared black and white people, my friend
recommended me to use a more realistic colour for black people as the colour
black doesnt fit. In the British/American part I added colour to better represent
and specify the characters and their flags. Reviewers commented that it was a
good idea to add colour but only 2 said that even so, it did not satisfy the
specification.

vibrant in emotion and facial expression

According to viewers/testers/target market:

-

5/5 liked the characters

5/5 can see different facial expressions
4/5 commented that the mood seems to be more focused on happy
o 3/4 said that the guide can expand more on emotion, like
seriousness.

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved
Comment: comment from the testers suggest that there are parts in the video
where the tone is more serious, and the facial expression almost matches, but
his expression isnt completely serious. The testers suggest exaggerate the facial
expression for boost dramatic effect in order to make the part more significant.
Noted, 2 of the reviewers hesitated to mark is specification as complete due to
reasons above but choose to mark it as completed. In order to improve my
animation, advice noted above will be taken into consideration.

good details where it is needed (clothing, assets that will be used)

According to viewers/testers/target market:

-

5/5 reports seeing the effort put into the making of the characters and
assets
5/5 said the characters look aesthetically pleasing
5/5 agreed there are plenty of detail

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved
Comment: the testers scores on the forms suggest a consistent high marks on
the animation quality, which states if the characters represented in this video
was detailed (defined above), additional comments shows that the same
character (guide) faces looks slightly different at scene 2, with his face being
more circle than the 1st one. One commented that it was only slightly distracting.

fluid and smooth animation quality (a lot of frames portraying a movement

in which the frames next to it arent drastically different)

According to viewers/testers/target market:

-

3/5 commented the animated intro is very well made (the animation was
clear and it was received as a continuous motion instead of individual
frame), the others did not comment
o the rest of scene 1 was also good, 3/3 commented that the motion
is not as smooth as the intro
5/5 can see that scene 2 was not animated (except for the eyes)
3/5 said there could be some more character movements
5/5 agreed animator showed sufficient use of different frame to portray
motion

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved
Comment: it is an understatement that the majority of the video was not
animated as seen by both the animator and the audience, however, when there
was animation (intro and scene 1), the reaction was more positive. The reason
why scene 2 was not animated was due to the limited time and experience
alongside with the massive frame count if the whole scene was animated. The
testers claimed to witness enough of my ability to animate that they marked this
specification as complete. However, improvements can be made to better
animate the video such was lip sync and have the character move slightly, this
change is necessary as it is so that the viewer know that they are watching an
animation, not a slideshow.

good body language (movements that fits with the context of the
dialogue, hand gestures for example)

According to viewers/testers/target market:

-

5/5 agreed facial expression matches body language

5/5 agreed appropriate hand gestures for different context

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved

Comment: N/A

Portraying a clear message to everyone, based on my first example,

although not as short as infographics is clearly needed.

According to viewers/testers/target market:

-

3/5 said there was just enough information

o 2/3 said it could go more into detail
5/5 commented that statistics are shown
4/5 agreed that it was easy to follow

Total amount of people marked this as completed: 3/5

Conclusion: unclear/ partially achieved
Comment: whilst most commented that it was easy enough to follow, some
addressed the need for more information and evidence to support the
information being presented, they agreed that most of the time it was backed up
by reliable sources but more proof could be shown for the American/British part.
Improvements could be made so that more information such as statistics could
be given for the American/British part

It does not need to be serious as it appeals to the kids, most people dont
like to read large chunks of text being presented so I will keep mine more
about the visuals.

According to viewers/testers/target market:

-

4/5 said that was easy to follow

2/5 Sometime the audio was too fast
5/5 agreed that subtitles is a good addition to make it easier to understand
o Not counting subtitles as text, 4/5 agreed the visuals and audio
represent most of the information
Could be understood by kids

Total amount of people marked this as completed: 5/5

Conclusion: this specification has been achieved
Comment: refer to comment at specification 2

My list of animated videos will be made for people of any age as racism
and stereotype exist no matter the age.
It does not differentiates any gender, in some cases, genders other than
male/female receives more hatred and being mocked at by normal
people.
it appeals for the younger age more, hence the not so serious aim

Other genders will not be directly mentioned due to policy of country, but
this video spreads to apply its message to anyone of any race, gender,
culture or nationality.

According to viewers/testers/target market:

-

5/5 see that the video did not focus on any gender
5/5 think that the art style are suitable for kids

Total amount of people marked this as completed: 5/5

Conclusion: these specifications have been achieved
Comment: there were no obvious pointers to a specific gender according to the
testers and as before mentioned, testers commented that the art style, the
content is suitable for young audience, according to my younger sisters and my
classmates.

Wishlist:

good lip syncing to voice over

According to viewers/testers/target market:

-

5/5 can see that background noises was distracting (slightly)

4/5 concludes that lip sync is close to voice over

2/5 say that the guide speaks too fast sometimes

Total amount of people marked this as completed: 3/5

Conclusion: needs improvements/ partially achieved
Comment:
Testers consistently states in their reviews that the audio needs improvements
sorely as it has background noises and was sometime too fast for audience to
follow. However, most of the testers commented more positive on lip sync.

Advanced visuals

(cloth folding, more realistic movements and facial expression and very detailed
assets can slow down making time significantly)
According to viewers/testers/target market:
-

5/5 Did not have any signs of cloth folding

5/5 agreed that the character movement is realistic enough (referring to
intro and scene 1)
4/5 see that the assets are detailed, but not to extent described by
specification
5/5 spoke upon the need for other facial expressions (only normal, happy
facial expression shown)

Total amount of people marked this as completed: 1/5

Conclusion: this wish has not been achieved

Comment:
Even though most, if not all the testers agreed on the quality of the character,
most wouldnt agree upon this wish specification, due to how it has been
described. There were no complicated cloth folding and the assets werent
consistently detailed. Some would prefer the minimalistic art style has it is more
appropriate (in their opinion)

Colour

(Considering the aim to maximize the amount of frames colours could be a

problem for a beginner who uses flash animation program and aims to insert
motion into his video)
According to viewers/testers/target market:
-

5/5 said the colour is used appropriately throughout the animation to

demonstrate different situations

Total amount of people marked this as completed: 5/5

Conclusion: this wish has been achieved
Comment: the use of colours was recommended by some testers during the
production phase and it seems the use of colours is appreciated.

old camera cinematics

(The old cinematic look might be applied in appropriate situation if it comes as it

could match the situation well if used correctly, overall a visual effect)
According to viewers/testers/target market:
-

none of the audience reported seeing old camera cinematics

Total amount of people marked this as completed: 0/5

Conclusion: this wish have not been achieved
Comment: old camera cinematics was not used as it was both time consuming
and out of place. The idea was scraped during the making of the animation

How can the Solution be improved? (further improvement)

Based on personal opinions and reviews collected I was able to make a list of
improvements I wanted to add into my solution in-order to satisfy other people.
-

The aesthetics:

The characters:
Clothings of the guide could have more folds and details, like
stripes. How and where the fold is made can be referenced by
looking at ones own shirt. So can the stripes be added so
that they add more details.
Add colour for shirt, skin and hair for the guide
Emphasize the outline of the guide body (using a bigger pen
to make the outline of the character stand out so that he
better contrast with his body and the background
Reason for improvements: I feel the need to improve
the main guide detail so that I can Satisfy a
specification in the wishlist, which isnt achieved based
on testers reviews, it also serve to improve the overall
feel of the animation, making it look better for the
audience
o The subtitles:
Use onion skin to align the subtitles
Reason for improvements: according to some
comments, watching the subtitles waving back and
forth is distracting, so it is in my interest to try and
align the subtitles so that the audience would focus on
the main content rather than the moving subtitles.
o Other assets:
American/British part
Outline the 2 character to make the characters cleaner
Redraw the American person clothes (change colour of
his jacket) and his hand (that is holding the gun)
Put folds on the American person clothes
Reason for improvements: the hand feels clunky and
out of place and so is his jacket, I had a different colour
in mind before but forgot to add it on to the character,
so Id like to replace the current one with an American
flag, so that he would be extra patriotic, which means
a more exaggerated stereotype that adds into the
disproving of such stereotype
The animation:
o Slight movements:
At scene 2 change character sitting position or how he sits
with a few individual frames every once in a while to remind
the audience that this is an animation, not a slide show (for,
example, have the character sit upright from a stretch out
position
Move hands make some minor hand movements as gestures
whilst keeping the body stationary, this should improve the
animation time
Lip synchronization
By improving on the experimental technique used in
scene one (cutting the amount of unnecessary mouth
delay and making more mouth for different syllable
o

and tone) the audio at scene 2 could be animated at

better efficiency
Reason for improvement: many reviewer comment the
lack of animation (except the eyes) over at scene 2. To
improve this, I would add ideas listed above to make
the scene more animated. Its purpose is to also
connect the 2 scene together, body movement and lip
sync are all part of the intended improvements
The information and content:
o Use information gathered about the American/British part from
reliable sources such as educational websites and doing the same
thing for the negative effect stereotypes have on someone elses
o Add charts for a side by side comparison
Reason for improvement: some reviewers express the need
for evidence at parts mentioned above as it was used well in
the black and white part, so the same could be applied with
those parts in the same way. Adding graphs for side by side
comparison clear up information as it can, for example
compare the percentage between obese and non-obese
people.
The audio:
o Record at night when everything is silent
o Use audio device to snip out sounds that arent needed and remove
potential background noises
o Properly pronounce each word and adding a pause between them
(remove pause with sound editing software)
Reason for improvement: the reviewers consistently express
the need for higher quality sound, in order to do so with in my
budget, I try to remove as much background noise as
possible, one way to do that is to record at night when
everyone is asleep, so that the amount of background noises
is even more limited.

Impact of the solution:

-

To what extent has the clients or target audiences problem been solved?
o Design problem summary: it isnt a problem that is usually
discussed due to the fact that a lot of people use it at a time. Some
people can get used to stereotypes, but others cant. this causes
problems for both sides
o According to target audiences:
It helped the target audiences identify their troublesome
inner-self and helped them understand what they are
potentially doing to other people, themselves included
Based on the personal interviews and the form given, it
was identified that the part of the British/American
where the guide goes on to discuss the effect of
stereotypes and whether or not they were using it on
someone elses on. It was also appreciated by the
audience that the guide tried not to contradict himself

by saying that not everyone react that way to racist

jokes, but it can happen as an example.
According the statement above, it has helped them to
evaluate themselves and thus changing their overall
attitude about the problem, this can have a positive
effect on the person who they think they are making
fun of which they did not know before, thus potentially
improving the relationship between both sides. This
means the client problems about stereotypes is solved
in many ways
How does this solution improve the clients or target audiences situation?
o According to target audiences:
As before mentioned, the point of this video is to help the
viewers evaluate themselves about their actions and its
consequences on themselves and other people, according to
the target audiences, this video has improved their situations
by various degree as they all have their own separate lives
and experiences.
To what extent has the design specification been meet?
o According to target audience against the design specification
average: 13/14 (baseline) and 1.5/4 wish list
Conclusion: to a great degree has the solution met with the
design specification requirements, however only a small part
of the wish list was completed, as noted by both the animator
and audiences. This is likely caused by the lack of time and
experience as most, if not all of the specification listed on the
wish list was very hard to achieve properly within time
restraints.
Are there any negative effect this solution could have?
o There were no comment on this matter given by the testers so there
were no definite answer on this question, however based on
personal look one negative effect of this solution could have is
misinterpretation. At the black and white people comparison, I
brought up the statistics showing that white people committed more
crimes, however I then critically compared the percentage of white
people committing a crime to their total accumulation, which is
lower and their black counter parts. This means that the viewer can
still hold on to their stereotypical views about black people and
instead of it being disproven, could be reinforced, having the
opposite effect in what I was hoping to achieve.