Documentos de Académico
Documentos de Profesional
Documentos de Cultura
a r t i c l e
i n f o
Article history:
Available online 22 September 2014
Keywords:
Knowledge-based recommender systems
Context-aware systems
Semantic Web
Ontology reasoning
a b s t r a c t
Recommender systems are used to provide ltered information from a large amount of elements. They
provide personalized recommendations on products or services to users. The recommendations are
intended to provide interesting elements to users. Recommender systems can be developed using different techniques and algorithms where the selection of these techniques depends on the area in which they
will be applied. This paper proposes a recommender system in the leisure domain, specically in the
movie showtimes domain. The system proposed is called RecomMetz, and it is a context-aware mobile
recommender system based on Semantic Web technologies. In detail, a domain ontology primarily
serving a semantic similarity metric adjusted to the concept of packages of single items was developed
in this research. In addition, location, crowd and time were considered as three different kinds of contextual information in RecomMetz. In a nutshell, RecomMetz has unique features: (1) the items to be recommended have a composite structure (movie theater + movie + showtime), (2) the integration of the time
and crowd factors into a context-aware model, (3) the implementation of an ontology-based context
modeling approach and (4) the development of a multi-platform native mobile user interface intended
to leverage the hardware capabilities (sensors) of mobile devices. The evaluation results show the efciency and effectiveness of the recommendation mechanism implemented by RecomMetz in both a
cold-start scenario and a no cold-start scenario.
2014 Elsevier Ltd. All rights reserved.
1. Introduction
Recommender systems are software tools and techniques providing suggestions for items to be of use to a user (Ricci, Rokach,
& Shapira, 2011). Recommender systems began to appear in the literature in the early nineteens, specically, the Tapestry mail system (Goldberg, Nichols, Oki, & Terry, 1992) is considered the rst
recommender system since the collaborative ltering concept
was coined (Resnick & Varian, 1997).
Recommender systems can be classied into ve different categories depending on the technique employed to predict the utility
of the items for the user, i.e., according to the recommendation
technique:
Corresponding author.
E-mail
addresses:
luisomar.colombo@um.es
(L.O.
Colombo-Mendoza),
valencia@um.es
(R.
Valencia-Garca),
alejandro.rodriguez@unir.net
(A. Rodrguez-Gonzlez), galor@itorizaba.edu.mx (G. Alor-Hernndez), jsamper@
irtic.uv.es (J.J. Samper-Zapater).
http://dx.doi.org/10.1016/j.eswa.2014.09.016
0957-4174/ 2014 Elsevier Ltd. All rights reserved.
1. Content-based recommender systems: these systems recommend items that are similar to the ones that the user liked
in the past.
2. Collaborative ltering recommender systems: these systems
recommend to the active user the items that other users
with similar tastes liked in the past.
3. Demographic recommender systems: these systems recommend items based on the identication of the demographic
niche the user ts better according to a personal demographic prole.
4. Knowledge-based recommender systems: these systems recommend items based on either inferences about user preferences or specic domain knowledge about how items
meet user preferences.
5. Hybrid recommender systems: these systems are based on the
combination of the above mentioned techniques.
Nowadays, recommender systems have taken advantage of
Semantic Web technologies to efciently overcome the challenges
1203
1204
Table 1
Comparison of proposals for context-aware recommendation (KB = knowledge-based, CFB = collaborative ltering-based, CB = content-based; PrF = pre-ltering, PoF = postltering, CM = contextual modeling, PB = programming-based, DMB = data model-based, OB = ontology-based).
Work
Kind of recommender
system (RS)
KB
CFB
Group corrections-driven
ltering (Blanco-Fernndez
et al., 2011)
Context-aware collaborative
ltering using genetic
algorithm (CACF-GA) (Dao
et al., 2012)
Wang and Wu (2011)
Yang, Cheng, and Dia (2008)
SigTur/E-destination (Moreno,
Valls, Isern, Marin, & Borrs,
2013)
Fang et al. (2012)
iConAwa (Ylmaz and Erdur,
2012)
Turist@ (Batet, Moreno, Snchez,
Isern, & Valls, 2012)
Filtering technique
Context-aware
approach
Ontology-based
context model
PrF
PB
X (item-based)
X (user-based)
Unknown
X (user-based)
X (item-based)
CB
X (user-based)
X (user-based)
X (user-based)
X (user-based)
X (user-based)
X
X
X
N/A (expert system)
X (user-based)
visiting time is not computed as the time in hours and minutes but
as a class representing the period to which the time corresponds:
morning, lunch time, afternoon and so on. Lee et al. (2014) did
not interpret crowd as the amount of people around the smart
TV system but as the kind or audience or companion so that the
appropriateness of the multimedia content for the audience
around the user accessing the system is determined by using the
Motion Picture Association of America (MPAA) rating system.
Table 1 presents a comparative analysis of context-aware recommender systems reviewed in the literature. This comparative
analysis considered the following factors: (1) kind of recommender
system, (2) ltering technique, (3) context-aware approach, (4)
context modeling approach; and (5) context dimensions.
2.1.1. Geo-recommender systems
According to Carretero, Isaila, Kermarrec, Taiani, and Tirado
(2012) geo-recommendation is the ability to recommend places
of possible interest to a user. We have adjusted this denition to
cover location-awareness as follows: the ability to recommend
places of possible interest to a user taking into account both the
current geographical location of the user and the geographical
location of the places. As it can be inferred, this new denition
of geo-recommendation takes into consideration the dynamic nature of users locations allowing for mobility, a concept from
mobile computing that is further described in Section 2.3 of this
paper. This is how recommender systems and mobile computing
converge in geo-recommender systems research. Some already
existing proposals supporting this asseveration are discussed
below. Fang et al. (2012) proposed a recommender system for
PoF
CM
Out-door scenario:
location, in-door
scenario: companion
and motivation
Location
X
X
Location
Location, time and
crowd
X
X
X
Location
X
Location
Location
X
X
OB
X
DMB
Context dimensions
X
X
Location
Location
Location
1205
Table 2
Comparison of proposals for geo-recommendation.
Work
Geo-localization technology
Geo-recommendation technique
1206
Table 3
Comparison of proposals for knowledge-based recommendation.
Work
SMARTMUSEUM (Ruotsalo
et al., 2013)
SR-REJA-3D (Noguera et al.,
2012)
iTravel (Yang and Hwang,
2013)
Lee et al. (2014)
Group corrections-driven
ltering (BlancoFernndez et al., 2011)
SigTur/E-destination
(Moreno et al., 2013)
Turist@ (Batet et al., 2012)
Ontology
population
technique
Web crawling
N/A
Tourism (points of
interest (POIs))
Leisure (movies)
N/A
N/A
E-commerce
Web crawling
Manual population
by domain experts
N/A
Domain
Explicit
user
feedback
User behavior
(implicit user
feedback)
Ontology-based
user prole
Rating scale
Qualitative
(binary)
Group
proles
(stereotypes)
Quantitative
(ve-stars)
Quantitative
(ten-stars)
Quantitative
(tag-based
ve- stars)
Quantitative
(ten-stars)
Quantitative
(ve-stars)
Qualitative
(ve-stars)
Table 4
Comparison of proposals for mobile recommendation.
Work
Telecommunications network
technology
Wireless LAN
Cellular networks
Wireless LAN (peer-to-peer
networks)
Wireless LAN
Wireless LAN and cellular networks
1207
1208
1
eki
x f ix Distanceu;mTi
(5)
(6)
(7)
(8)
1209
Google
Geocoding API
IMDB API
Time-aware
Service
Foursquare API
Domain
Database
Locaon-aware
Service
Informaon Collector
User
Database
Crowd-aware
Service
Context-aware Subsystem
Knowledgebased
Recommender
Domain
Ontology
User proler
User Interface
Google Movies
Showmes
User Check-in
Subsystem
Recommendaon Engine
Data Repository
Client
(Mobile device)
Server
Fig. 1. RecomMetzs architecture.
Theaters
List
Showmes
List
(ltered)
14.
12.
9.
Locaonaware Service
8.
User
prole
5.
15.
10.
Theaters
List
Movies
Simmil.
Matrix
(ltered)
List
13.
4.
User
Interface
1.
2.
User
Proler
16.
7.
Knowledge-based
Recommender
Time-aware
Service
3.
6.
User
Database
Domain
Database
Informaon
Collector
11.
Acve User
Google Distance
Matrix API
Fig. 2. Partial view of the functioning of RecomMetz.
1210
http://www.mysql.com/.
https://babbage.inf.unibz.it/trac/obdapublic/wiki/Example_MovieOntology#no1.
theaters. On the other hand, the movieTheaterUserCounter datatype is as an indicator of the location of the already served users in
movie theaters; thereby, it is interpreted as the crowd information
of the active users in RecomMetz. Unlike the crowd information,
the location and time information of each active user in RecomMetz is modeled by means of his user prole as is pointed out in
Section 4.4.3 of this paper.
1211
Finally, as explained in Section 4.4.1.1 of this work, the Information Collector is also leveraged for other purposes not concerning
ontology population. In fact, the Information Collector acts as a
broker for the Google Distance Matrix API, which is used by the
Location-aware Service to calculate distances between origins
and destinations. Similarly, the Information Collector acts as a broker for the Foursquare Venues API, which is used by the User Checkin Subsystem to know the number of people at movie theaters in
real-time.
http://www.imdb.com/.
1212
theaters, i.e., it is responsible for discarding all the movies are currently not in movie theaters (time-related pre-ltering, phase 1). In
detail, the time-aware service operates at the domain ontology
level, and it is in charge of identifying all the individuals of the
Movie class that are actually related to at least one individual
of the MovieTheater class via the isShownIn object property.
Furthermore, at a higher level of abstraction, the time-aware
service is responsible for estimating the likelihood of movie showtimes attendance according to formula (2) (leeway). For this purpose, the time required to get to all the movie theaters (instances
of the MovieTheater class resulting from the previous pre-ltering operations) from the active users current location is rst calculated by sending a series of HTTP requests to the Google Distance
Matrix API. In fact, this task is actually performed by the Location-aware Service because both the distances and times between
locations can be retrieved in the same response from the Google
Distance Matrix API.
4.4.1.3. Crowd-aware Service. The crowd-related post-ltering
relies on the estimation of not only the amount of people already
crowded at the movie theater that is likely to be visited by the
active user but also the amount of people (already server users)
that are attending the same showtime that the active user is likely
to attend. This estimation is done by the Crowd-aware Service by
analyzing the people counters maintained by the User Check-in
Subsystem in the domain ontology. In detail, for each recommendation to be presented to the active user, i.e., for each result in
the output of the previous pre-ltering operation, a value representing the amount of people at the intended movie theater is
retrieved by analyzing the corresponding individual of the MovieTheater class whereas a value representing the amount of already
served users attending the intended showtime is retrieved by analyzing the corresponding individual of the Showtime class. Similarly, the amount of already served users attending each one of the
simultaneous showtimes at the same movie theater is retrieved by
analyzing all the individuals of the Showtime class that are
linked to the corresponding individual of the Movie Theater class
via the isShownAt object property.
For each intended showtime, a more realistic value representing
the amount of attendants is calculated as follows: (1) summarizing
the values representing the amount of already served users attending each one of the simultaneous showtimes, (2) subtracting the
resulting value to the value representing the amount of people at
the intended movie theater, (3) dividing the resulting value by
the amount of concurrent showtimes and (4) adding the resulting
value to the original value.
The resulting data set is used as input for calculating quartiles
as in the case of the location-related pre and post-ltering so that
four equal groups of data are obtained also for the variable crowd.
The values assigned at this stage along with the values assigned at
the location-related post-ltering are then used by the recommendation engine to compute the nal recommendations as explained
below.
4.4.2. Knowledge-based recommender
Unlike other recommendation approaches related to the movies
domain, our proposal is intended to recommend showtimes for the
movies currently in movie theaters instead of simply recommending movies as content. Therefore, there are not one but three
different reference classes in the domain ontology: Movie,
MovieTheater and Showtime so that the items to be recommended are triples composed of an individual of the Movie class,
an individual of the MovieTheater class and an individual of the
Showtime class at the same time.
In detail, the triples are recommended to users starting from
both the information available about user contexts (time, location
Sab Similarity a; b
#P
X
commona; b; Pi
weightPi:
1213
1214
I like Thor,
I like CINESA,
I do not
20:00hrs
showme
CaptainAmerica, NEOCINE,
21:05hrs
Userprole
0.75
0.70
0.90
I like Thor,
I like CINESA,
I do not
20:05hrs
showme
Preferencesa
rray
*
Thor, CINESA, 20:00hrs
[0]
(0.5+0.5+(-0.5))/3
=0.166
=
0.1245
Recommendaons
compung
Similariesm
atrix
Fig. 3. Recommendations computing process.
fact, the user prole updating is the rst phase of the context-aware
recommendation process proposed in this work. From this perspective, along with the active users preferences, the current location of
the user as well as the time-related information, namely the hour,
minute and period at which the user made the recommendation
request are tracked by the rich user interface running in his mobile
device. They are sent to the user proler as input parameters for the
user prole updating process and, in general, for the recommendation process. Similarly, user proles also store visiting histories;
nevertheless, they do not need to be updated when new entries
in visiting histories are generated because they are updated when
the ratings for the triples related to the entries are given.
Provisional proles are built according to the responses given by
potential users to a series of questions presented during user
authentication process. These questions are intended to reveal the
factors affecting the decisions about what movie to watch, where
to watch it and when (what time) to watch it. In addition, specic
interests for each one of the factors addressed in the questionnaire
are required to users in order to provide recommendations as accurate as possible from the beginning. For instance, if a question about
decisive factors is: do you choose a movie to watch by the genre
that it belongs to?; then, the complementary question about specic preferences might be: do you like drama movies?. Obviously,
the complementary question would be selected by the user proler
only if an afrmative reply is given to the rst question. As it can be
inferred, these sample questions are related only to the Movie reference class of the domain ontology; however, there are also questions related to the remaining of the reference classes, i.e., the
MovieTheater and Showtime classes.
It is important to notice that the above outlined technique is
intended to alleviate the cold-start problem by propagating the
preferences explicitly stated by users either over a hierarchy of
classes in the ontology e.g. over all the instances of the NightShowtime subclass of the Showtime class or over a set of
instances fullling a SPARQUL query, e.g. over all the instances of
the Movie class where the related Genre is drama. The former
case is depicted in Fig. 3. At the same time, it allows the recommendation engine to determine the weights for the properties
(object and datatype properties in the domain ontology) to be
taken into account in computing the matrix of similarities. In fact,
the questions about decisive factors are closely related to properties of the domain ontology so that the weights of the properties
are practically determined by users through answering the questionnaire presented during user account creation. For instance,
the above outlined question about decisive factors (do you choose
a movie to watch by the genre that it belongs to?) is closely related
to the property belongsToGenre of the domain ontology.
Both, the responses to the questionnaire presented during user
account creation and the preferences explicitly stated by users as
them interact with the recommender system, are internally represented as values from the following 5-point rating scale: strongly
liked, liked, indifferent, disliked and strongly disliked. It is important to notice that, for usability purposes, the proposed evaluation
scale uses qualitative values as opposed to the quantitative values
used by most of the recommendation approaches related to our
work (see Section 2.2 of this paper). Indeed, these qualitative values are internally matched to quantitative (numerical) values in
order to enable RecomMetz to process ratings. The matching is
as follows: strongly liked = 1, liked = 0.5, indifferent = 0, disliked = 0.5 and strongly disliked = 1.
As part of the information to be established during user account
creation, there also are settings related to context-aware variables.
We have proposed a 5-point Likert-type scale to represent the
importance (the weights from the user perspective) for the context-aware variables involved in the post-ltering operations, i.e.,
the location and crowd variables. It is important to notice that this
1215
http://phonegap.com/.
1216
2. Recommendaons
compung
Preferences
feedback
1. Prole
establishment
5. Pending rang
nocaon
6. Rang
GPS sensor
System
me
Recommendaons
compung
Recommendaon
feedback
4. User check-in
Fig. 5. (a) Check-in at a movie theater, (b) rating a movie showtime triple.
2. As a result, an initial set of recommendations is automatically computed by RecomMetz starting from both the
provisional preferences and some contextual information
collected from the users mobile device (GPS sensor and
system time). As it can be inferred, the potential user
1217
5. Evaluation
5.1. Metrics
In order to measure the performance of RecomMetz, the precision, recall and f-measure metrics from the Information Retrieval
literature (Salton & McGill, 1986) were used. In detail, these
metrics are intended to evaluate the efcacy and effectiveness of
information retrieval systems, mainly focusing on the quality of
the retrieval output.
Precision, recall and f-measure metrics have traditionally been
preferred to other methods for evaluating information retrieval
systems (Raghavan, Bollmann, & Jung, 1989). Furthermore, they
have been more recently applied to recommender systems because
recommender systems are usually considered a particular case of
personalized information retrieval systems (Fang et al., 2012; Lee
et al., 2014; Ruotsalo et al., 2013). For instance, in (Ruotsalo
et al., 2013) a two-part evaluation method comprising a series of
laboratory experiments and a set of user trials was proposed in
order to evaluate both the ltering performance of a recommender
system and its usability in real-life scenarios, respectively. Ruotsalo et al. measured the performance of a recommender system as
the accuracy of its underlying computational algorithms, namely
ontology-based reasoning, query expansion and clustering) in
terms of precision and recall.
In detail, precision allows measuring the ability of a system to
retrieve as many relevant documents as possible in response to a
request whereas recall allows measuring the ability of a system
to retrieve as few non-relevant documents as possible in response
to a request. Here, a document is considered to be relevant if it is
judged by the user to be of interest; otherwise, it is considered to
be non-relevant. F-measure is the harmonic mean of precision
and recall.
In this research, precision and recall metrics were contextualized to the Recommender Systems eld, specically to the scope
of knowledge-based recommender systems in the sense that the
outcome of the system to be evaluated are not documents
(unstructured or semi-structured data) but semantically described
items (structured data) inferred from previous user experiences.
Likewise, as usual in personalized recommendation processes,
there is no a specic query as input. The contextualization of the
aforementioned metrics is described below.
In addition, a standard software metric intended to measure the
quality of the RecomMetzs client application in terms of response
time, i.e., in terms of performance, was used as an indicator of the
computational complexity of the context-aware recommendation
algorithm implemented by RecomMetz. For this purpose, we
Precision
where Correctly recommended items is the number of items classied as relevant by the user that are recommended by RecomMetz.
Total recommended items is the total number of items recommended
by RecomMetz.
Recall is interpreted as the RecomMetzs ability to recommend
as few non-relevant items as possible. It can be calculated by
means of formula (7). As it can be inferred, an item is considered
to be non-relevant if it is disliked by the user.
Recall
F measure
2 precision recall
precision recall
Tmean
TXmean
P
Tmean
Ti
;
N
for i 1 to N
1218
about 300 m. and 5 min. walking from the campus whereas the farthest movie theater to the campus is CINESA-Nueva Condomina,
which is about 9 km. and 16 min. driving from the campus. Similarly, the nearest movie theater to the campus Campus de Espinardo is NEOCINE-El Tiro, which is about 700 m. and 9 min.
walking from the campus, specically from the faculty of education
whereas the farthest movie theater to the campus is CINESANueva Condomina, which is about 6 km. and 11 min. driving from
the campus, specically from the faculty of education. Although in
this scenario the inferring of the nearest and farthest movie theaters (destinations) to a campus do not depend on the faculty that
is considered as the origin of the route, the distances as well as the
times may vary because of the proximity of the faculties in a campus. For instance, in the case of the campus Campus de Espinardo, the two faculties farthest away from one another are the
faculty of informatics and the faculty of education, which are about
1.5 km. walking from one another.
5.3. Solution
At the beginning of the user test, the mobile devices were congured to effectively communicate with the BlazeMeters mobile
application recording technology; then, the participants were
asked to create their user accounts by interacting with RecomMetz
for the rst time. As a result, the corresponding provisional user
proles were generated by RecomMetz. In detail, the participants
were indirectly asked about movies, movie theaters and showtimes they potentially like or dislike thanks to the classication
capabilities of the ontology reasoning mechanism implemented
by the system. For instance, preferences related to motion picture
technologies, seating systems at movie theaters, comfort and luxury features of movie theaters, movie genres, actors/actresses,
awards and nominations of movies and showtime periods were
collected by means of the questionnaires presented to the participants. As it was explained in Section 4.4.3 of this paper, the questionnaires served for two purposes: on the one hand, they allowed
for inferring specic preferences such as the actors a user like; on
the other hand, they allowed identifying the factors that are relevant to the users in selecting movie showtimes; these factors were
then leveraged by RecomMetz in computing the similarities
between the movie showtimes in the recommendation space.
Once the user proles were generated, RecomMetz was able to
automatically obtain recommendations. For this purpose, a search
space composed of 83 movie showtimes was rst formed starting
from four movies in movie theaters: Into the Storm, Guardians
of the Galaxy, Lucy and El Nio, the ve movie theaters mentioned in the use case and a total of 65 showtimes. Here, the movies were randomly selected. In fact, each participant in the
evaluation was previously asked to classify each one of the movie
showtimes in the search space either as relevant or non-relevant to
his interests, i.e., either as a movie showtime he would like to
attend or a movie showtime he would not like to attend.
Finally, the recommendations generated by RecomMetz were
analyzed in order to identify, among other values, the values that
were used as input parameters for metrics described in Section 5.2
of this paper, namely how many of the movie showtimes in the
search space were presented (parameter total recommended items),
how many of the movie showtimes classied as relevant (parameter relevant items) and non-relevant by the participants were presented as well as the hits of RecomMetz in classifying the movie
showtimes in the search space as relevant (parameter correctly recommended items) and non-relevant according to the classication
made by the user. This last parameter was determined by comparing the user and system classications. Once the values were
obtained, they were substituted in formulas (6) and (7). Then,
the results from formulas (6) and (7) were used as input
1219
parameters for formula (8). Thereby, the precision, recall and fmeasure of the system were determined. The analysis of the results
of these measures is presented in the following section of this
paper.
It is important to notice that, the test was repeated once with
the aim of depicting the RecomMetzs performance under normal
circumstances, i.e., under a no cold-start scenario. In detail, each
participant in the evaluation was asked to select and rate one of
the movie showtimes recommended by RecomMetz. For this purpose, the geographical positions of the participants were statically
set in order to simulate the arrivals to the corresponding movie
theaters and allow checking into them. This eliminated the need
of actually visiting movie theaters during the user test.
5.4. Results
Table 5 depicts the results obtained from applying formulas
(6)(8) to the recommendations generated by RecomMetz along
the two executions of the test for each participant. The input
parameters used in each case are also depicted. In detail, column
Relevant-User represent the parameter relevant items whereas
column Non-Relevant-User represent the opposite, i.e., the
amounts of movie showtimes in the search space classied as
non-relevant by the participants. Column Relevant-System represents the parameter correctly recommended items whereas column Non-Relevant-System represents the opposite, i.e., the
amounts of hits of RecomMetz in classifying the movie showtimes
in the search space as non-relevant according to the classications
made by the participants. Finally, column Recommended represents the parameter total recommended items.
As it can be inferred from the results of the rst execution of the
test (cold-start scenario), RecomMetz was able to correctly recommend 7 out of 8 movie showtimes in the best-case scenario, which
is equivalent to a precision value of 88% (for user G). On the
opposite, RecomMetz was able to correctly recommend 5 out of
7 movie showtimes in the worst-case scenario, which represents
a precision value of 71% (for user A). Hence, the average precision
value of RecomMetz in the cold-start scenario was 81%. In fact, the
precision rate of RecomMetz reached more than 80% in most cases
(5 out of 8 users).
Similarly, RecomMetz was able to correctly recommend 6 out of
7 movie showtimes labeled as relevant by the user in the best-case
Table 5
Results of precision, recall and f-measure measurement.
Group
User
A
B
C
D
E
F
G
H
Average
Execution
Relevant
Non-relevant
Recommended
Precision
Recall
F-measure
69
67
71
71
74
73
7
9
6
8
7
9
0.714285714
0.888888889
0.833333333
0.75
0.857142857
0.888888889
0.555555556
0.888888889
0.625
0.75
0.857142857
0.888888889
0.625
0.888888889
0.714285714
0.75
0.857142857
0.888888889
78
76
74
74
77
74
76
74
73
71
72
72
5
8
6
7
5
9
0.8
0.75
0.833333333
0.857142857
0.8
0.777777778
0.8
0.857142857
0.555555556
0.666666667
0.666666667
0.777777778
0.8
0.8
0.666666667
0.75
0.727272727
0.777777778
7
6
4
5
74
75
76
75
71
73
71
71
8
7
5
6
0.875
0.857142857
0.8
0.833333333
0.777777778
0.75
0.571428571
0.625
0.823529412
0.8
0.666666667
0.714285714
5
6.5
75.5
74.625
72.125
71.5
6.125
7.875
0.814136905 (81%)
0.825396825 (83%)
0.676140873 (68%)
0.775545635 (78%)
0.735070505 (74%)
0.796230159 (80%)
User
System
User
System
1
2
1
2
1
2
9
9
8
8
7
9
5
8
5
6
6
8
74
74
75
75
76
74
1
2
1
2
1
2
5
7
9
9
6
9
4
6
5
6
4
7
1
2
1
2
9
8
7
8
1
2
7.5
8.375
1220
Table 6
Results from the load test automated by using the BlazeMeter workbench.
Group
User
Execution
B
C
B
D
E
F
G
H
Ti (milliseconds)
1
2
1
2
1
2
610
605
605
600
595
595
1
2
1
2
1
2
600
595
650
635
590
580
1
2
1
2
635
630
615
615
1 (N = 8)
2 (N = 8)
615
610
90
80
70
60
50
Execuon 1
40
Execuon 2
30
20
10
0
Precision
Recall
F-measure
group context corresponds to crowd information, which is modeled in the domain ontology. Individual context corresponds to
the other kinds of information comprising context, i.e., location
and time, and it is modeled in each user prole. It is important
to notice that, in this research user proles are not modeled using
ontologies as it has been proposed in recent contributions on
knowledge-based recommender systems. Nevertheless, the performance implications of an ontology-based user prole approach are
currently being studied.
We are currently working on the implementation of a feedback
mechanism for the recommendation process that allows adjusting
the semantic similarity metric towards the improvement of the
RecomMetzs performance. From this perspective, the possibility
of rating items not only as a whole but also by means of a specic
feature is being studied as a line of research for this purpose.
Finally, the implementation of a complementary mechanism for
gathering implicit feedback on user preferences is currently being
studied as another line of research for the aforementioned purpose.
In addition, we are currently working on the implementation of a
complementary mechanism for modeling further domain knowledge about movie theaters besides showtimes and lms towards
the computation of more accurate crowd-aware recommendations.
In detail, this mechanism is intended to gather the information
about movie theaters that is not available online, namely, number
of rooms and seating capacities directly from movie theater workers viewed as stakeholders in the information gathering process
implemented by RecomMetz.
Acknowledgments
This work has been supported by the Spanish Ministry of Economy and Competitiveness and the European Commission (FEDER/
ERDF) through project SeCloud (TIN2010-18650). Luis Omar
Colombo-Mendoza is supported by the National Council of Science
and Technology (CONACYT) and the Public Education Secretary
(SEP). In addition, this work was supported by the General Council
of Superior Technological Education of Mexico (DGEST), National
Council of Science and Technology (CONACYT) and the Public Education Secretary (SEP) through PROMEP.
References
Adomavicius, G., & Tuzhilin, A. (2008). Context-aware recommender systems. In
Proceedings of the 2008 ACM conference on recommender systems (pp. 335336).
New York, NY, USA: ACM.
Batet, M., Moreno, A., Snchez, D., Isern, D., & Valls, A. (2012). Turist@: Agent-based
personalised recommendation of tourist activities. Expert Systems with
Applications, 39(8), 73197329. http://dx.doi.org/10.1016/j.eswa.2012.01.086.
Bechofer, S., van Harmelen, F., Hendler, J., Horrocks, I., McGuinness, D. L., PatelSchneider, P. F., et al. (2004). OWL web ontology language reference. Retrieved
from <http://www.w3.org/TR/owl-ref/>.
Berners-Lee, T., Hendler, J., & Lassila, O. (2001). The semantic web. Scientic
American, 284, 3443.
Blanco-Fernndez, Y., Lpez-Nores, M., Pazos-Arias, J. J., & Garca-Duque, J. (2011).
An improvement for semantics-based recommender systems grounded on
attaching temporal information to ontologies and user proles. Engineering
Applications of Articial Intelligence, 24(8), 13851397. http://dx.doi.org/
10.1016/j.engappai.2011.02.020.
Blanco-Fernndez, Y., Pazos-Arias, J. J., Gil-Solla, A., Ramos-Cabrer, M., Lpez-Nores,
M., Garca-Duque, J., et al. (2008). A exible semantic inference methodology to
reason about user preferences in knowledge-based recommender systems.
Knowledge-Based
Systems,
21(4),
305320.
http://dx.doi.org/10.1016/
j.knosys.2007.07.004.
Carrer-Neto, W., Hernndez-Alcaraz, M. L., Valencia-Garca, R., & Garca-Snchez, F.
(2012). Social knowledge-based recommender system. Application to the
movies domain. Expert Systems with Applications, 39(12), 1099011000. http://
dx.doi.org/10.1016/j.eswa.2012.03.025.
Carretero, J., Isaila, F., Kermarrec, A.-M., Taiani, F., & Tirado, J. M. (2012). Geology:
Modular georecommendation in gossip-based social networks. In 2012 IEEE
32nd international conference on distributed computing systems (ICDCS) (pp. 637
646). http://dx.doi.org/10.1109/ICDCS.2012.36.
1221
Cyganiak, R., Wood, D., & Lanthaler, M. (2014). RDF 1.1 concepts and abstract
syntax. Retrieved from <http://www.w3.org/TR/2014/REC-rdf11-concepts20140225/>.
Dao, T. H., Jeong, S. R., & Ahn, H. (2012). A novel recommendation model of locationbased advertising: Context-aware collaborative ltering using GA approach.
Expert Systems with Applications, 39(3), 37313739. http://dx.doi.org/10.1016/
j.eswa.2011.09.070.
Fang, B., Liao, S., Xu, K., Cheng, H., Zhu, C., & Chen, H. (2012). A novel mobile
recommender system for indoor shopping. Expert Systems with Applications,
39(15), 1199212000. http://dx.doi.org/10.1016/j.eswa.2012.03.038.
Forman, G. H., & Zahorjan, J. (1994). The challenges of mobile computing. IEEE
Computer, 27, 3847.
Goldberg, D., Nichols, D., Oki, B. M., & Terry, D. (1992). Using collaborative ltering
to weave an information tapestry. Communications of the ACM, 35(12), 6170.
http://dx.doi.org/10.1145/138859.138867.
Gruber, T. R. (1993). A translation approach to portable ontology specications.
Knowledge Acquisition, 5, 199220.
Gu, T., Wang, X. H., Pung, H. K., & Zhang, D. Q. (2004). An ontology-based context
model in intelligent environments. In Proceedings of communication networks
and distributed systems modeling and simulation conference (pp. 270275).
Jung, J. J. (2009). Contextualized mobile recommendation service based on
interactive social network discovered from mobile users. Expert Systems with
Applications,
36(9),
1195011956.
http://dx.doi.org/10.1016/
j.eswa.2009.03.067.
Lee, W.-P., Kaoli, C., & Huang, J.-Y. (2014). A smart TV system with body-gesture
control, tag-based rating and context-aware recommendation. Knowledge-Based
Systems, 56, 167178. http://dx.doi.org/10.1016/j.knosys.2013.11.007.
Liu, L., Xu, J., Liao, S. S., & Chen, H. (2014). A real-time personalized route
recommendation system for self-drive tourists based on vehicle to vehicle
communication. Expert Systems with Applications, 41(7), 34093417. http://
dx.doi.org/10.1016/j.eswa.2013.11.035.
Lpez-Nores, M., Blanco-Fernndez, Y., Pazos-Arias, J. J., & Gil-Solla, A. (2012).
Property-based collaborative ltering for health-aware recommender systems.
Expert Systems with Applications, 39(8), 74517457. http://dx.doi.org/10.1016/
j.eswa.2012.01.112.
Montaner, M., Lpez, B., & De La Rosa, J. L. (2003). A taxonomy of recommender
agents on the internet. Articial Intelligence Review, 19(4), 285330. http://
dx.doi.org/10.1023/A:1022850703159.
Moreno, A., Valls, A., Isern, D., Marin, L., & Borrs, J. (2013). SigTur/E-destination:
ontology-based personalized recommendation of tourism and leisure activities.
Engineering Applications of Articial Intelligence, 26(1), 633651. http://
dx.doi.org/10.1016/j.engappai.2012.02.014.
Noguera, J. M., Barranco, M. J., Segura, R. J., & Martnez, L. (2012). A mobile 3D-GIS
hybrid recommender system for tourism. Information Sciences, 215, 3752.
http://dx.doi.org/10.1016/j.ins.2012.05.010.
Raghavan, V., Bollmann, P., & Jung, G. S. (1989). A critical investigation of recall and
precision as measures of retrieval system performance. ACM Transactions on
Information Systems, 7(3), 205229. http://dx.doi.org/10.1145/65943.65945.
Resnick, P., & Varian, H. R. (1997). Recommender systems. Communications of the
ACM, 40(3), 5658. http://dx.doi.org/10.1145/245108.245121.
Ricci, F., Rokach, L., & Shapira, B. (2011). Introduction to recommender systems
handbook. In F. Ricci, L. Rokach, B. Shapira, & P. B. Kantor (Eds.), Recommender
systems handbook (pp. 135). US: Springer. Retrieved from http://
link.springer.com/chapter/10.1007/978-0-387-85820-3_1.
Ruotsalo, T., Haav, K., Stoyanov, A., Roche, S., Fani, E., Deliai, R., et al. (2013).
SMARTMUSEUM: A mobile recommender system for the web of data. Web
Semantics: Science, Services and Agents on the World Wide Web, 20, 5067. http://
dx.doi.org/10.1016/j.websem.2013.03.001.
Salton, G., & McGill, M. J. (1986). Introduction to modern information retrieval. New
York, NY, USA: McGraw-Hill Inc.
Schilit, B., Adams, N., & Want, R. (1994). Context-aware computing applications. In
Proceedings of workshop on mobile computing systems and applications (pp. 85
90). http://dx.doi.org/10.1109/MCSA.1994.512740.
Tsai, C.-Y., & Chung, S.-H. (2012). A personalized route recommendation service for
theme parks using RFID information and tourist behavior. Decision Support
Systems, 52(2), 514527. http://dx.doi.org/10.1016/j.dss.2011.10.013.
Turner, R. (2013). Travel & tourism economic impact 2013 World (No. 2013).
London, UK: World Travel & Tourism Council. Retrieved from <http://
www.wttc.org/site_media/uploads/downloads/world2013_1.pdf>.
Wang, S.-L., & Wu, C.-Y. (2011). Application of context-aware and personalized
recommendation to implement an adaptive ubiquitous learning system. Expert
Systems with Applications, 38(9), 1083110838. http://dx.doi.org/10.1016/
j.eswa.2011.02.083.
Wimalasuriya, D. C., & Dou, D. (2010). Ontology-based information extraction: An
introduction and a survey of current approaches. Journal of Information Science,
36(3), 306323. http://dx.doi.org/10.1177/0165551509360123.
Xie, M., Lakshmanan, L. V. S., & Wood, P. T. (2011). CompRec-Trip: A composite
recommendation system for travel planning. In 2011 IEEE 27th international
conference on data engineering (ICDE) (pp. 13521355). http://dx.doi.org/
10.1109/ICDE.2011.5767954.
Yang, W.-S., Cheng, H.-C., & Dia, J.-B. (2008). A location-aware recommender system
for mobile shopping environments. Expert Systems with Applications, 34(1),
437445. http://dx.doi.org/10.1016/j.eswa.2006.09.033.
Yang, W.-S., & Hwang, S.-Y. (2013). ITravel: A recommender system in mobile peerto-peer environment. Journal of Systems and Software, 86(1), 1220. http://
dx.doi.org/10.1016/j.jss.2012.06.041.
1222