Reconstruct dynamic systems from large-scale open data

Kun Hung Tsai, Chia Yu Lin, Li Chun Wang, Jian Ren Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


With the prosperity of e-commerce, on-line vendors use recommendation systems in different fields. Classic recommendation algorithms are designed assuming that data is stationary and will not change over time. However, since the scale and variability of data are growing gradually, these methods will encounter the issues of the memory deficient and the out-of-date model, which degrade the recommendation accuracy intensively. In addition, retraining the whole model for every new arrival record results in high complexity. In this paper we propose a light-weight adaptive updating method to overcome these issues. Comparing with the explicit feedback recommendation, which asks the customers to express their opinions on the recommended items, the implicit feedback recommendation is easier to collect and non- intrusive way. However, the dynamic time-variant system with implicit feedback has not been seen in the literature. In this paper, we propose a real- time incremental updating algorithm (RI-SGD) to deal with time-variant systems based on the implicit feedback. We compare our method with methods that retraining the whole model and show that our method costs less than 1% of the retraining time with a competitive accuracy.

Original languageEnglish
Title of host publication2015 IEEE Global Communications Conference, GLOBECOM 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479959525
StatePublished - 2015
Event58th IEEE Global Communications Conference, GLOBECOM 2015 - San Diego, United States
Duration: 6 Dec 201510 Dec 2015

Publication series

Name2015 IEEE Global Communications Conference, GLOBECOM 2015


Conference58th IEEE Global Communications Conference, GLOBECOM 2015
Country/TerritoryUnited States
CitySan Diego


  • Adaptive algorithm
  • Concept drift
  • Implicit feedback
  • Recommendation system


Dive into the research topics of 'Reconstruct dynamic systems from large-scale open data'. Together they form a unique fingerprint.

Cite this