Actor-based Incremental Tree Data Processing for Large-scale Machine Learning Applications
A number of online machine learning techniques based on tree model are studied in order to cope with today’s requirements of quickly processing large scale data-sets. We present a design pattern for \emph{incremental tree data processing} as gradually constructing on-demand tree-model on memory. Our approach adopts the actor model as making use of multi-cores and distributed computers without largely rewriting code for algorithms. The pattern basically defines a node in the tree as an actor which is the unit of asynchronous processes and each data instance flows between actor nodes as a message. We study concrete 2 machine learning algorithms, VFDT for decision tree’s top-down growth and BIRCH for hierarchical clustering’s bottom up growth. For supporting VFDT, we propose an extension mechanism of replicating root nodes so that it can address bottleneck as starting of inputs. For supporting BIRCH, we split processes of recursive construction into asynchronous steps with correcting target node by traversing extra horizontal links between sibling nodes. We carried out machine learning tasks with our implementation on top of Akka Java, and we confirmed reasonable performance for the tasks with large scale data-sets.
Tue 22 OctDisplayed time zone: Beirut change
14:00 - 15:30 | |||
14:00 30mTalk | Krestianstvo Luminary: Decentralized Virtual Time for Croquet architecture AGERE Nikolai Suslov Fund for Supporting Development of RT Media Attached | ||
14:30 30mTalk | Actor-based Incremental Tree Data Processing for Large-scale Machine Learning Applications AGERE Kouhei Sakurai Graduate School of Natural Science & Technology, Kanazawa University, Taiki Shimizu Graduate School of Natural Science & Technology, Kanazawa University | ||
15:00 30mTalk | Run, Actor, Run - Towards Cross-Actor Language Benchmarking AGERE Sebastian Blessing Imperial College London, Kiko Fernandez-Reyes Uppsala University, Albert Mingkun Yang , Sophia Drossopoulou Imperial College London, Tobias Wrigstad Uppsala University |