On Federated Multi-Armed Bandits for Mobile Social Networks

Kazuya Sakai, Takeshi Kitamura, Min Te Sun, Wei Shinn Ku

研究成果: 書貢獻/報告類型會議論文篇章同行評審

摘要

Multi-armed bandits (MABs) are widely used for decision making processes, in which an agent tries to maximize a long-term reward by balancing exploiting and exploring actions. In this paper, we are particularly interested in federated MABs for mobile social networks (MSNs), where a collection of agents learn action values by locally observing rewards and exchanging estimated action values with other agents. Our research differs from the existing federated MABs in the underlying network setting, such that agents can communicate with each other only at opportunistic contact events. To this end, we first design the weighted-connectivity (WC) centrality to quantify the importance of agents in an MSN, and then, we propose the weighted-connectivity upper confidence bound (WC-UCB) algorithm for the MSN contexts. The key idea to reduce biases at each agent and to utilize limited opportunities of federated updates is to prioritize the estimates of action-value functions computed by the agents with a high WC centrality. In addition, the performance bound in terms of the cumulative regret is analyzed. The performance of the proposed algorithm is evaluated by simulations using real mobility traces and the results demonstrate that our WC-UCB outperforms the state-of-the-art algorithms in terms of the average reward and the cumulative regret.

原文???core.languages.en_GB???
主出版物標題Proceedings - 2024 IEEE 44th International Conference on Distributed Computing Systems, ICDCS 2024
發行者Institute of Electrical and Electronics Engineers Inc.
頁面774-784
頁數11
ISBN(電子)9798350386059
DOIs
出版狀態已出版 - 2024
事件44th IEEE International Conference on Distributed Computing Systems, ICDCS 2024 - Jersey City, United States
持續時間: 23 7月 202426 7月 2024

出版系列

名字Proceedings - International Conference on Distributed Computing Systems
ISSN(列印)1063-6927
ISSN(電子)2575-8411

???event.eventtypes.event.conference???

???event.eventtypes.event.conference???44th IEEE International Conference on Distributed Computing Systems, ICDCS 2024
國家/地區United States
城市Jersey City
期間23/07/2426/07/24

指紋

深入研究「On Federated Multi-Armed Bandits for Mobile Social Networks」主題。共同形成了獨特的指紋。

引用此