OC-DLRM: Minimizing the I/O Traffic of DLRM Between Main Memory and OCSSD

Shang Hung Ti, Tseng Yi Chen, Tsung Tai Yeh, Shuo Han Chen, Yu Pei Liang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Due to the exponential growth of data in computing, DRAM-based main memory is now insufficient for data-intensive applications like machine learning and recommendation systems. This has led to a performance issue involving data transfer between main memory and storage devices. Conventional NAND-based SSDs are unable to efficiently handle this problem as they can't distinguish between data types from the host system. In contrast, open-channel SSDs (OCSSD) offer a solution by optimizing data placement from the host-side system. This research focuses on developing a new data access model for deep learning recommendation systems (DLRM) using OCSSD storage drives, called OC-DLRM. OC-DLRM reduces I/O traffic to flash memory by aggregating frequently-accessed data using the I/O unit of a flash memory drive. Our experiments show that OC-DLRM has significant performance improvement compared with traditional swapping space management techniques.

Original languageEnglish
Title of host publication2024 Design, Automation and Test in Europe Conference and Exhibition, DATE 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350348590
StatePublished - 2024
Event2024 Design, Automation and Test in Europe Conference and Exhibition, DATE 2024 - Valencia, Spain
Duration: 25 Mar 202427 Mar 2024

Publication series

NameProceedings -Design, Automation and Test in Europe, DATE
ISSN (Print)1530-1591

Conference

Conference2024 Design, Automation and Test in Europe Conference and Exhibition, DATE 2024
Country/TerritorySpain
CityValencia
Period25/03/2427/03/24

Keywords

  • deep learning
  • flash memory
  • Open channel SSD
  • recommendation model
  • virtual memory

Fingerprint

Dive into the research topics of 'OC-DLRM: Minimizing the I/O Traffic of DLRM Between Main Memory and OCSSD'. Together they form a unique fingerprint.

Cite this