REEFS: An SDN hyper file system based on erasure coding

Zheng Ping Guo; Jehn Ruey Jiang; Yung Liang Lai

doi:10.1109/CompComm.2018.8780613

REEFS: An SDN hyper file system based on erasure coding

Zheng Ping Guo, Jehn Ruey Jiang, Yung Liang Lai

Department of Computer Science and Information Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This study proposes a hyper file system, named REEFS (Resilient Erasure-codE File System), which is based on erasure code (EC) and integrates the technologies of software defined networking (SDN) and the distributed file system (DFS). REEFS utilizes the EC to encode a data object or file into \boldsymbol{n} blocks for storing in \boldsymbol{n} storage nodes in the DFS. REEFS is fault-tolerant since any \boldsymbol{k} out of the \boldsymbol{n} blocks can recover the data object. An algorithm, called Residual Network Multiple Shortest Path (RNMSP), is developed for finding the shortest paths from the file source to \boldsymbol{n} storage nodes to reduce the file data block transmission latency, while maintaining high data availability. The shortest paths are used by the SDN controller to manage SDN switches to forward block data. The RNMSP algorithm is compared with other related algorithms to show its superiority in terms of the average file transmission latency.

Original language	English
Title of host publication	2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	619-623
Number of pages	5
ISBN (Electronic)	9781538683392
DOIs	https://doi.org/10.1109/CompComm.2018.8780613
State	Published - Dec 2018
Event	4th IEEE International Conference on Computer and Communications, ICCC 2018 - Chengdu, China Duration: 7 Dec 2018 → 10 Dec 2018

Publication series

Name	2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018

Conference

Conference	4th IEEE International Conference on Computer and Communications, ICCC 2018
Country/Territory	China
City	Chengdu
Period	7/12/18 → 10/12/18

Keywords

Distributed file system
Erasure code
Fault-tolerance
Software defined networking

Access to Document

10.1109/CompComm.2018.8780613

The Cyber-Physical Smart Factory of Electronic Parts and Components Manufacturing( II )
Jiang, J.-R. (PI)
1/10/17 → 30/09/18
Project: Research

Cite this

Guo, Z. P., Jiang, J. R., & Lai, Y. L. (2018). REEFS: An SDN hyper file system based on erasure coding. In 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018 (pp. 619-623). Article 8780613 (2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CompComm.2018.8780613

@inproceedings{eb93087a55864e6a85040501c24146e3,

title = "REEFS: An SDN hyper file system based on erasure coding",

abstract = "This study proposes a hyper file system, named REEFS (Resilient Erasure-codE File System), which is based on erasure code (EC) and integrates the technologies of software defined networking (SDN) and the distributed file system (DFS). REEFS utilizes the EC to encode a data object or file into \boldsymbol{n} blocks for storing in \boldsymbol{n} storage nodes in the DFS. REEFS is fault-tolerant since any \boldsymbol{k} out of the \boldsymbol{n} blocks can recover the data object. An algorithm, called Residual Network Multiple Shortest Path (RNMSP), is developed for finding the shortest paths from the file source to \boldsymbol{n} storage nodes to reduce the file data block transmission latency, while maintaining high data availability. The shortest paths are used by the SDN controller to manage SDN switches to forward block data. The RNMSP algorithm is compared with other related algorithms to show its superiority in terms of the average file transmission latency.",

keywords = "Distributed file system, Erasure code, Fault-tolerance, Software defined networking",

author = "Guo, {Zheng Ping} and Jiang, {Jehn Ruey} and Lai, {Yung Liang}",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 4th IEEE International Conference on Computer and Communications, ICCC 2018 ; Conference date: 07-12-2018 Through 10-12-2018",

year = "2018",

month = dec,

doi = "10.1109/CompComm.2018.8780613",

language = "???core.languages.en_GB???",

series = "2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "619--623",

booktitle = "2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018",

}

Guo, ZP, Jiang, JR & Lai, YL 2018, REEFS: An SDN hyper file system based on erasure coding. in 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018., 8780613, 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018, Institute of Electrical and Electronics Engineers Inc., pp. 619-623, 4th IEEE International Conference on Computer and Communications, ICCC 2018, Chengdu, China, 7/12/18. https://doi.org/10.1109/CompComm.2018.8780613

REEFS: An SDN hyper file system based on erasure coding. / Guo, Zheng Ping; Jiang, Jehn Ruey; Lai, Yung Liang.
2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 619-623 8780613 (2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - REEFS

T2 - 4th IEEE International Conference on Computer and Communications, ICCC 2018

AU - Guo, Zheng Ping

AU - Jiang, Jehn Ruey

AU - Lai, Yung Liang

PY - 2018/12

Y1 - 2018/12

N2 - This study proposes a hyper file system, named REEFS (Resilient Erasure-codE File System), which is based on erasure code (EC) and integrates the technologies of software defined networking (SDN) and the distributed file system (DFS). REEFS utilizes the EC to encode a data object or file into \boldsymbol{n} blocks for storing in \boldsymbol{n} storage nodes in the DFS. REEFS is fault-tolerant since any \boldsymbol{k} out of the \boldsymbol{n} blocks can recover the data object. An algorithm, called Residual Network Multiple Shortest Path (RNMSP), is developed for finding the shortest paths from the file source to \boldsymbol{n} storage nodes to reduce the file data block transmission latency, while maintaining high data availability. The shortest paths are used by the SDN controller to manage SDN switches to forward block data. The RNMSP algorithm is compared with other related algorithms to show its superiority in terms of the average file transmission latency.

AB - This study proposes a hyper file system, named REEFS (Resilient Erasure-codE File System), which is based on erasure code (EC) and integrates the technologies of software defined networking (SDN) and the distributed file system (DFS). REEFS utilizes the EC to encode a data object or file into \boldsymbol{n} blocks for storing in \boldsymbol{n} storage nodes in the DFS. REEFS is fault-tolerant since any \boldsymbol{k} out of the \boldsymbol{n} blocks can recover the data object. An algorithm, called Residual Network Multiple Shortest Path (RNMSP), is developed for finding the shortest paths from the file source to \boldsymbol{n} storage nodes to reduce the file data block transmission latency, while maintaining high data availability. The shortest paths are used by the SDN controller to manage SDN switches to forward block data. The RNMSP algorithm is compared with other related algorithms to show its superiority in terms of the average file transmission latency.

KW - Distributed file system

KW - Erasure code

KW - Fault-tolerance

KW - Software defined networking

UR - http://www.scopus.com/inward/record.url?scp=85070831767&partnerID=8YFLogxK

U2 - 10.1109/CompComm.2018.8780613

DO - 10.1109/CompComm.2018.8780613

M3 - 會議論文篇章

AN - SCOPUS:85070831767

T3 - 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018

SP - 619

EP - 623

BT - 2018 IEEE 4th International Conference on Computer and Communications, ICCC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 7 December 2018 through 10 December 2018

ER -

REEFS: An SDN hyper file system based on erasure coding

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Projects

The Cyber-Physical Smart Factory of Electronic Parts and Components Manufacturing( II )

Cite this