Grouping-based consistency protocol design for end-edge-cloud hierarchical storage system
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
With the increasing of the number of edge-devices and the demand of real-time experience, the end-edge-cloud hierarchical storage system (EECHSS) is emerged recently for reliable caching and fast offloading of massive amounts of data. EECHSS can accommodate various services, save computing power and improve storage capacity, due to transformation from central-cloud to edge-cloud, considerable reducing service delay and communication overhead. One of the main challenges brought by edge-cloud architecture is consistency problem. It is difficult to guarantee that the data from the two distributed clusters is consistent by existing consistency protocols. In addition, as the variety of applications increases, the existing fixed consistency level of classical protocols can no longer satisfy the system dynamic requirements. In this paper, we focus on designing grouping-based consistency protocols with adaptively selecting consistency level in EECHSS. At first, we analyze the internal structure and the workflow of EECHSS, and devise two modified adaptive grouping-based consistency protocols (GM-Paxos and GEPaxos) with efficient grouping algorithms. Then, for the characteristics that data is offloaded frequently, we design two synchronization strategies to ensure the consistency of the data cached in the edge-cloud and the central-cloud, respectively. Experiments show that, our proposed grouping-based consistency protocols of EECHSS can improve the availability as much as possible while ensuring data consistent.
With the increasing of the number of edge-devices and the demand of real-time experience, the end-edge-cloud hierarchical storage system (EECHSS) is emerged recently for reliable caching and fast offloading of massive amounts of data. EECHSS can accommodate various services, save computing power and improve storage capacity, due to transformation from central-cloud to edge-cloud, considerable reducing service delay and communication overhead. One of the main challenges brought by edge-cloud architecture is consistency problem. It is difficult to guarantee that the data from the two distributed clusters is consistent by existing consistency protocols. In addition, as the variety of applications increases, the existing fixed consistency level of classical protocols can no longer satisfy the system dynamic requirements. In this paper, we focus on designing grouping-based consistency protocols with adaptively selecting consistency level in EECHSS. At first, we analyze the internal structure and the workflow of EECHSS, and devise two modified adaptive grouping-based consistency protocols (GM-Paxos and GEPaxos) with efficient grouping algorithms. Then, for the characteristics that data is offloaded frequently, we design two synchronization strategies to ensure the consistency of the data cached in the edge-cloud and the central-cloud, respectively. Experiments show that, our proposed grouping-based consistency protocols of EECHSS can improve the availability as much as possible while ensuring data consistent.
Description
Keywords
Sponsorship
This work was supported in part by the National Natural Science Foundation of China under Grant 61701136, Grant 61831008, and Grant 61525103, in part by the Guangdong Science and Technology Planning Project under Grant 2018B030322004, in part by The Verification Platform of Multi-Tier Coverage Communication Network for Oceans under Grant PCL2018KP002, and in part by the Shenzhen Basic Research Program under Grant JCYJ20170811154233370 and Grant ZDSYS201707280903305.
Rights:
Citation
S. Gu, Y. Wang, Y. Wang, Q. Zhang and X. Qin, "Grouping-Based Consistency Protocol Design for End-Edge-Cloud Hierarchical Storage System," in IEEE Access, vol. 8, pp. 8959-8973, 2020, doi: 10.1109/ACCESS.2020.2964626.