2012 IEEE 7th International Conference on Networking, Architecture, and Storage

Format:

Book

Author/Creator:

IEEE International Conference on Networking, Architecture, and Storage, author.

Contributor:

IEEE Staff, Contributor.

Language:

English

Subjects (All):

Computer architecture--Congresses.

Computer architecture.

Physical Description:

1 online resource (xviii, 358 pages) : illustrations

Place of Publication:

[Place of publication not identified] IEEE 2012

Language Note:

English

Summary:

Data deduplication, an efficient space reduction method, has gained increasing attention and popularity in data-intensive storage systems. Most existing state-of-the-art deduplication methods remove redundant data at either the file level or the chunk level, which incurs unavoidable and significant overheads in time (due to chunking and fingerprinting). These overheads can degrade the write performance to an unacceptable level in a data storage system. In this paper, we propose P-Dedupe, a fast and scalable deduplication system. The main idea behind P-Dedupe is to fully compose pipelined and parallel computations of data deduplication by effectively exploiting the idle resources of modern computer systems with multi-core and many-core processor architectures. Our experimental evaluation of the P-Dedupe prototype based on real-world datasets shows that P-Dedupe speeds up the deduplication write throughput by a factor of 2~4 through pipelining deduplication and parallelizing hash calculation and achieves 80%~250% of the performance of a conventional storage system without data deduplication.

Notes:

Bibliographic Level Mode of Issuance: Monograph

ISBN:

9780769547220

0769547222