A Review on Data Deduplication Techniques in Cloud

Day by day the usage of smart devices is increasing and communication between devices which improves data growth in cloud storage. The growth of data affects the performance of storage system. The data deduplication system can optimize performance of data storage by eliminating redundant data, reducing storage cost and improves storage utilization. Deduplication technique classified into few types based on that it produces results. Along with that data deduplication performs on encrypted data will be used to prevent unauthorized users from accessing data. Subsequently, various methods perform deduplication (file or block level) safely over encrypted data in cloud. This paper represents different methods which have used different deduplication technique.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic €32.70 /Month

Buy Now

Price includes VAT (France)

eBook EUR 160.49 Price includes VAT (France)

Softcover Book EUR 210.99 Price includes VAT (France)

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

Overview of Data Deduplication Technology in a Cloud Storage Environment

Chapter © 2020

A Survey on Efficient Storage and Retrieval System for the Implementation of Data Deduplication in Cloud

Chapter © 2020

SEDS: secure and efficient server-aided data deduplication scheme for cloud storage

Article 15 July 2019

References

  1. OpenDedup: OpenDedup, global inline deduplication for block storage and files. [Online] 2012 Available from: http://opendedup.org/index.php
  2. Douceur, J., Adya, A., Bolosky, W., Simon, D., Theimer, M.: Reclaiming space from duplicate files in a server less cloud file system. In: Cloud Computing Systems, 2002. Proceedings of 22nd International Conference on IEEE, pp. 617–624 (2002) Google Scholar
  3. Drop Box: http://www.dropbox.com. Tion
  4. AmazonS3: http://aws/amazon.com/s3s Google Scholar
  5. Google Drive: http://www.drive.google.com
  6. SNIA: Advanced deduplication concepts. [Online] 2011. Available from http://www.snia.org/sites/default/education/tutorials/2011/fall/DataProtectionManagement/ThomasRiveria_Advanced_Dedupe_Concepts_FINAL.pdf
  7. http://searchdatabackup.techtarget.com/tip/Where-and-how-to-use-data-deduplication-technology-in-disk-based-backup
  8. Meyer, D.T., Bolosky, W.J.: A study of practical deduplication. ACM Trans. Storage (TOS) 7(4), 14 (2012) Google Scholar
  9. Yang, C., Ma, J., Ren, J.: Provable ownership of encrypted files in de-duplication cloud storage. Ad Hoc Sens. Wireless Netw. 26(1-4), 43–72 (2015) Google Scholar
  10. Li, J., Li, Y.K., Chen, X., Lee, P.P.C., Lou, W.: A hybrid cloud approach for secure authorized deduplication. Parallel CloudSystems Trans. IEEE 26(5), 1206–1216 (2015) ArticleGoogle Scholar
  11. Halevi, S., Harnik, D., Pinkas, B., Shulman-Peleg, A.: Proofs of ownership in remote storage systems. In: Proceedings of ACM Conference on Computer and Communications Security, pp. 491–500 (2011) Google Scholar
  12. Bellare, M., Keelveedhi, S., Ristenpart, T.: Message-locked encryption and secure deduplication. In: Advances in Cryptology–EUROCRYPT 2013, pp. 296–312. Springer, Berlin, Heidelberg (2013) Google Scholar
  13. Miguel, R., Aung, K.M.M.: HEDup: secure deduplication with homomorphic encryption. In: International Conference on Networking, Architecture and Storage (NAS), 2015 IEEE, pp. 215–223 (2015) Google Scholar
  14. Bellare, M., Keelveedhi, S., Ristenpart, T.: DupLess: server-aided encryption for deduplicated storage. In: Proceedings of the 22nd USENIX Conference on Security. USENIX Association (2013) Google Scholar
  15. Chen, R., Mu, Y., Yang, G., Guo, F.: BL-MLE: block-level message-locked encryption for secure large file deduplication. Inf. Forensics Sec. IEEE Trans. 26(12), 2643–2652 (2015) ArticleGoogle Scholar
  16. Puzio, P., Molva, R., Önen, M., Loureiro, S.: ClouDedup: secure deduplication with encrypted data for cloud storage. In: 2013 IEEE 5th International Conference on Cloud Computing Technology and Science (CloudCom), vol. 1, pp. 363–370 (2013) Google Scholar
  17. Bugiel, S., Nurnberger, S., Sadeghi, A., Schneider, T.: Twin clouds: an architecture for secure cloud computing. In: Proceedings of Workshop Cryptography Security Clouds, pp. 32–44 (2011) Google Scholar
  18. Storer, M.W., Greenan, K., Long, D.D.E., Miller, E.L.: Secure data deduplication. In: Proceedings of 4th ACM International Workshop Storage Security Survivability, pp. 1–12 (2008) Google Scholar
  19. Li, J., Chen, X., Huang, X., Tang, S., Xiang, Y., Hassan, M., Alelaiwi, A.H.: Secure cloud deduplication systems with improved reliability. Comput. IEEE Trans. 64(12), 3569–3579 (2015) ArticleMathSciNetGoogle Scholar
  20. Blakley, G.R., Meadows, C.: Security of ramp schemes. Proc. Adv. Cryptol. 196, 242–268 (1985) ArticleMathSciNetGoogle Scholar
  21. Santis, A.D., Masucci, B.: Multiple ramp schemes. IEEE Trans. Inf. Theory 45(5), 1720–1728 (1999) ArticleMathSciNetGoogle Scholar
  22. Zhou, Y., Feng, D., Xia, W., Fu, M., Huang, F., Zhang, Y., Li, C.: SecDep: a user-aware efficient fine- grained secure deduplication scheme with multi-level key management. In: 2015 31st Symposium on Mass Storage Systems and Technologies (MSST), pp. 1–14 (2015) Google Scholar
  23. Shamir, A.: How to share a secret. Commun. ACM 22(11), 612–613 (1979) ArticleMathSciNetGoogle Scholar
  24. Stanek, J., Sorniotti, A., Androulaki, E., Kencl, L.: A secure data deduplication scheme for cloud storage. In: Technology Report IBM Research, Zurich, ZUR 1308-022 (2013) Google Scholar
  25. Li, J., Chen, X., Li, M., Li, J., Lee, P.P.C., Lou, W.: Secure deduplication with efficient and reliable convergent key management. Parallel CloudSyst. IEEE Trans 25(6), 1615–1625 (2014) ArticleGoogle Scholar

Author information

Authors and Affiliations

  1. CSE, Dr.K.V. Subba Reddy Institute of Technology, Kurnool, Andhra Pradesh, India B. Mahesh & K. Pavan Kumar
  2. IT, VNRVJIET, Hyderabad, Telangana, India Somula Ramasubbareddy
  3. CSE, SV College of Engineering, Tirupati, Andhra Pradesh, India E. Swetha
  1. B. Mahesh