Authors: Sandhya Narayanan; Philip Samuel; Mariamma Chacko
Addresses: Information Technology, Cochin University of Science and Technology, Kochi, India ' Department of Computer Science, Cochin University of Science and Technology, Kochi, India ' Department of Ship Technology, Cochin University of Science and Technology, Kochi, India
Abstract: Network traffic occurring in the internet is a challenging issue due to the increase in internet users. Nowadays, internet traffic increases exponentially every month. Communication capability between the networks becomes difficult because of this heavy traffic. We propose hashing-based network resilient distribution (HBNRD) method to detect and eliminate duplicate data chunks in the packets of network layer using big data processing framework. HBNRD method helps to detect the similar files transferred through the internet and removes redundant data chunks. This results in fast communication and the proposed model attains fault tolerance because of resilient distributed approach. This data centric model can dynamically allocate the resources and can detect the data chunk repetition occurring during computation. Use of Center for Applied Internet Data Analysis (CAIDA) dataset shows that HBNRD improves the network performance by reducing the internet traffic redundancy by 60%. The data centric network traffic redundancy eliminated model is fast, scalable and resilient.
Keywords: network data traffic; resilient distribution; hashing; big data analytics; redundancy elimination.
International Journal of Cloud Computing, 2023 Vol.12 No.2/3/4, pp.107 - 117
Received: 06 Mar 2020
Accepted: 07 Apr 2020
Published online: 14 May 2023 *