Network traffic performance analysis from passive measurements using gradient boosting machine learning
by Astha Syal; Alina Lazar; Jinoh Kim; Alex Sim; Kesheng Wu
International Journal of Big Data Intelligence (IJBDI), Vol. 8, No. 1, 2021

Abstract: Effective monitoring and analysis of network traffic are vital for scientific computing, since scientific applications often require moving massive data from one site to another. A body of statistical and machine learning techniques have been introduced for network traffic monitoring and analysis, but this is considered a highly challenging task due to several reasons, such as unavailability of label information, complication of real-time analysis, and generalisation property of machine learning models. In this paper, we present a novel method to identify continuous time windows of low throughput for the purpose of network performance analysis and anomaly detection, in order to facilitate data transfers for high-performance scientific computing. The presented method is based on supervised learning techniques with an adaptive labelling function that automatically determines if the time window is whether 'slow' or 'normal'. The presented method is validated on real large datasets collected from several data transfer nodes (DTNs) located in Science DMZ. Our experimental results show that the proposed method is able to quickly predict time windows of low performing network transfers, that require attention from network engineers and also to identify the most important features for the classification.

Online publication date: Thu, 04-Nov-2021

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Big Data Intelligence (IJBDI):
Login with your Inderscience username and password:

    Username:        Password:         

Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email