Back to AI News
arxiv

Study Finds Protocol Filtering Boosts LLM Network Trace Analysis

A new arXiv paper proposes a reproducible question-answering evaluation methodology for testing how well large language models analyze network packet captures. Using real benign traffic from the CICIDS2017 dataset, the researchers compared multiple models on raw textual traffic dumps versus protocol-filtered representations, scoring answers with an LLM-as-a-judge pipeline validated against human evaluations. Results show that protocol filtering significantly reduces prompt overhead and improves answer accuracy by cutting incorrect responses. The authors conclude that protocol-aware filtering is an effective optimization for LLM-assisted network management.

AI Brief

It offers concrete, reproducible evidence that preprocessing choices materially affect LLM reliability on a practical security and network-operations task.

arXiv:2611.22575v1 Announce Type: cross Abstract: The effective delivery and monitoring of ICT services rely heavily on network traffic analysis. However, interpreting complex packet captures remains a challenging task that requires substantial technical expertise. Large language models (LLMs) offer promising opportunities to automate network traffic in- vestigation, yet their reliability in packet-level field extraction and flow-level sequence reconstruction remains an open research question. This study proposes a reproducible, question-answering- based evaluation methodology to assess the capabilities of LLMs in network trace analysis. Using real-world benign traffic from the CICIDS2017 dataset, we evaluate multiple models against a human-generated ground truth, comparing their performance on raw textual traffic dumps and protocol-filtered representations. Model responses are assessed through an automated LLM- as-a-judge pipeline, validated against human evaluations. The results demonstrate that protocol filtering significantly reduces prompt overhead while improving answer accuracy by reducing incorrect responses. These findings highlight the importance of protocol-aware traffic filtering as an effective optimization for improving the efficiency and reliability of LLM-assisted network management.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!