Information - Theoretic Methods for Anomaly Detection
DOI:
https://doi.org/10.51408/1963-0041Keywords:
Anomaly / outlier detection, Entropy, Relative entropy, Local-search heuristic algorithm LSAAbstract
Maintaining the security of digital systems with a huge amount of data is one of the main concerns of IT specialists in these times. Anomaly detection in systems is one of the solutions to overcome this challenge. Anomaly detection means ¯nding patterns that are not normal or deviate from normal behavior in a system. Anomaly detection has various applications in bio-informatics, image processing, cyber security, security for databases, etc. There are many groups of methods that are used for anomaly detection including statistical methods, neural network methods and information theoretic methods. In this paper we survey pros and cons of anomaly detection based on information theoretic techniques
References
C.C.Aggarwal and S.Sathe, Outlier Ensembles. An introduction|,Springer,2017.
X.Xu, H.Liu and M.Yao,Recent Progress of Anomaly Detection, Hindawi,Complexity, 2019
T.M.Cover and J.A.Thomas, Elements of information theory, 2nd edition, A WileyInterscience Publication,2006.
V.Chandola, A.Banerjee and V.Kumar, Anomaly detection: a survey", ACM Computing Surveys, vol.41,no.3, pp.158, 2009.
V.Chandola, A.Banerjee and V.Kumar, Anomaly detection for discrete sequences: a survey", IEEE Trans. Knowl. Data Eng., vol. 24, no. 5, pp. 823 - 839, 2012.
T.M.Cover and J. A.Thomas, Elements of information theory, 2nd edition, A WileyInterscience Publication, 2006.
W. Lee and D.Xiang, Information-theoretic measures for anomaly detection', In Proceedings of the IEEE Symposium on Security and Privacy, IEEE Computer Society,pp. 130-143, 2001
Z.He,S.D eng, XuX.,Anoptimization model for outlier detection in categorical data", Advances in Intelligent Computing., Lecture Notes in Computer Science, vol 3644, Springer, pp. 400 - 409, 2005.
U.Qamar, Automated entropy value frequency ( AEVF) algorithm for outlier detection in categorical data",12th WSE AS Intern. Conf. on Articial Intelligence, Knowledge Engineering and Data
L. Akoglu,H.Tong, J.Vreeken and C. Faloutsos, Fast and reliable anomaly detection in categorical data, Proc. 21st ACM Int. Conf. Inf. Knowl. Manage., pp. 415 424, 2012.
C.C. Noble and D.J.Cook,Graph-based anomaly detection",Proc. of the 9th ACMSIGKDD International Conference on Knowledge Discovery and Data Mining, ACMPress, pp. 631 636, 2003.
Y.Gu,A.McCallum and D.Towsley,Detecting anomalies in network tra±c using maximum entropy estimation",proc. ACM SIGCOMM Conf. Internet Measurement,pp. 345-350,2005
G.Nychis, V.Sekar, D.G.A nderson, H. Kim, H.Zhang, An empirical evaluation of entropy-based traffic anomaly detection",Proc. of the 8th ACM SIGCOMM Conference on Internet Measurement, Greece, 2008.
A.Wagner and B.Plattner, Entropy based worm and anomaly detection in fast IP networks", Proc. of the Workshop on Enabling Technologies: Infrastructure for Collaborative E nterprises, WETICE, 2005.
Y.Xiang, K. Liand W. Zhou, Low-rate DDoS attacks detection and traceback by using new information metrics", IEEE Trans. on information, forensics and security, vol. 6,no.2, pp. 426 -437, 2011.
F.Pan and W. Wang, Anomaly detection based-on the regularity of normal behaviors, Proc. 1st Int. Symp. Syst. Control Aerosp. Astronaut., pp. 1046-11046-6, 2006.
E.E.Eiland and L. M. Liebrock, An application of information theory to intrusion detection, P roc. Fourth IEEE Int. Workshop Inf. Assurance, 2006
C.-K. Han and H.-K. Choi, Effective discovery of attacks using entropy of packet dynamics, IEEE Netw., vol. 23, no. 5, pp. 412, 2009.
N.Wang, J. Han and J.Fang, An anomaly detection algorithm based on lossless compression, Proc. IEEE 7th Int. Conf. Netw. Archit. Storage, pp. 31 38, 2012
H.Shahriar and M. Zulkernine, Information-theoretic detection of SQL injection attacks, Proc. IEEE 14th Int. Symp. High-Assurance Syst. Eng., pp. 4047, 2012
A.Host-Madsen, E. Sabeti and C. Walton, Data discovery and anomaly detection using atypicality: theory", IEEE Trans. on Inform. Theory, vol. 65, no. 9, pp. 5302 - 5322, 2019.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
