We are now living in a Big Data world - billions of devices communicating over millions of networks and generating petabytes of data, both at rest and in transit! Security professionals now encounter Big Data in the form of large log files, network traffic captures, forensics of large images, and exports from security tools and products. In this course, we will look at how to analyze, mangle, transform and visualize data to derive interesting insights and intelligence from it. Pandas is a Python library that is part of the SciPy scientific computing ecosystem. In simple terms, Pandas provides powerful data structures to perform data analysis. As dry as this might initially sound, due to the high level of abstraction provided by its powerful API, Pandas allows us to do really complicated analysis with just a few lines of Python code. In this course, we will go through the basics of Numpy, a deep dive into Pandas Series and Dataframes, and how to analyze data with it. The case study used is the analysis of Wi-Fi networks using Airodump-NG’s output file for a relatively large network with hundreds of devices.
