Skip to main content
XenonStack
Exploratory Data Analysis (EDA): Methods and Steps
J
K
N
O
R
X
Y
Z

XenonStack Glossary Exploratory Data Analysis (EDA): Methods and Steps

Key takeaway

  • Exploratory data analysis (EDA) uses mostly graphical methods to understand data before modelling. See its types, steps and how it differs from plots.

Exploratory data analysis (EDA) is an approach to analysing a data set, using mostly graphical techniques, to understand its structure, spot outliers and anomalies, and decide what to model before any assumptions are fixed. Analysts use visualisation and summary statistics to see what the data can reveal beyond formal modelling or hypothesis testing.

This page is for data scientists, analysts and data leaders who start projects from raw data. It covers what EDA is, its types and steps, how it differs from statistical graphics, and what to do first.

What is exploratory data analysis?

The NIST Engineering Statistics Handbook describes EDA as an approach and philosophy for data analysis that employs a variety of techniques, mostly graphical. Its goals include maximising insight into a data set, uncovering underlying structure, detecting outliers and anomalies, and developing parsimonious models. It adds that EDA postpones the usual assumptions about what kind of model the data follow, so the data can show its own structure.

IBM says EDA originated with John Tukey in the 1970s and is used to summarise a data set's main characteristics, often with data visualisation. It sits upstream of business analytics and modelling work.

What are the types of exploratory data analysis?

IBM lists four types, based on how many variables are examined and whether the methods are graphical.

TypeWhat it examinesTypical methods
Univariate non-graphicalOne variable, to describe it and find patternsSummary statistics
Univariate graphicalOne variable, shown visuallyStem-and-leaf plots, histograms, box plots
Multivariate non-graphicalRelationships among two or more variablesCross-tabulation, statistics
Multivariate graphicalRelationships among two or more variables, shown visuallyGrouped bar charts, scatter plots, heat maps

How does exploratory data analysis work?

There is no single fixed sequence, because NIST calls EDA a way of thinking rather than a collection of techniques. A common order is to identify each variable and its type, examine variables one at a time, then examine relationships between them. IBM also stresses finding missing values early, so that you can decide how to handle them before machine learning. For high-dimensional data it names clustering and dimension reduction, and it lists Python and R as widely used languages for EDA.

Two-column diagram. Univariate: non-graphical, graphical, stem-and-leaf, missing values. Multivariate: non-graphical, graphical, scatter plots, heat maps.

What is the difference between EDA and statistical graphics?

NIST says EDA is not identical to statistical graphics, although the two terms are used almost interchangeably. Statistical graphics is a set of techniques, each focused on one aspect of the data. EDA is broader and relies heavily on graphical techniques, with a few quantitative ones, to explore the data in an open-ended way.

QuestionEDAStatistical graphicsFormal modelling or hypothesis testing
Starting pointThe data, with model assumptions postponedA chosen aspect of the dataA model or hypothesis fixed in advance
ScopeBroad, open-ended explorationA set of plotting techniquesTests a specific claim
Typical outcomeStructure, outliers, candidate modelsA picture of one aspectSupport for or against the model

Why does exploratory data analysis matter?

IBM says the main purpose of EDA is to look at data before making any assumptions. That helps teams catch missing values, odd outliers and unexpected relationships before they reach a model, a report or a decision.

How does exploratory data analysis relate to AI agents?

An agent is only as dependable as the data it reads, so EDA is a sensible check on the data an agent will rely on. Missing values and outliers found in EDA are decisions someone must own. ElixirData is XenonStack's Context OS, built for governed context across the data behind agent decisions.

What should you do first?

  1. List the variables in your data set and label the type of each.
  2. Plot each variable alone, using a histogram or box plot.
  3. Check for missing values and outliers, and record how you handle them.
  4. Examine relationships between pairs and groups of variables.
  5. Write down what the data suggests, and test it with formal methods afterwards.

To map one decision your agents make, and the data and policy it depends on, book a Context Workshop. See what happens in the workshop.

Frequently asked questions

What is exploratory data analysis in simple terms?

Exploratory data analysis is an approach to examining a data set, mostly with graphics, to understand its structure and spot outliers before building a model.

Who developed exploratory data analysis?

IBM says EDA originated with John Tukey in the 1970s.

What are the types of EDA?

Univariate non-graphical, univariate graphical, multivariate non-graphical and multivariate graphical.

Is EDA the same as statistical graphics?

No. NIST says the two are not identical: statistical graphics is a set of techniques, while EDA is a broader approach that relies heavily on graphical techniques.

Which tools are used for EDA?

Python and R are widely used for EDA, including for finding missing values.

Interested in solving your challenges with the XenonStack team?
Get Started

Tell us about you and your priorities so we can prepare the right conversation. It takes about 2 minutes.

Please Select your Industry
Banking
Fintech
Payment Providers
Wealth Management
Discrete Manufacturing
Semiconductor
Machinery Manufacturing / Automation
Appliances / Electrical / Electronics
Elevator Manufacturing
Defense & Space Manufacturing
Computers & Electronics / Industrial Machinery
Motor Vehicle Manufacturing
Food and Beverages
Distillery & Wines
Beverages
Shipping
Logistics
Mobility (EV / Public Transport)
Energy & Utilities
Hospitality
Digital Gaming Platforms
SportsTech with AI
Public Safety - Explosives
Public Safety - Firefighting
Public Safety - Surveillance
Public Safety - Others
Media Platforms
City Operations
Airlines & Aviation
Defense Warfare & Drones
Robotics Engineering
Drones Manufacturing
AI Labs for Colleges
AI MSP / Quantum / AGI Institutes
Retail Apparel and Fashion

Continue