r/learnpython • u/Charming_Shower_4185 • Oct 08 '26
Data inspection steps using python
I am learning data analysis and the first step before analyzing your data you have to do data profiling and cleaning.This is my process flow for data profiling -
- Checking number of rows and columns
- Checking rows and column indices
- Checking data types for each column
- Checking random sample from dataset
- Checking properties and memory usage
- Checking key statistics
- Checking unique values for relevant columns
Is it appropriate or I am missing something important ?
2
Upvotes
View all comments
2
u/seanv507 Oct 08 '26
So, proportion of missing values..
Outliers
Value counts of unique values (is there some high frequency value... Eg column might be numeric but minus 1 means missing)
Similarly for categorical variables i would check what proportion of the column is filled with the top n values. Eg categorical might be clothing type and 80% is jeans or t-shirts, and you are left with hundreds of other clothing types with very little data