How to Do Data Exploration (step-by-step tutorial on real-life dataset)
104,543
Published 2021-05-24
👇Learn how to complete your first real-world data science project
Hands-on Data Science course
www.misraturp.com/hods
In this video we learn how to explore a real-life dataset from NYC using Python and Pandas. We will dive deep into the data and find out potential problems, issues to fix and extract insights from it.
If you’d like to follow along, find the data here: data.cityofnewyork.us/Environment/2015-Street-Tree…
NYC Open Data - opendata.cityofnewyork.us/
00:00 Welcome
00:34 Some notes on data exploration
01:15 Dataset explanations
05:26 First look into our dataset
06:58 Understanding columns
09:22 Filtering out the unnecessary columns
11:45 Missing value check
12:49 Numerical values check
15:08 Outliers check
19:57 Categorical values check
24:57 Explore distribution of binary columns
26:40 Summary
👋 Keep in touch?
==========================
🐥 Twitter - twitter.com/misraturp
🔗 LinkedIn - linkedin.com/in/misraturp/
📹 YouTube - youtube.com/@misraturp
🌎 Website - misraturp.com/
Courses & resources
============================
📙 Fundamentals of Deep Learning in 25 pages
misraturp.gumroad.com/l/fdl
👩💻 Hands-on Data Science: Complete your first portfolio project
www.misraturp.com/hods
📥 Streamlit template
misraturp.gumroad.com/l/stemp
🤖 Deep Learning 101 with Python and Keras (FREE)
• 50 Days of Deep Learning
🏃♀️ Data Science Kick-starter mini-course (FREE)
misraturp.gumroad.com/l/kick-starter
🐼 Pandas cheat sheet (FREE)
misraturp.gumroad.com/l/pandascs
📝 NNs hyperparameters cheat sheet (FREE)
misraturp.gumroad.com/l/hcs
All Comments (21)
-
I was searching for a video where someone explains their reasoning in data exploration from last 15 days. This video has now become bookmark for my future data exploration works. Thank you very much.
-
Hi Misra, I love your videos. The way you explain topics in a simple manner is really helpful. Thank you so much!
-
Honestly your the most honest and humble trader on YouTube!!
-
Thank you so much for making this video! I'm just starting out with using python for data analysis and this video is so informative and inspiring. :)
-
It‘s a pleasure to watch your Videos. Thank you Misra! 🙏🏽
-
Found you as I start to work on a project for my MS in analytics! This has definitely helped me make better progress than before.
-
Really like how you have explained the thought process when comes to data understand and exploration. Learnt a lot!
-
Very nicely done! Looking forward to more data cleaning videos. Keep the good work going on. Thanks!!
-
Just wanted to let you know that your videos breathed new life into my Udacity Nanodegree experience. I have really been stalling on the last two classes, but this video and the cleaning one (along with others) were so much easier to watch and understand than the Udacity instruction provided in the course. Thank you!
-
Wonderful explanation, thank you!
-
its very informative ... thank you so much for uploading this❣
-
Best explanation and video to kickstart thinking about datasets...want more quality video like this... Keep it up
-
Wow . Great DataSet . just what i was looking for . I was searching for a video where someone explains all important things on datascience . This video has now become bookmark for my future data exploration works. Thank you very much Misra . ur channel is the best in the world.
-
Very useful indeed.. learnt how to think like a data analyst as a beginner
-
this video was very helpful, I'm going to watch all of them
-
Hi Misra, this video was so helpful! I'm starting my master's in Data Science this September and you've honestly been such a role model for me! Thank you and keep up the great work!
-
Thank you Misra, I personally like your videos a lot. You really teach Good .
-
thank you for this video! i was very overwhelmed by a dataset that i was looking at and didn't know how to start. great video
-
I love the way you teaching! Thank you
-
Hi Misra. I'm 18 minutes into the video and I'm still able to follow. thank you for this! Most of the articles I see on Google just jump straight into data cleaning and I don't even know how they detected the data errors they're trying to clean in the first place.
