Data Wrangler - Prepare data with Python and pandas in Power Query Style
Data Wrangler provides a nice user interface to clean and prepare data in a pandas dataframe. In this tutorial video, I start with data in a pandas dataframe. I use Data Wrangler to view and profile the data, then to clean the data: rename some columns, drop other columns, find and replace values in a column, change the datatype of a column, and add a column by example. Data Wrangler then generates the Python pandas code. I then group and summarise the data into a second Data Wrangler session.
You can download the notebook that I built during the video from
https://github.com/MarkWilcock/lbag-o...
Data Wrangler is an extension to VSCode from Microsoft. For full details and documentation start here https://devblogs.microsoft.com/python...
#Data Science #python
Timestamps
00:00 Introduction - when and why to use the Data Wrangler
00:20 The initial setup: VS Code, Jupyter notebook, the sample dataset
01:02 The challenge to clean data
01:30 Launch Data Wrangler, first look at the user interface
02:30 Rename some columns,
03:00 View the code generated by the Data Wrangler
03:40 Drop columns
04:08 Replace values in a column
05:00 Change the datatypes of some columns
05:33 Add a column by examples
06:20 Preview the generated code for all operations
07:00 Execute the generated code in the notebook
07:35 A second transformation: group and summarise the data
09:00 Conclusion, and next steps
We run a full range of data analysis and generative AI courses in London and online. See our courses at zomalex.co.uk