An Exploration Of Effective Pandas Practices With Matt Harrison

The Python Podcast.__init__

Summary

Pandas has grown to be a ubiquitous tool for working with data at every stage. It has become so well known that many people learn Python solely for the purpose of using Pandas. With all of this activity and the long history of the project it can be easy to find misleading or outdated information about how to use it. In this episode Matt Harrison shares his work on the book "Effective Pandas" and some of the best practices and potential pitfalls that you should know for applying Pandas in your own work.

Announcements

• Hello and welcome to Podcast.__init__, the podcast about Python’s role in data and science.
• When you’re ready to launch your next app or want to try a project you hear about on the show, you’ll need somewhere to deploy it, so take a look at our friends over at Linode. With the launch of their managed Kubernetes platform it’s easy to get started with the next generation of deployment and scaling, powered by the battle tested Linode platform, including simple pricing, node balancers, 40Gbit networking, dedicated CPU and GPU instances, and worldwide data centers. Go to pythonpodcast.com/linode and get a $100 credit to try out a Kubernetes cluster of your own. And don’t forget to thank them for their continued support of this show!
• Your host as usual is Tobias Macey and today I’m interviewing Matt Harrison about best practices for using Pandas for data exploration, manipulation, and analysis

Interview

• Introductions
• How did you get introduced to Python?
• What motivated you to write a book about Pandas?
  • There are a number of books available that cover some aspect of the Pandas framework or its application. What was missing from the available literature?
  • Who is your target audience for this book?
• What are some of the most surprising things that you have learned about Pandas while working on this book?
• What are the sharp edges that you see newcomers to pandas run into most frequently?
• It is easy to use Pandas in a naive manner and get things done. What are some of the bad habits that you have seen people form in their work with Pandas?
  • How and when do those habits become harmful?
• What are the most interesting, innovative, or unexpected ways that you have seen Pandas used?
• What are the most interesting, unexpected, or challenging lessons that you have learned while working on this book?
• What are some of the projects that you are planning to work on in the near/medium term?

Keep In Touch

• Website
• @__mharrison__ on Twitter
• Blog
• mattharrison on GitHub

Picks

• Tobias
  • MSR Snowshoes
• Matt
  • Telemark Skiing
  • 22 Designs

Closing Announcements

• Thank you for listening! Don’t forget to check out our other show, the Data Engineering Podcast for the latest on modern data management.
• Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
• If you’ve learned something or tried out a project from the show then tell us about it! Email [e-mail]) with your story.
• To help other people find the show please leave a review on iTunes and tell your friends and co-workers

Links

• Effective Pandas Book (affiliate link with 20% discount code applied)
  • Discount code INIT
• TCL
• Perl
• Pandas
  • Podcast Episode
• Pandas Extension Arrays
  • Podcast Episode
• Koalas
• Dask
  • Data Engineering Podcast Episode
• Modin
  • Podcast Episode

The intro and outro music is from Requiem for a Fish The Freak Fandango Orchestra / CC BY-SA