CSV (comma-separated value) files are a common file format for transferring and storing data. The ability to read, manipulate, and write data to and from CSV files using Python is a key skill to master for any data scientist or business analysis. In this post, we’ll go over what CSV files are, how to read CSV files into Pandas DataFrames, and how to write DataFrames back to CSV files post analysis.
This post shows how to load, use, and make your own word embeddings using Python. Use the Gensim and Spacy libraries to load pre-trained word vector models from Google and Facebook, or train custom models using your own data and the Word2Vec algorithm. This post is a direct follow-on from the introductory Word Embeddings post, and will show you how to get started using word vectors with your own models and systems.
This post provides an introduction to “word embeddings” or “word vectors”. Word embeddings are real-number vectors that represent words from a vocabulary, and have broad applications in the area of natural language processing (NLP). We examine training, use, and properties of word embeddings models, and look at how and why you should look to use word embeddings over older bag-of-words techniques in your data science and language modelling tasks.
The Pandas DataFrame – this blog post covers the basics of loading, editing, and viewing data in Python, and getting to grips with the all-important data structure in Python – the Pandas Dataframe. Learn by example to load CSV files, rename columns, extract statistics, and select rows and columns.
In this post, geocoded data for all property price sales in Ireland from 2012-2017 is available. Data is sourced on the Irish Property Price Register and geocoded using the Google geocoding script in Python. All of the GPS latitude/longitude coordinates are further tied to census small area and electoral division boundaries.
Many precious hours have been lost to Character encoding errors and EOF character errors in CSV files being read by the Pandas read_csv file. This is an incredibly frustrating start to any analysis! Hopefully this post will save some people from the same fate!
A lot of modern-day games, especially the ones being developed for mobile, are built on business models revolving around data. Understanding how the audience thinks and responds with a product, as well as knowing how retention works in gaming, are both important in paving the way for the future of gaming.
Merging and Joining data sets are key activities of any data scientist or analyst. In this tutorial, we explore the process of combining datasets based on common columns quickly and easily with the Python Pandas library and it’s fast merge() functionality. Finally conquer merging and become a master with this 2-part tutorial.
Geocode your addresses for free with Python and Google For a recent project, I ported the “batch geocoding in R” script over to Python. The script allows geocoding of large numbers of string addresses to latitude and longitude values using the Google Maps Geocoding API. The Google Geocoding API is one of the most accurate geocoding …
Batch CSV Geocoding in Python with Google Maps APIRead More »
Pandas Data Selection There are multiple ways to select and index rows and columns from Pandas DataFrames. I find tutorials online focusing on advanced selections of row and column choices a little complex for my requirements. Selection Options There’s three main options to achieve the selection and indexing activities in Pandas, which can be confusing. The three selection cases and …
Using iloc, loc, & ix to select rows and columns in Pandas DataFramesRead More »
