At this point in the book, I think you've seen enough examples and had enough concepts that I can finally set you loose and have you try to write your very own Spark script from scratch. I realize this might be your first Python script ever, so I'm going to keep it pretty easy and I'm going to give you a lot of tips on how to be successful with it. Don't be afraid! Let me introduce the problem at hand and give you some tips you need for success, and we'll set you loose.
I'm going to start you off with a pretty simple example here just to get your feet wet. What you're going to do is go to the download package for this book and find the customerorders.csv file. This just contains some random fake data that I generated. The input data in that file is going to look like this:
We have comma-separated fields of a customer ID, an item ID, and the amount spent on that item. What I want you to do is write a Spark script that consolidates...