Book Image

Working with Big Data in Python [Video]

By : Alexis Rutherford
4 (1)
Book Image

Working with Big Data in Python [Video]

4 (1)
By: Alexis Rutherford

Overview of this book

<p><span id="description" class="sugar_field">This course is a comprehensive, practical guide to using MongoDB and Spark in Python, learning how to store and make sense of huge data sets, and performing basic machine learning tasks to make predictions.</span></p> <p>MongoDB is one of the most powerful non-relational database systems available offering robust scalability and expressive operations that, when combined with Python data analysis libraries and distributed computing, represent a valuable set of tools for the modern data scientist. NoSQL databases require a new way of thinking about data and scalable queries. Once Mongo queries have been mastered, it is necessary to understand how we can leverage this API in Python's rich analysis and visualization ecosystem. This course will cover how to use MongoDB, particularly if you are used to SQL databases, with a focus on scalability to large datasets. pyMongo is introduced as the means to interact with a MongoDB database from within Python code and the data structures used to do so are explored. MongoDB uniquely allows for complex operations and aggregations to be run within the query itself and we will cover how to use these operators. While MongoDB itself is built for easy scalability across many nodes as datasets grow, Python is not. Therefore, we cover how we can use Spark with MongoDB to handle more complex machine learning techniques for extremely large datasets. This learning will be applied to several examples of real-world datasets and analyses that can form the basis of your own pipelines, allowing you to quickly get up-and-running with a powerful data science toolkit.</p> <h2><span class="sugar_field">Style and Approach</span></h2> <p><span class="sugar_field"><span id="trade_selling_points_c" class="sugar_field">An exhaustive course that carefully covers the fundamental concepts of unstructured data and distributed programming before applying them to examples of typical data science workflows.</span></span></p> <p><span class="sugar_field"><span id="trade_selling_points_c" class="sugar_field">This course is divided into clear chunks, so you can learn at your own pace and focus on your own area of interest.</span></span></p>
Table of Contents (5 chapters)
Chapter 2
Using the pyMongo Module
Content Locked
Section 4
Return Codes and Exceptions
MongoDB is a highly scalable database capable of many simultaneous connections. Sometimes this causes errors in operations. Learn how to deal with these errors. - Concurrency requires locks and queues of operations - try/except clauses to catch errors - Specific error handling using pymongo.errors