Data Analysis with Python

Data Analysis with Python

By : David Taieb

Buy this Book

Data Analysis with Python

By: David Taieb

Buy this Book

Overview of this book

Data Analysis with Python offers a modern approach to data analysis so that you can work with the latest and most powerful Python tools, AI techniques, and open source libraries. Industry expert David Taieb shows you how to bridge data science with the power of programming and algorithms in Python. You'll be working with complex algorithms, and cutting-edge AI in your data analysis. Learn how to analyze data with hands-on examples using Python-based tools and Jupyter Notebook. You'll find the right balance of theory and practice, with extensive code files that you can integrate right into your own data projects. Explore the power of this approach to data analysis by then working with it across key industry case studies. Four fascinating and full projects connect you to the most critical data analysis challenges you’re likely to meet in today. The first of these is an image recognition application with TensorFlow – embracing the importance today of AI in your data analysis. The second industry project analyses social media trends, exploring big data issues and AI approaches to natural language processing. The third case study is a financial portfolio analysis application that engages you with time series analysis - pivotal to many data science applications today. The fourth industry use case dives you into graph algorithms and the power of programming in modern data science. You'll wrap up with a thoughtful look at the future of data science and how it will harness the power of algorithms and artificial intelligence.

Data Analysis with Python

Contributors

Preface

Other Books You May Enjoy

Free Chapter

Programming and Data Science – A New Toolset

What is data science

Is data science here to stay?

Why is data science on the rise?

What does that have to do with developers?

Putting these concepts into practice

Deep diving into a concrete example

Data pipeline blueprint

What kind of skills are required to become a data scientist?

IBM Watson DeepQA

Back to our sentiment analysis of Twitter hashtags project

Lessons learned from building our first enterprise-ready data pipeline

Data science strategy

Jupyter Notebooks at the center of our strategy

Summary

Python and Jupyter Notebooks to Power your Data Analysis

Why choose Python?

Introducing PixieDust

SampleData – a simple API for loading data

Wrangling data with pixiedust_rosie

Display – a simple interactive API for data visualization

Filtering

Bridging the gap between developers and data scientists with PixieApps

Architecture for operationalizing data science analytics

Summary

Accelerate your Data Analysis with Python Libraries

Anatomy of a PixieApp

Summary

Publish your Data Analysis to the Web - the PixieApp Tool

Overview of Kubernetes

Installing and configuring the PixieGateway server

Summary

Python and PixieDust Best Practices and Advanced Concepts

Use @captureOutput decorator to integrate the output of third-party Python libraries

Increase modularity and code reuse

Run Node.js inside a Python Notebook

Summary

Analytics Study: AI and Image Recognition with TensorFlow

What is machine learning?

What is deep learning?

Getting started with TensorFlow

Image recognition sample application

Summary

Analytics Study: NLP and Big Data with Twitter Sentiment Analysis

Getting started with Apache Spark

Twitter sentiment analysis application

Part 1 – Acquiring the data with Spark Structured Streaming

Part 2 – Enriching the data with sentiment and most relevant extracted entity

Part 3 – Creating a real-time dashboard PixieApp

Part 4 – Adding scalability with Apache Kafka and IBM Streams Designer

Summary

Analytics Study: Prediction - Financial Time Series Analysis and Forecasting

Getting started with NumPy

Statistical exploration of time series

Putting it all together with the StockExplorer PixieApp

Time series forecasting using the ARIMA model

Summary

Analytics Study: Graph Algorithms - US Domestic Flight Data Analysis

Introduction to graphs

Getting started with the networkx graph library

Part 1 – Loading the US domestic flight data into a graph

Part 2 – Creating the USFlightsAnalysis PixieApp

Part 3 – Adding data exploration to the USFlightsAnalysis PixieApp

Part 4 – Creating an ARIMA model for predicting flight delays

Summary

The Future of Data Analysis and Where to Develop your Skills

Forward thinking – what to expect for AI and data science

References

PixieApp Quick-Reference

Annotations

Custom HTML attributes

Methods

Index

Customer Reviews

5 star

4 star

3 star

2 star

1 star

SampleData – a simple API for loading data

Loading data into a Notebook is one of the most repetitive tasks a data scientist can do, yet depending on the framework or data source being used, writing the code can be difficult and time-consuming.

Let's take a concrete example of trying to load a CSV file from an open data site (say https://data.cityofnewyork.us) into both a pandas and Apache Spark DataFrame.

Note

Note: Going forward, all the code is assumed to run in a Jupyter Notebook.

For pandas, the code is pretty straightforward as it provides an API to directly load from URL:

import pandas
data_url = "https://data.cityofnewyork.us/api/views/e98g-f8hy/rows.csv?accessType=DOWNLOAD"
building_df = pandas.read_csv(data_url)
building_df

The last statement, calling building_df, will print its contents in the output cell. This is possible without a print because Jupyter is interpreting the last statement of a cell calling a variable as a directive to print it:

The default output of a pandas DataFrame...

Data Analysis with Python

By : David Taieb

Data Analysis with Python

By: David Taieb

Overview of this book

Related Content you might be interested in

Current Title:

Data Analysis with Python

Cognitive Computing with IBM Watson

SampleData – a simple API for loading data

Note