Index

A

• Active State Komodo Edit
  • URL / Getting more tools – a text editor
• address
  • geocoding / Geocoding an address
• AnnualStats class definition
  • using / Using a class definition
• application module
  • creating / Creating an application module
• approaches, steganography
  • color channel, using / Some approaches to steganography
  • Least Significant Bits (LSB), using / Some approaches to steganography
  • red-channel data, obtaining / Getting the red-channel data
  • bytes, extracting from Unicode characters / Extracting bytes from Unicode characters
  • bits, manipulating / Manipulating bits and bytes
  • bytes, manipulating / Manipulating bits and bytes
  • bits, assembling / Assembling the bits
  • message, encoding / Encoding the message
  • message, decoding / Decoding a message

B

• b command / Mac OS and GNU/Linux secrets
• BeautifulSoup
  • URL / Working with HTML web services – tools
  • installing, with Easy Install / Working with HTML web services – tools
• bit fiddling operators / The usual culprits
• bits
  • manipulating / Manipulating bits and bytes
  • assembling / Assembling the bits
• borders / Handling politics – borders, precincts, jurisdictions, and neighborhoods
• brute-force search, lost password recovery
  • using / Using brute-force search
• built-in numbers, Python
  • about / The ivory tower of numbers
  • integer numbers / Integer numbers
  • rational numbers / Rational numbers
  • floating-point numbers / Floating-point numbers
  • decimal numbers / Decimal numbers
  • complex numbers / Complex numbers
• bytes
  • extracting, from Unicode characters / Extracting bytes from Unicode characters
  • manipulating / Manipulating bits and bytes

C

• ? command / Mac OS and GNU/Linux secrets
• callback function / Downloading a file via FTP
• character escape(\n character) / Handling text and strings
• chart plotters / Coping with GPS device limitations
• cheese.extend() function / Using a Python list
• cheese data
  • URL / Solving problems – analyzing some interesting datasets
• City of Chicago data
  • URL / Understanding the data – schema and metadata
• class definition
  • about / Creating our own classes of objects
  • using / Using a class definition
• class of objects
  • creating / Creating our own classes of objects
• clean data portal
  • working with / Working with clean data portals
• client information
  • modifying / Changing our client information
• closing() function / Using http.client for HTTP GET
• coefficient of correlation
  • about / Comparisons and correlations
  • computing / Computing a coefficient of correlation
• color channel
  • using / Some approaches to steganography
• Command-line Interface (CLI) / Writing scripts and seeing output, Creating an application module
• comparison operators / The usual culprits
• comparisons
  • about / Comparisons and correlations
• complex numbers / Complex numbers
• complex RESTful queries
  • using / Using more complex RESTful queries
• conventional arithmetic operators / The usual culprits
• correlations
  • about / Comparisons and correlations
• counter mappings
  • using / Using the defaultdict and counter mappings
• CPython / Getting the tools of the trade – Python 3.3
• Create, Retrieve, Update, and Delete (CRUD) / Using a REST API in Python
• CSV / Working with CSV files
• CSV files
  • working with / Working with CSV files
• currency conversion rates problem
  • solving / Solving problems – currency conversion rates
• currency information
  • URL / Using a REST API in Python
• cyan-magenta-yellow-key (CMYK) colors / JPEG and PNG graphics – pixels and metadata
• Cygwin
  • URL / Getting other developer tools

D

• data
  • accessing, from Internet / Accessing data from the Internet
• data, accessing from Internet
  • about / Accessing data from the Internet
  • TCP/IP protocols / Background briefing – the TCP/IP protocols
  • http.client, using for / Using http.client for HTTP GET
  • client information, changing / Changing our client information
  • FTP, using in Python / Using FTP in Python
  • urllib package, using / Using urllib for HTTP, FTP, or file access
  • urllib, using / Using urllib for FTP access
• data collections
  • organizing / Organizing collections of data
  • organizing, Python list used / Using a Python list
  • organizing, list index operations used / Using list index operations
  • organizing, Python tuple used / Using a Python tuple
  • organizing, Python dictionary mapping used / Using a Python dictionary mapping
  • organizing, with generator function / Transforming sequences with generator functions
  • organizing, defaultdict used / Using the defaultdict and counter mappings
  • organizing, counter mappings used / Using the defaultdict and counter mappings
  • organizing, Python set used / Using a Python set
  • organizing, for statement used / Using the for statement with a collection
  • organizing, Python operators used / Using Python operators on collections
• datasets
  • analyzing / Solving problems – analyzing some interesting datasets, Getting some more data
• data types, Python
  • Boolean values / Outside the numbers
  • short-circuit operators / Outside the numbers
  • Arithmetic operations / Outside the numbers
• decimal numbers / Decimal numbers
• defaultdict
  • using / Using the defaultdict and counter mappings
• digital watermark / Some approaches to steganography
• directory_list() function / Using FTP in Python
• distance between points
  • calculating / How close? What direction?
• divmod() function / Rational numbers, Creating Maidenhead grid codes
• docstring test cases
  • about / Writing high-quality software
• doctest.testmod() function
  • evaluating / Building a self-testing module and a test module
• doctest cases
  • adding, to class definition / Adding doctest cases to a class definition

E

• easy_install
  • URL / Getting a tool to get more Python components
• encode( / Using brute-force search
• enumerate() generator function / Assembling the bits
• EOF (end-of-file)) / How do we stop?
• exact division (/) , conventional arithmetic operators / The usual culprits
• Exif tags / JPEG and PNG graphics – pixels and metadata

F

• file
  • working with / Working with files and folders
  • creating / Creating a file
  • creating, aspects / Creating a file
  • reading / Reading a file
  • complex logical conditions, defining / Defining more complex logical conditions
  • downloading, via FTP / Downloading a file via FTP
• file-like object / Using urllib for HTTP, FTP, or file access
• file access
  • urllib, using for / Using urllib for HTTP, FTP, or file access
• file formats
  • handling / Background briefing – handling file formats
  • OS filesystem, working with / Working with the OS filesystem
  • simple text files, processing / Processing simple text files
  • ZIP files, working with / Working with ZIP files
  • JSON files, working with / Working with JSON files
  • CSV files, working with / Working with CSV files
  • JPEG / JPEG and PNG graphics – pixels and metadata
  • PNG / JPEG and PNG graphics – pixels and metadata
• File Transfer Protocol (FTP) / Background briefing – the TCP/IP protocols
• floating-point numbers / Floating-point numbers
• folders
  • working with / Working with files and folders
• for statement
  • using, with data collection / Using the for statement with a collection
• FTP
  • using, in Python / Using FTP in Python
  • urllib, using / Using urllib for HTTP, FTP, or file access
  • accessing, urllib used / Using urllib for FTP access
• FTP, Python
  • about / Using FTP in Python
  • base URL / Using FTP in Python
  • file, downloading / Downloading a file via FTP
  • get() function, using / Using our FTP get() function
• FTP get() function
  • using / Using our FTP get() function

G

• generator expressions
  • using, with list-of-tuples / Using generator expressions with list of tuples
• generator functions
  • used, for transforming sequences / Transforming sequences with generator functions
• geocodes
  • used, for enriching Python object / Enriching Python objects with geocodes
• geocoding
  • combining, with haversine() function / Combining geocoding and haversine
• geocoding services
  • URL / Finding out where we are with geocoding services
• GeoRef code
  • creating / Creating GeoRef codes
  • URL / Creating GeoRef codes
  • decoding / Decoding a GeoRef code
  • Maidenhead grid codes, creating / Creating Maidenhead grid codes
  • Maidenhead grid codes, decoding / Decoding the Maidenhead grid codes
• getpixel() method / Decoding a message
• getwelcome() method / Downloading a file via FTP
• get_bits() function / Decoding a message
• get_spot_rate() function / Saving our data via JSON
• glob module, OS filesystem / glob
• good restaurant application
  • building / Solving problems – closest good restaurant
  • Python objects, creating / Creating simple Python objects
  • HTML web services, working with / Working with HTML web services – tools, Working with HTML web services – getting the page, Working with HTML web services – parsing a table
  • Python object, creating from columns of data / Making a simple Python object from columns of data
  • Python objects, enriching with geocodes / Enriching Python objects with geocodes
  • Python objects, enriching with health scores / Enriching Python objects with health scores
  • data, integrating into web services / Combining the pieces and parts
  • data portals, working with / Working with clean data portals
  • Python object, creating from JSON document / Making a simple Python object from a JSON document
  • data, leveraging from web source / Combining different pieces and parts
  • final steps / Final steps
  • schema / Understanding the data – schema and metadata
  • metadata / Understanding the data – schema and metadata
• GPS
  • about / Background briefing – latitude, longitude, and GPS
  • device limitations, copying with / Coping with GPS device limitations
• Graphical User Interfaces (GUI) / Writing scripts and seeing output
• Greenwich meridian / Background briefing – latitude, longitude, and GPS
• grid codes
  • creating, compression schemes used / Compressing data to make grid codes
  • GeoRef code, creating / Creating GeoRef codes

H

• hash totals
  • using / Using hash totals to validate a file
• haversine() function
  • about / How close? What direction?
  • combining, with geocoding / Combining geocoding and haversine
• haversine calculation
  • steps / How close? What direction?
• haversine formula
  • URL / How close? What direction?
• h command / Mac OS and GNU/Linux secrets
• help() system, Python
  • using / Using the help() system
  • -- More -- command / Windows secrets
  • h command / Windows secrets
  • q command / Windows secrets
  • ? command / Windows secrets
• help mode, Python
  • using / Using the help mode
• high-quality software
  • writing / Writing high-quality software
• Homebrew
  • URL / Mac OS X secrets
• HTML page
  • obtaining / Working with HTML web services – getting the page
• HTML web services
  • tools, using / Working with HTML web services – tools
  • page, obtaining / Working with HTML web services – getting the page
  • table, parsing / Working with HTML web services – parsing a table
• HTTP
  • urllib, using / Using urllib for HTTP, FTP, or file access
• http.client
  • using, for HTTP GET / Using http.client for HTTP GET
• HTTP GET
  • http.client, using for / Using http.client for HTTP GET
• hybrid module
  • creating / Creating a hybrid module
• Hypertext Transfer Protocol (HTTP) / Background briefing – the TCP/IP protocols

I

• IDEs
  • about / Getting more tools – a text editor
• IDLE / Windows secrets
• image data
  • decoding / Decoding and encoding image data
  • encoding / Decoding and encoding image data
• ImageEnhance module / Manipulating images – enhancing
• ImageFilter module / Manipulating images – enhancing, Manipulating images – filtering
• ImageOps module / Manipulating images – enhancing, Manipulating images – ImageOps
• images, Pillow
  • resizing / Manipulating images – resizing and thumbnails
  • cropping / Manipulating images – cropping
  • enhancing / Manipulating images – enhancing
  • filtering / Manipulating images – filtering
• InfoChimps
  • URL / Solving problems – closest good restaurant
• infolist() method / Using brute-force search
• integer division (//), conventional arithmetic operators / The usual culprits
• integer numbers / Integer numbers
• Iron Python / Getting the tools of the trade – Python 3.3

J

• JSON
  • URL / Getting simple REST data
  • used, for saving data / Saving our data via JSON
• JSON document
  • Python object, creating from / Making a simple Python object from a JSON document
• JSON files
  • working with / Working with JSON files
• Jython / Getting the tools of the trade – Python 3.3

L

• lambda function / Using a Python tuple
• latitude / Background briefing – latitude, longitude, and GPS
• latitude-longitude point
  • reverse geocoding / Reverse geocoding a latitude-longitude point
• Least Significant Bits (LSB)
  • using / Some approaches to steganography
• len() function / Understanding generator expressions
• let_num() function / Creating Maidenhead grid codes
• list index operations, Python list
  • using / Using list index operations
• longitude / Background briefing – latitude, longitude, and GPS
• lost password recovery
  • about / Solving problems – recovering a lost password
  • word corpus, reading / Reading a word corpus
  • ZIP archive, reading / Reading a ZIP archive
  • brute-force search, using / Using brute-force search

M

• Mac OS X
  • XCode, getting / Mac OS X secrets
• Mac OS X installer, Python 3.3 / Mac OS X secrets
• Maidenhead grid codes
  • creating / Creating Maidenhead grid codes
  • URL / Creating Maidenhead grid codes
  • decoding / Decoding the Maidenhead grid codes
• mask value / Encoding the message
• math / Background briefing – math and numbers
• median value
  • about / Finding the value in the middle
  • computing / Finding the value in the middle
• message
  • encoding / Encoding the message
  • decoding / Decoding a message
  • encrypting / Solving problems – encrypting a message
  • unpacking / Unpacking a message
• message digest
  • key, adding to / Using a key with a digest
• metadata / JPEG and PNG graphics – pixels and metadata, Understanding the data – schema and metadata
• modal value
  • about / Finding the most popular value
  • computing / Finding the most popular value
• mode function
  • working / Finding the most popular value
• modules, Pillow
  • ImageEnhance / Manipulating images – enhancing
  • ImageFilter / Manipulating images – enhancing, Manipulating images – filtering
  • ImageOps / Manipulating images – enhancing, Manipulating images – ImageOps
• mutablility / Using a Python list

N

• ** notation / Creating simple Python objects
• namespace / Creating simple Python objects
• Natural Area Code (NAC) / Creating natural area codes
• natural area codes
  • creating / Creating natural area codes
  • decoding / Decoding natural area codes
• neighborhoods / Handling politics – borders, precincts, jurisdictions, and neighborhoods
• NLTK
  • URL / Solving problems – recovering a lost password
• numbers / Background briefing – math and numbers
  • values, assigning to variables / Assigning values to variables

O

• <<operator / The usual culprits
• >> operator / The usual culprits
• open() function / Creating a file
• OS filesystem
  • glob module / glob
  • os package / os
• os package, OS filesystem / os
• ~ operator / The usual culprits

P

• parse_details() method / Combining different pieces and parts
• partition() method / Reading a file
• Pillow
  • URL / Using the Pillow library
  • documentation, URL / Using the Pillow library
  • supporting libraries, adding / Adding the required supporting libraries
  • installing / Installing and confirming Pillow
  • confirming / Installing and confirming Pillow
  • image data, decoding / Decoding and encoding image data
  • image data, encoding / Decoding and encoding image data
  • images, resizing / Manipulating images – resizing and thumbnails
  • images, cropping / Manipulating images – cropping
  • slice details, enhancing / Manipulating images – enhancing
  • images, filtering / Manipulating images – filtering
• Pillow library
  • using / Using the Pillow library
• PIP
  • URL / Getting a tool to get more Python components
• pixels / JPEG and PNG graphics – pixels and metadata
• prime meridian / Background briefing – latitude, longitude, and GPS
• print() function / Writing scripts and seeing output, Organizing our software, Creating a file
• projection / Background briefing – latitude, longitude, and GPS
• PyCrypto package
  • URL / Solving problems – encrypting a message
• PyPy / Getting the tools of the trade – Python 3.3
• pySerial project
  • URL / Coping with GPS device limitations
• Python
  • URL, for download / Getting the tools of the trade – Python 3.3
  • about / Getting the tools of the trade – Python 3.3
  • testing / Confirming our tools
  • exit() option / How do we stop?
  • help() system, using / Using the help() system
  • help mode, using / Using the help mode
  • FTP, using / Using FTP in Python
  • REST API, using / Using a REST API in Python
• Python 3 / Getting the tools of the trade – Python 3.3
• Python 3.3
  • about / Getting the tools of the trade – Python 3.3
  • Windows installer / Windows secrets
  • Mac OS X installer / Mac OS X secrets
• Python applications, creating
  • text editor, using / Getting more tools – a text editor
  • developer tools, obtaining / Getting other developer tools
• Python dictionary mapping
  • using / Using a Python dictionary mapping
  • access methods, using / Using the dictionary access methods
• Python generators
  • rules / Understanding generator expressions
• Python Imaging Library (PIL) / Using the Pillow library
• Python list
  • using / Using a Python list
  • list index operations, using / Using list index operations
• Python module
  • about / Creating Python modules and applications
  • creating / Creating Python modules and applications
  • using / Creating and using a module
  • application module, creating / Creating an application module
  • hybrid module, creating / Creating a hybrid module
• Python modules, adding
  • easy_install, using / Getting a tool to get more Python components
  • PIP, using / Getting a tool to get more Python components
• Python object
  • creating, from columns of data / Making a simple Python object from columns of data
  • enriching, with geocodes / Enriching Python objects with geocodes
  • enriching, with health scores / Enriching Python objects with health scores
  • creating, from JSON document / Making a simple Python object from a JSON document
• Python objects
  • creating / Creating simple Python objects
• Python operators
  • using, on data collection / Using Python operators on collections
  • union (|) / Using Python operators on collections
  • symmetric difference (^) / Using Python operators on collections
  • difference (-) / Using Python operators on collections
  • intersection (&) / Using Python operators on collections
• Python programming
  • URL / Background briefing – math and numbers
  • arithmetic operators / The usual culprits
  • bit fiddling operators / The usual culprits
• Python set
  • using / Using a Python set
• Python tuple
  • using / Using a Python tuple
  • generator expressions, using with list-of-tuples / Using generator expressions with list of tuples

Q

• q command / Mac OS and GNU/Linux secrets
• quantize / Decimal numbers

R

• rational numbers / Rational numbers
• read() function / Reading a file
• Read-Execute-Print Loop (REPL) / How do we stop?
• red-channel data
  • obtaining / Getting the red-channel data
• red-green-blue (RGB) colors / JPEG and PNG graphics – pixels and metadata
• REST API
  • using, in Python / Using a REST API in Python
• REST API, Python
  • using / Using a REST API in Python
  • REST data, obtaining / Getting simple REST data
  • complex RESTful queries, using / Using more complex RESTful queries
  • data, saving via JSON / Saving our data via JSON
• REST data
  • obtaining / Getting simple REST data
• reverse geocoding
  • latitude-longitude point / Reverse geocoding a latitude-longitude point
• RFC
  • about / Accessing data from the Internet
• round half up rule / Decimal numbers
• rstrip() method / Reading a file

S

• ** syntax / Making a simple Python object from a JSON document
• safe= / Geocoding an address
• schema / Understanding the data – schema and metadata
• scrapy tool
  • URL / Working with HTML web services – tools
• scripts
  • writing / Writing scripts and seeing output
  • about / Writing scripts and seeing output
• self-testing module
  • building / Building a self-testing module and a test module
• sequence
  • comparing, with iterable / Comparing a sequence and an iterable
• sequences
  • transforming, with generator functions / Transforming sequences with generator functions
• setattr() function / Enriching Python objects with health scores
• short-circuit operators
  • and / Outside the numbers
  • or / Outside the numbers
• size() method / Downloading a file via FTP
• socket / Background briefing – the TCP/IP protocols
• software, Python
  • organizing / Organizing our software
• sophisticated tests
  • creating / Creating more sophisticated tests
• standard deviation
  • computing / Computing the standard deviation
• standardized score
  • computing / Computing a standardized score
• statistical summaries
  • creating / Creating statistical summaries
  • raw data file, parsing / Parsing the raw data file
  • average value, finding / Finding an average value
  • generator expressions / Understanding generator expressions
  • median value, finding / Finding the value in the middle
  • modal value, finding / Finding the most popular value
• stdscore() method / Comparing a sequence and an iterable
• steganography
  • about / Some approaches to steganography
• steg_embed() function / Solving problems – encrypting a message
• steg_extract() function / Unpacking a message
• string conversions
  • strings to numbers / Converting between numbers and strings
  • numbers to strings / Converting between numbers and strings
• strings
  • handling / Handling text and strings
  • parsing / Parsing strings
• strip() method / Using brute-force search
• supporting libraries, adding
  • GNU/Linux configuration, libraries / GNU/Linux secrets
  • Mac OS X / Mac OS X secrets
  • Windows / Windows secrets

T

• table
  • parsing / Working with HTML web services – parsing a table
• tags / JPEG and PNG graphics – pixels and metadata
• tampering
  • detecting / Detecting and preventing tampering
  • preventing / Detecting and preventing tampering
  • hash totals, using / Using hash totals to validate a file
  • message digest, key adding / Using a key with a digest
• test module
  • building / Building a self-testing module and a test module
• text
  • handling / Handling text and strings
• text editor
  • using / Getting more tools – a text editor
• text files
  • processing / Processing simple text files
• thumbnail
  • creating / Manipulating images – resizing and thumbnails
• tools, HTML web services
  • Easy Install / Working with HTML web services – tools
  • scrapy / Working with HTML web services – tools

U

• Unicode characters
  • bytes, extracting / Extracting bytes from Unicode characters
• unit testing
  • about / Writing high-quality software
  • performing / Writing high-quality software
• urllib
  • using, for FTP / Using urllib for HTTP, FTP, or file access
  • using, for HTTP / Using urllib for HTTP, FTP, or file access
  • using, for file access / Using urllib for HTTP, FTP, or file access
  • using, for FTP access / Using urllib for FTP access
• urllib.parse.urlencode() function / Using more complex RESTful queries
• user agent string
  • URL / Changing our client information
• user input
  • gathering / Gathering user input
  • exceptions, handling / Handling exceptions
  • looping / Looping and trying again
• User Interface (UI) / Writing scripts and seeing output

V

• values
  • assigning, to variables / Assigning values to variables

W

• web2 (Webster’s Second International / Reading a word corpus
• Windows
  • Pillow distributions / Mac OS X secrets
  • Pillow distribution libraries / Windows secrets
• Windows installer, Python3.3
  • about / Windows secrets
• word corpus, lost password recovery
  • reading / Reading a word corpus

X

• XCode
  • URL / Getting other developer tools, Mac OS X secrets

Y

• Yelp
  • URL / Solving problems – closest good restaurant

Z

• zip() function / Decoding the Maidenhead grid codes
• ZIP archive, lost password recovery
  • reading / Reading a ZIP archive
• ZIP files
  • working with / Working with ZIP files