Book Image

Using OpenRefine

Book Image

Using OpenRefine

Overview of this book

Data today is like gold - but how can you manage your most valuable assets? Managing large datasets used to be a task for specialists, but the game has changed - data analysis is an open playing field. Messy data is now in your hands! With OpenRefine the task is a little easier, as it provides you with the necessary tools for cleaning and presenting even the most complex data. Once it's clean, that's when you can start finding value. Using OpenRefine takes you on a practical and actionable through this popular data transformation tool. Packed with cookbook style recipes that will help you properly get to grips with data, this book is an accessible tutorial for anyone that wants to maximize the value of their data. This book will teach you all the necessary skills to handle any large dataset and to turn it into high-quality data for the Web. After you learn how to analyze data and spot issues, we'll see how we can solve them to obtain a clean dataset. Messy and inconsistent data is recovered through advanced techniques such as automated clustering. We'll then show extract links from keyword and full-text fields using reconciliation and named-entity extraction. Using OpenRefine is more than a manual: it's a guide stuffed with tips and tricks to get the best out of your data.
Table of Contents (13 chapters)
Using OpenRefine
Credits
Foreword
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Overview


The following table provides an overview of the special symbols in regular expressions:

Symbol

Meaning

ABC… abc…

Match the corresponding letters literally

123…

Match the corresponding numbers literally

[xyz]

Match one of the characters inside the braces

[^xyz]

Match any character that is not inside the braces

[0-9]

Match one of the characters inside the range

\d

Match a digit

\D

Match a non-digit

\w

Match a letter, number, or underscore

\W

Match anything that is not a letter, number, or underscore

.

Match any character except a newline

\n

Match a newline

\.

Match an actual dot (the backslash escapes the next character)

?

Match the preceding item zero or one time

*

Match the preceding item zero or more times

+

Match the preceding item one or more times

{3}

Match the preceding item three times

{3,6}

Match the preceding item three to six times

{3,}

Match the preceding item at least three times

{,6}

Match the preceding item up to six times

^

Match at the beginning of the text

$

Match at the end of the text

\b

Match at a word boundary

cat|dog|cow

Match one of the alternatives