Book Image

Exploring Data with RapidMiner

By : Andrew Chisholm
Book Image

Exploring Data with RapidMiner

By: Andrew Chisholm

Overview of this book

<p>Data is everywhere and the amount is increasing so much that the gap between what people can understand and what is available is widening relentlessly. There is a huge value in data, but much of this value lies untapped. 80% of data mining is about understanding data, exploring it, cleaning it, and structuring it so that it can be mined. RapidMiner is an environment for machine learning, data mining, text mining, predictive analytics, and business analytics. It is used for research, education, training, rapid prototyping, application development, and industrial applications.</p> <p>Exploring Data with RapidMiner is packed with practical examples to help practitioners get to grips with their own data. The chapters within this book are arranged within an overall framework and can additionally be consulted on an ad-hoc basis. It provides simple to intermediate examples showing modeling, visualization, and more using RapidMiner.<br /><br />Exploring Data with RapidMiner is a helpful guide that presents the important steps in a logical order. This book starts with importing data and then lead you through cleaning, handling missing values, visualizing, and extracting additional information, as well as understanding the time constraints that real data places on getting a result. The book uses<br />real examples to help you understand how to set up processes, quickly.</p> <p>This book will give you a solid understanding of the possibilities that RapidMiner gives for exploring data and you will be inspired to use it for your own work.</p>
Table of Contents (18 chapters)
Exploring Data with RapidMiner
Credits
About the Author
About the Reviewer
www.PacktPub.com
Preface
Index

Removing attributes


Three different techniques for removing attributes are illustrated in the following sections. These are as follows:

  • Remove useless attributes by employing simple statistical techniques.

  • Weighting, which determines how much influence or weight an individual attribute has on the label. The assumption in this case is that the data is being used for a classification problem and the removal of attributes will speed up the modeling process but reduce the accuracy.

  • Model-based, which uses a classification model to determine the most predictive attributes of the label. As with weighting, the assumption is that the data is being used for classification.

Removing useless attributes

The Remove Useless Attributes operator is well named but it is worth understanding how it works to ensure that useful attributes are not accidently removed.

The following screenshot shows Statistics View for the first few attributes of a document vector containing 24176 attributes (refer to the process, reduceLargeDocumentVector...