Book Image

IBM SPSS Modeler Cookbook

By : Keith McCormick, Abbott
Book Image

IBM SPSS Modeler Cookbook

By: Keith McCormick, Abbott

Overview of this book

IBM SPSS Modeler is a data mining workbench that enables you to explore data, identify important relationships that you can leverage, and build predictive models quickly allowing your organization to base its decisions on hard data not hunches or guesswork. IBM SPSS Modeler Cookbook takes you beyond the basics and shares the tips, the timesavers, and the workarounds that experts use to increase productivity and extract maximum value from data. The authors of this book are among the very best of these exponents, gurus who, in their brilliant and imaginative use of the tool, have pushed back the boundaries of applied analytics. By reading this book, you are learning from practitioners who have helped define the state of the art. Follow the industry standard data mining process, gaining new skills at each stage, from loading data to integrating results into everyday business practices. Get a handle on the most efficient ways of extracting data from your own sources, preparing it for exploration and modeling. Master the best methods for building models that will perform well in the workplace. Go beyond the basics and get the full power of your data mining workbench with this practical guide.
Table of Contents (11 chapters)
10
Index

Speeding up merge with caching and optimization settings

In this recipe, we will start with a simple stream involving two Merge nodes. Although the sample size in the example is not extremely large, we will explore how you could speed up this stream if you were experiencing performance issues. In effect, we are performing a trade, trading available hard drive space to make it easier on the processor. One should be able to process millions of rows even if you are restricted to a client copy of Modeler. Note that, if you are experiencing these kinds of problems during Deployment, you should probably pursue a more complete solution. If, however, it is a data prep challenge, this should be helpful in getting you past the problem, and then during modeling you should consider a random sample.

Getting ready

We will start with the stream SpeedUpMerge.str.

How to do it...

To speed up a Merge node by using a cache and optimization settings:

  1. Open the stream SpeedUpMerge.str. To run the entire stream on...