The work presented in this chapter is a further extension of Chapter 10, Learning Telco Data on Spark, as well as Chapter 9, City Analytics on Spark. It is a very special extension of Chapter 9, City Analytics on Spark, as both chapters are using open datasets. It is also an extension of Chapter 10, Learning Telco Data on Spark, as both chapters take a dynamic approach so that readers can take advantage of all the learned techniques to achieve better machine learning results and also to develop the best analytical solutions. Therefore, this chapter may be used as a review chapter, as well as a special chapter for you to synthesize all the knowledge learned.

In this chapter, with a real-life project of learning from open data, we have repeated the same step-by-step RM4Es process as used in the previous chapters, from which we processed open data on Apache Spark and then selected models (equations). For each model, we estimated their coefficients and then evaluated these models against...