Learn how to use deploy and maintain apache spark with this comprehensive guide written by the creators of the opensource clustercomputing framework. With an emphasis on improvements and new features in spark 2.0 authors bill chambers and matei zaharia break down spark topics into distinct sections each with unique goals. Youll explore the basic operations and common functions of sparks structured apis as well as structured streaming a new highlevel api for building endtoend streaming applications. Developers and system administrators will learn the fundamentals of monitoring tuning and debugging spark and explore machine learning techniques and scenarios for employing mllib sparks scalable machinelearning library. Get a gentle overview of big data and spark learn about dataframes sql and datasetssparks core apisthrough worked examples dive into sparks lowlevel apis rdds and execution of sql and dataframes understand how spark runs on a cluster debug monitor and tune spark clusters and applications learn the power of structured streaming spark s streamprocessing engine learn how you can apply mllib to a variety of problems including classification or recommendation