Building a Better Elephant—YARN in Hadoop 2.0

Hadoop has come a long way in a few short years, and has become the centerpiece of most modern analytic architecture. With Hadoop 1.0 Map Reduce was responsible for the procession of data, but also managing jobs through the cluster. With the introduction of YARN (Yet Another Resource Manager), Hadoop gains the concept of scheduling to more efficiently manage and more efficiently utilize nodes in the cluster. Additionally, it has allowed more applications to run natively in Hadoop, allowing closer to real time analytics with in-memory tools and graph processing. You will learn how YARN can help you meet your big data challenges.

Joseph D'Antoni is an Senior Architect and SQL Server MVP with over a decade of experience working in both Fortune 500 and smaller firms. He is a Principal Architect for Denny Cherry and Associates and lives in Malvern, PA. He is a frequent speaker at major tech events, and blogger about all topics technology. He believes that no single platform is the answer to all technology problems. He holds a BS in Computer Information Systems from Louisiana Tech University and an MBA from North Carolina State University, and is the co-author of the Microsoft white paper "Using Power BI in a Hybrid Environment".