Apache Hadoop

The Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

Apache Hadoop 2.9.2

Apache Hadoop 2.9.2 is a point release in the 2.x.y release line, building upon the previous stable release 2.9.1.

Here is a short overview of the major features and improvements.

• Common

  • Aliyun OSS Support. See the user documentation for more details.
  • HADOOP Resource Estimator. See the user documentation for more details.

• HDFS

  • HDFS Router based federation. See the user documentation for more details.

• YARN

  • YARN Timeline Service v.2. See the user documentation for more details.
  • YARN Federation. See the user documentation for more details.
  • Opportunistic Containers. See the user documentation for more details.
  • YARN Web UI v.2. See the user documentation for more details.
  • Changing queue configuration via API (supported only on the Capacity Scheduler). See the user documentation for more details.
  • Update Resources and Execution Type of an allocated/running container. (supported only on the Capacity Scheduler). See the user documentation for more details.

Getting Started

The Hadoop documentation includes the information you need to get started using Hadoop. Begin with the Single Node Setup which shows you how to set up a single-node Hadoop installation. Then move on to the Cluster Setup to learn how to set up a multi-node Hadoop installation.