Hadoop cluster environment construction is a problem that many Hadoop learners or users are bound to face. There are many blog tutorials about Hadoop cluster environment construction on the Internet. There is no problem for those who are good at playing Hadoop, or even “easy” to do, but for those who are new to Hadoop, setting up a Hadoop cluster environment is quite stressful.
There are many articles on hadoop cluster environment construction on the Internet, which can be said to be “illustrated”. For beginners, even if the steps are detailed, looking at so many steps and so many instructions will certainly feel very cumbersome. After all, we are all from the rookie step by step, remember doing hadoop cluster environment is really cumbersome.
Although there are many commercial releases of Hadoop in China at present, they are basically similar or the same in the construction of cluster environment, with many instructions and complicated steps. Sometimes I wonder why these publishers don’t optimize their Hadoop cluster deployment. Fortunately, I was able to find a Hadoop distribution cluster environment that was easy to set up.
Here is a domestic Hadoop distribution, big quick search launched DKhadoop. The overall deployment of the clustered environment strikes me as relatively easy to use and less cumbersome than some previous releases. Here is a simple and easy to use Hadoop cluster environment with DKhadoop as an example.
1a Define a name for the cluster: Before installing the cluster, the installation program needs to perform some environment check on the host. DKhadoop requires root permission and links to the host through SSH.
2a Select an installation mode. Three installation modes are available: basic installation, full installation, and custom installation. The basic installation includes haFS-2.6.0 installation, JDk1.7.0_79 installation, YarN-2.6.0 installation, and Zooleper-3.4.6 installation
3a If the full installation mode is selected, more services need to be installed. For details, see the following figure and description.
4a In the custom installation mode, roles can be independently configured. DKhadoop recommends corresponding Settings based on host performance by checking host performance.
5a Select an appropriate installation mode and click “Continue” in the lower right corner to automatically install components. After all components are successfully installed, the cluster environment is deployed.
The cluster environment deployment of DKhadoop has been optimized and I find it easy to use. Interested friends can have a look!