CloudDOE User Manual - Deploy

Introduction

l   CloudDOE - Deploy is a wizard provides easy deployment of the Hadoop MapReduce computing framework for an administrator. This wizard installs Java runtime environment 1.6 and Hadoop version 0.20.203, and also starts the Hadoop services automatically.

For any experimental issues, please contact to:

l   Wei-Chun Chung (wcchung AT iis DOT sinica DOT edu DOT tw)

l   Yu-Chun Wang (zxaustin AT iis DOT sinica DOT edu DOT tw)

 

System requirement

l   A Graphic User Interface supported system with Java Run-Time Environment 1.6 (or higher) installed

n   Windows, Linux, and Mac

l   A decompression tool

l   A set of dedicated servers (at least two servers) with

n   Ubuntu Linux and enabled SSH service

n   An account with super-user privileges

n   Internet access rights for downloading JAVA and Hadoop packages

 

Acknowledgment

l   Yao-Tsung Wang (jazz@nchc.org.tw), National Center for High-Performance Computing, Taiwan.

 

Installation

        Download the CloudDOE packages and decompress it. Then you will get:

l   Deploy.jar: this program

l   Workspace directory: running environments of CloudDOE

l   Miscellaneous files such as test data, setup properties, and other programs

Note that we will install dependent software and also modify system settings of each node, including:

l   Install: Java run-time environment, Hadoop and related software.

l   Modify: /etc/hostname, /etc/hosts and SSH key-pairs.

 

Usage

We are now using Windows 7 as our platform to illustrate the usage of each components of CloudDOE - Deploy.


 

Start CloudDOE - Deploy

1.      Double click the Deploy.jar, or

Right click the Deploy.jar and select the Java run-time environment you preferred.

2.      Then you will see the main panel and other 2 panels of the program Deploy.jar.

 

Components

Installation Panel (The main panel)

You are requested to fill information for configuring a Cloud.

Please consult your cluster provider or manager for the connection information.

Uninstallation Panel

You can uninstall a Cloud, which deployed by CloudDOE.

About Panel

Copyright and contact information may be found on this panel. You can mail us if you have any problem in using CloudDOE.

 

Perform Hadoop Installation

Setup your Cloud

1.          You need to provide information for connecting to the Master Node of a Hadoop Cloud in Step 1. CloudDOE utilizes the Master Node for further deployment.

2.          You need to provide information of each Node in your Hadoop Cloud, including IP address, username and password.

Perform installation

1.          Installation is launched after click the GO button. You can monitor the installation progress below the panel.

2.          A notification prompt when the installation is completed.

 


 


Check Status of the Hadoop Cloud

You can check status reports of the installed Hadoop Cloud via:

  • http://{mater node ip}:50030
  • http://{mater node ip}:50070


 

Perform Hadoop Uninstallation

Perform uninstallation

You need to provide information for connecting to the Master Node of a Hadoop Cloud in Step 1. CloudDOE utilizes the Node to rollback installations of each node.