The spark-ec2 script comes bundled with Spark and makes it easy to launch, manage, and shut down clusters on Amazon EC2.

Before you start, do the following things: log in to the Amazon AWS account via http://aws.amazon.com.

1. Click on Security Credentials under your account name in the top-right corner.
2. Click on Access Keys and Create New Access Key:

3. Download the key file (let's save it in the /home/hduser/kp folder as spark-kp1.pem).
4. Set permissions on the key file to 600.
5. Set environment variables to reflect access key ID and secret access key (replace the sample values with your own values):

     $ echo "export AWS_ACCESS_KEY_ID="AKIAOD7M2LOWATFXFKQ"" >> /home/hduser/.bashrc
$ echo "export 
       AWS_SECRET_ACCESS_KEY="+Xr4UroVYJxiLiY8DLT4DLT4D4sxc3ijZGMx1D3pfZ2q"" >> 
         /home/hduser/.bashrc
$ echo "export PATH=$PATH:/opt/infoobjects/spark/ec2" >> /home/hduser/.bashrc