Home > Uncategorized > Using Bootstrap for AWS

Using Bootstrap for AWS

January 18, 2012 Leave a comment Go to comments

Some limitations of AWS:It was dated Jan, 2011, not test it for the current system. But I guess I have to pay attention to or test it a little bit.

Ref: http://www.vitaliykulikov.com/2011/01/hadoop-map-reduce-programming-linux_11.html

1. Not good for input data > 5GB
2. Not running more than 20 instances.

boostrap is really a noisy thing for me, since it’s hard to predict the output. Here’s the code for installing R(randomForest), Python(simple json).

#!/bin/bash
# turn on logging and exit on error
set -e -x

#Install easy_install
sudo apt-get install python-setuptools

sudo easy_install simplejson

#debian R upgrade The R version used by Amazon is really old. The solution is to update it with the following script
echo "deb http://streaming.stat.iastate.edu/CRAN/bin/linux/debian lenny-cran/" | sudo tee -a /etc/apt/sources.list
sudo apt-get update
sudo apt-get -t lenny-cran install –yes –force-yes r-base r-base-dev

echo "install.packages(‘randomForest’,repos=’http://cran.r-project.org‘)" | sudo R –no-save

Advertisements
Categories: Uncategorized
  1. No comments yet.
  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: