AnisblePlaybooks

Hadoop Ecosystem

ansible_sparkseq

To configure Hadoop for 8 instances you can run the following command using sample hosts inventory:

ansible-playbook hadoop.yml -i hosts_example.txt -s -u spark

###hosts_example.txt############
[hadoop_namenode]
sparkseq002.cloudapp.net

[hadoop_jobtracker]
sparkseq001.cloudapp.net

[hadoop_datanode]
sparkseq[003:008].cloudapp.net

[hadoop_tasktracker]
sparkseq[003:008].cloudapp.net
#sparkseq[001:008].cloudapp.net

Scala & SBT

To install Scala 2.10.3 and sbt on every instance run the following command:

ansible-playbook jvm-6.yaml -i hosts_example.txt -s -u spark

Scala+SBT