Starting with Hadoop – 3

I was having too much problem with SELinux while trying to run the generic Hadoop distribution on Fedora.

I decided to install the prepackaged one with yum.

  • sudo yum install hadoop-common hadoop-common-native hadoop-mapreduce

I was then able to start the different components with:

  • sudo start-dfs.sh
  • sudo start-yarn.sh

Now time to see if I can submit jobs to Hadoop.

To copy some file into HDFS:

hadoop fs -copyFromLocal ./sample.html hdfs://localhost:8020/

Advertisements

Published by

m5c

Java developper that loves photography and good coffee

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s