Home / server / Questions / 659073
In Process
billcyz
Asked: 2015-01-14 01:05:41 +0800 CST

How to specify hard disk for hadoop cluster?

  • 772

I installed Hadoop on one Azure VM, and it works fine by using its OS disk. However, I attached one hard disk to my VM, and I want to know how to configure Hadoop to only use this new hard disk as its default storage disk. Can anyone tell me how to change the configurations?

Any Help would be grateful. Thank You.

linux

2 Answers

  1. Specifically, the Datanode needs to have the dfs.datanode.data.dir configuration property set with the path of each mount point or directory where it is allowed to write data to. This property is a set of comma-separated values.

    For example:

    <property>
  <name>dfs.datanode.data.dir</name>
  <value>/hdfs/01/hdfs,/hdfs/02/hdfs,/hdfs/03/hdfs</value>
</property>

    This defines three different directories that the Datanode can write blocks into.

    • 1

  2. problem is solved. I have to edit hdfs-site.xml. Thanks for everyone.

    • 0