Home / server / Questions / 275327
Accepted
millebii
Asked: 2011-05-30 13:13:34 +0800 CST

Hadoop moving data to another user

  • 772

I have a few hundreds of GB in my hdfs for userA (single node configuration). I would like to transfer all that data to userB wich will be more appropriate for the multi-node configuration I'm setting up.

I tried the following without success:

  • hadoop fs -chown -R userB:hadoop PATH, when logged as userB I can't see the data, fine with userA although userB is set as hdfs owner.
  • tried start-all.sh as userB, needed to change a few access controls to that. Same thing I see nothing.
  • tried to force <name>hadoop.tmp.dir</name> on userA
  • tried to rename hadoop-userA dir into hadoop-userB
    When listing the directory I have the following
    drwxr-xr-x - userB hadoop 0 2011-05-29 18:17 /user/userA/tmp

Looks like the data is still owned by userA. Any idea how to fix that?

ADDITION userB is in the group hadoop (of course).

hadoop

3 Answers

  1. Best Answer

    To make it work you need to do the following:

    • make sure userB can write in the logs directory
    • make sure userB can write in dfs/ directories
    • make sure userB has read access to the directory hadoop fs -chown userB:hadoop

    Data will stay at /user/userA/ so you need to query using absolute path

    hadoop fs -ls /user/userA/<path>

    Using relative path is going to point you at different location

    hadoop fs -ls

    • 1

  2. Try setting read permissions:

    hadoop fs -chmod -R 644 PATH
    • 0

  3. You have to copy the data to your local disk and then reupload with the other user.

    • 0