FAQ
Hello

How to specify not default (64 Mb) block size for fuse_dfs !?

In hdfs-site.xml 32MB:

<property>
<name>dfs.block.size</name>
<value>33554432</value>
</property>

via command line hadoop dfs -copyFromLocal ...... - all newly created
blocks - 32Mb,

but fuse_dfs after mounting creates blocks with default 64Mb size !

Best regards,
Sergey R.

Search Discussions

  • Zhuweimin at Mar 25, 2010 at 12:34 am
    Hi
    How to specify not default (64 Mb) block size for fuse_dfs !?
    Because hdfs-site.xml not in CLASSHPATH in the file of fuse_dfs_wrapper.sh.
    So you need to edit the fuse_dfs_wrapper.sh and add one line

    export CLASSPATH=<the directory of your hdfs-site.xml>

    before this part

    for f in ls $HADOOP_HOME/lib/*.jar $HADOOP_HOME/*.jar ; do
    export CLASSPATH=$CLASSPATH:$f
    done

    I wish it can resolve your question.

    -----Original Message-----
    From: fenix.serega@gmail.com
    Sent: Wednesday, March 24, 2010 10:22 PM
    To: hdfs-user@hadoop.apache.org
    Subject: fuse_dfs_wrapper && fuse_dfs block size

    Hello

    How to specify not default (64 Mb) block size for fuse_dfs !?

    In hdfs-site.xml 32MB:

    <property>
    <name>dfs.block.size</name>
    <value>33554432</value>
    </property>

    via command line hadoop dfs -copyFromLocal ...... - all newly created
    blocks - 32Mb,

    but fuse_dfs after mounting creates blocks with default 64Mb size !

    Best regards,
    Sergey R.
  • Fenix Serega at Mar 25, 2010 at 3:00 pm
    Thanks, you are right. Solved.

    2010/3/25 zhuweimin <xim-shu@tsm.kddilabs.jp>:
    Hi
    How to specify not default (64 Mb) block size for fuse_dfs !?
    Because hdfs-site.xml not in CLASSHPATH in the file of fuse_dfs_wrapper.sh.
    So you need to edit the fuse_dfs_wrapper.sh and add one line

    export CLASSPATH=<the directory of your hdfs-site.xml>

    before this part

    for f in ls $HADOOP_HOME/lib/*.jar $HADOOP_HOME/*.jar ; do
    export CLASSPATH=$CLASSPATH:$f
    done

    I wish it can resolve your question.

    -----Original Message-----
    From: fenix.serega@gmail.com
    Sent: Wednesday, March 24, 2010 10:22 PM
    To: hdfs-user@hadoop.apache.org
    Subject: fuse_dfs_wrapper && fuse_dfs block size

    Hello

    How to specify not default (64 Mb) block size for fuse_dfs !?

    In hdfs-site.xml 32MB:

    <property>
    <name>dfs.block.size</name>
    <value>33554432</value>
    </property>

    via command line hadoop dfs -copyFromLocal ...... - all newly created
    blocks - 32Mb,

    but fuse_dfs after mounting creates blocks with default 64Mb size !

    Best regards,
    Sergey R.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphdfs-user @
categorieshadoop
postedMar 24, '10 at 1:23p
activeMar 25, '10 at 3:00p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Fenix Serega: 2 posts Zhuweimin: 1 post

People

Translate

site design / logo © 2022 Grokbase