Hadoop > common-user > June 2006

Hi everybody, I'm a new hadoop user, and I would like to know if it's possible to use a file in the filesystem as a site config file : eg : in /etc/hadoop/hadoop-site.xml i have my configuration ...

Can someone lead me in the right direction as to configuring settings for large sorting operations 1M rows. I keep getting out of memory exceptions during the sort phase. Here are my current ...

Hi all. I embedded nutch in my application and implemented an indexing plugin to add custom index fields. I need to pass some runtime parameters to the plugin, so I was wondering if it is possible to ...

Hi, I see Hadoop 0.3.0 is available for download, but there's been no announcement on this list or on the Hadoop web pages? I'm just wondering if there's any upgrade procedure, or if it's simply a ...

Hi All, I just recently upgraded from hadoop .2 to hadoop .32 and now I can't get a file to the DFS. It seems like when we go to upload the CRC file (which happens before the actual file is upload) I ...

I'm looking for feedback/ideas/suggestions/warnings on the following subject: We really need a mechanism for foreground and background jobs. We have jobs that take 12 to 48 hours to complete, and we ...

Can someone explain a little about these different properties and how they would affect performance, operation, and memory. io.sort.factor io.sort.mb io.bytes.per.checksum Thanks, Dennis

With the new log4j logging stuff, the way that you set finer grain logging levels for particular loggers is via the conf/log4j.properties. For example, in mine I have set the level up on 3 classes ...

I am seeing some weird behavior with tasks on hadoop-0.3 dev with the current nutch. This is on an 11 node cluster with 55 map tasks (although this is only happening on the fetcher and fetcher is ...