This isn't a HBase question. This belongs on
mapreduce[email protected] lists. I'm moving it there, and lets
carry on on that list. I've added you to cc in case you are not
subscribed to the mentioned list :)

Also, to reply to your original question - No, there isn't anything in
Hadoop core's Java APIs that lets you do this 'essential' task. It
would be useful to have a delimited text input format, if you'd like
to contribute one. Perhaps use OpenCSV or such a library for good
extensibility over delimited files.

For the record, Pig and Hive have support for such needs in them
natively, and you can use these downstream libraries to get down and
dirty with your data quickly.
On Fri, Sep 30, 2011 at 5:07 PM, Arsalan Bilal wrote:
I am asking about such* **InputFormat* and *RecordReader* that read strings
of text separated by (;) semicolon characters

On Fri, Sep 30, 2011 at 11:11 AM, Sonal Goyal wrote:

Sorry, I think I got confused by the question and talked about the
OutputFormat not the input format, which is apparently what you are looking
for. Please ignore my answer. Apologies!

Best Regards,
Crux: Reporting for HBase <>
Nube Technologies <>


On Fri, Sep 30, 2011 at 12:32 PM, Sonal Goyal <[email protected]>
Hi Arsalan,

Are you trying to insert this data into HBase or are you trying to just
process this log file using Hadoop? I am not sure how your question is
related to HBase, so if it is unrelated, you can seek help on the mapreduce
user lists.

For a MR job, you can use TextInputFormat and specify the custom

Best Regards,
Crux: Reporting for HBase <>
Nube Technologies <>


On Fri, Sep 30, 2011 at 12:26 PM, Arsalan Bilal <
[email protected]>wrote:
No , i did not try Guava's Splitter
I am asking about such input format class that takes also separator.
As example, job.setInputFormatClass(<Class Format>, <Seperator>);
What will be inputFormatClass here that support separator?

On Thu, Sep 29, 2011 at 8:39 PM, Buttler, David <[email protected]>
Have you considered just taking the line of text as is and using

Not sure how this is related to HBase

-----Original Message-----
From: Arsalan Bilal
Sent: Thursday, September 29, 2011 7:24 AM
To: [email protected]
Subject: Problem in Input Format Class

i want to read text file (sample given below) separated with
using mapper. Each one record is separated with semicolon(;).
Should i write my own custom input format class? OR
Is there exist any input format class that ask about separator?

input File look


Best Regards,
Arsalan Bilal

Best Regards,
Arsalan Bilal

Harsh J

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupmapreduce-user @
postedSep 30, '11 at 12:36p
activeSep 30, '11 at 12:36p

1 user in discussion

Harsh J: 1 post



site design / logo © 2023 Grokbase