[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Runping Qi updated HADOOP-2906:

Status: Patch Available (was: Open)

The attached patch include a common abstract base class (MultipleOutputFormat) and two concrete classes:
MultipleTextOutputFormat and MultipleSequenceFileOutputFormat. These classes implement the default behaviors,
which are the same as TextOutputFormat class and SequenceFileOutputFormat class, respectively.
The users can subclass these classes and overwrite one of the protected method to implement a specific logic
of writing data to different output files.
The patch also contains a test case, which also illustrates two special ways of using these classes.

output format classes that can write to different files depending on keys and/or config variable

Key: HADOOP-2906
URL: https://issues.apache.org/jira/browse/HADOOP-2906
Project: Hadoop Core
Issue Type: New Feature
Components: mapred
Reporter: Runping Qi
Assignee: Runping Qi
Attachments: patch.2096.txt

I've a few apps that require to write out data into different files/directories depending on keys and/or configuration variables.
I've implemented such classes for those apps. I noticed that many other users have similar need from time to time.
So I think it may be a good idea to contribute to Hadoop mapred.lib package so that other users can benefit from it.
This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Search Discussions

Discussion Posts


Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 5 of 35 | next ›
Discussion Overview
groupcommon-dev @
postedFeb 26, '08 at 11:31p
activeMar 6, '08 at 12:30p

1 user in discussion

Hudson (JIRA): 35 posts



site design / logo © 2023 Grokbase