[HDFS-user] Output 'hadoop dfs -get' to stdout

[HDFS-user] Output 'hadoop dfs -get' to stdout

	Alex Parvulescu
	Mar 16, 2010 at 9:59 am

Hello,

Is there a reason for which 'hadoop dfs -get' will not output to stdout?

I see 'hadoop dfs -put' can handle stdin. It would seem that dfs would have
to also support outputing to stdout.

thanks,
alex

Search Discussions

Discussion Posts

Follow ups

Varene Olivier: Hello Alex, get writes down a file on your FileSystem hadoop dfs [-get [-ignoreCrc] [-crc] ] with src : your file in your hdfs localdst : the name of the file with the collected data (from src) on your local filesystem To get the results to STDOUT, you can use cat hadoop dfs [-cat ] with src : your file in your hdfs Regards Olivier Alex Parvulescu a écrit :
Alex Parvulescu: Hello Olivier, I've tried 'cat'. This is the error I get: 'cat: Source must be a file.' This happens when I try to get all parts from a directory as a single .csv file. Something like that: hadoop dfs -cat hdfs://master:54310/user/hadoop-user/output/solr/ cat: Source must be a file. This is what the dir looks like hadoop dfs -ls hdfs://master:54310/user/hadoop-user/output/solr/ Found 3 items drwxr-xr-x - hadoop supergroup 0 2010-03-12 16:36 /user/hadoop-user/output/solr/_logs -rw-r--r-- 2
Alex Parvulescu: Hello, one minor correction. I'm talking about 'hadoop dfs -getmerge' . You are right, '-cat' is the equivalent of '-get' and they both handle only files. I'd like to see an equivalent of 'getmerge' to stdout. sorry for the confusion alex

Related Discussions

Discussion Navigation

view	thread \| post
posts	‹ prev \| 1 of 6 \| next ›

Discussion Overview

group	hdfs-user @
categories	hadoop
posted	Mar 16, '10 at 9:59a
active	Mar 17, '10 at 11:37a
posts	6
users	2
website	hadoop.apache.org...
irc	#hadoop

font	variable	Hotkey: f
user style	avatars	Hotkey: a

[HDFS-user] Output 'hadoop dfs -get' to stdout

Search Discussions

Discussion Posts

Related Discussions

2 users in discussion