Grokbase Groups Avro user April 2013
FAQ

Search Discussions

23 discussions - 111 posts

  • Hi, Is there a reason for specific records to not implement the generic API? I didn't find any obvious technical reason, but maybe I missed something. Thanks, C.
    Christophe TatonChristophe Taton
    Apr 15, 2013 at 6:24 pm
    Apr 22, 2013 at 8:19 pm
  • I implemented essentially the Java avro example but using the GenericDatumWriter and GenericDatumReader and hit an issue. https://gist.github.com/jcoveney/5317904 This is the error: Exception in ...
    Jonathan CoveneyJonathan Coveney
    Apr 5, 2013 at 9:25 am
    Apr 9, 2013 at 4:17 pm
  • Hey folks, Aware that I can use Pig, Hive, etc to join avro files together, but I have several use cases where I need to perform a reduce-side join on two avro files. MultipleInputs doesn't seem to ...
    Sripad SriramSripad Sriram
    Apr 24, 2013 at 12:01 am
    Apr 28, 2013 at 2:11 am
  • Hi, Does anyone know if/how it's possible to get compressed Avro files as an input to a M/R job? If so, which codecs are supported? Thanks, Nir -- View this message in context ...
    Nir_zamirNir_zamir
    Apr 22, 2013 at 9:27 am
    May 1, 2013 at 7:12 am
  • I'm working on migrating an internally developed serialization format to Avro. In the process, there have been many cases where I made a mistake migrating the schema (I've automated it), and then ...
    Jonathan CoveneyJonathan Coveney
    Apr 4, 2013 at 1:58 pm
    Apr 6, 2013 at 8:42 pm
  • Hi, I noticed that after calling: /AvroJob.setMapOutputSchema(conf, Pair.getPairSchema(Schema.create(Type.INT), schema));/ (schema is parsed from an avro file, and has no namespace) When the M/R job ...
    Nir_zamirNir_zamir
    Apr 9, 2013 at 4:02 pm
    Apr 25, 2013 at 12:23 pm
  • I'd like to be able to alias primitive types, for example to indicate that a field of type "date" is really a string that I should treat specially. The spec says "Named types and fields may have ...
    Jay HackerJay Hacker
    Apr 12, 2013 at 7:15 pm
    Apr 15, 2013 at 4:26 pm
  • I have the following schema: {"name":"hey", "type":"record", "fields":[{"name":"a","type":["null","string"],"default":null}]} I am trying to deserialize the following against this schema using Java ...
    Jonathan CoveneyJonathan Coveney
    Apr 9, 2013 at 9:07 am
    Apr 11, 2013 at 10:22 pm
  • I think an example is most useful: https://gist.github.com/jcoveney/5311795 I realize that the python implementation isn't as strict as the Java implementation, though this result is a bit ...
    Jonathan CoveneyJonathan Coveney
    Apr 4, 2013 at 4:22 pm
    Apr 5, 2013 at 8:22 am
  • Hi, I had to re-create my local Maven repository, and since then I'm not able to compile Avro (I need to do it to test a patch). Just to make sure I'm doing the right thing: 1. Get the 'trunk' from ...
    Nir_zamirNir_zamir
    Apr 22, 2013 at 9:17 am
    Apr 28, 2013 at 9:03 am
  • I installed avro for python. Like Referred : https://avro.apache.org/docs/current/gettingstartedpython.html 1. Build as per the instructions. Here is the output. ************** Installation ...
    Milind VaidyaMilind Vaidya
    Apr 15, 2013 at 8:55 pm
    Apr 16, 2013 at 2:01 pm
  • This should replicate the issue on 1.7.4: https://gist.github.com/jcoveney/5459644 Basically, when using DataFileReader to read a union of bytes, it's outputting in the form of {"bytes": "<thebytes ...
    Jonathan CoveneyJonathan Coveney
    Apr 25, 2013 at 1:27 pm
    May 7, 2013 at 8:32 am
  • Hi, I have a Hive table created with the Avro Serde. When I add some data to it using the Snappy compression, it still looks compressed with deflate (the file starts with ...
    Nir_zamirNir_zamir
    Apr 25, 2013 at 2:13 pm
    Apr 25, 2013 at 3:03 pm
  • The following gist illustrates my question: https://gist.github.com/jcoveney/5320422 It seems pretty surprising to me that all of these cases all return 1.0, at least in python (I will now do this in ...
    Jonathan CoveneyJonathan Coveney
    Apr 5, 2013 at 4:11 pm
    Apr 16, 2013 at 6:08 pm
  • Hi, I am using to 1.4.0 version of avro (not by choice) and tried a toString() on a GenericRecord containing somewhere a GenericEnumSymbol. My problem is that this instance is not represented as a ...
    Bertrand DechouxBertrand Dechoux
    Apr 19, 2013 at 2:16 pm
    Apr 21, 2013 at 4:12 pm
  • //Data to be written unsigned char buffer_data[] = {0x12, 0x34, 0x56, 0x78,0x12,0x34,0x56,0x78,0x12, 0x34, 0x56, 0x78,0x12, 0x34, 0x56, 0x78,0x12,0x34,0x56,0x78,0x12, 0x34, 0x56, 0x78,0x12, 0x34, ...
    Milind VaidyaMilind Vaidya
    Apr 9, 2013 at 2:12 pm
    Apr 12, 2013 at 4:01 am
  • I'm looking to use Avro to send data back and forth between a Java process and a Python process. I was planning on just streaming the data across standard input but it looks like Python doesn't ...
    Jeremy KarnJeremy Karn
    Apr 9, 2013 at 2:37 pm
    Apr 9, 2013 at 3:43 pm
  • To best of my knowledge use of avro_datum_t is discouraged. So I was trying following code //Assume path variable to be having proper value and proper exception handling in place PART A: avro_value_t ...
    Milind VaidyaMilind Vaidya
    Apr 5, 2013 at 5:26 pm
    Apr 9, 2013 at 2:10 pm
  • As the example on the avro c website shows, Create datum for record avro_datum_t person = avro_record(person_schema); Create Datun for a field avro_datum_t id_datum = avro_int64(++id); Set the field ...
    Milind VaidyaMilind Vaidya
    Apr 6, 2013 at 2:34 pm
    Apr 8, 2013 at 1:28 pm
  • I have a schema file like this {"namespace" : "com.b2b.camel.endpoint", "type" : "record", "name" : "CamelEndpoint", "fields" : [ {"name" : "id", "type" : "int"}, {"name" : "desc", "type" ...
    Atin SoodAtin Sood
    Apr 20, 2013 at 3:15 pm
    Apr 21, 2013 at 6:22 pm
  • Hi, I have a a csv string which I want to serialize, compress and write to a database. * I have the following code to serialize the string* ByteArrayOutputStream outputStream = new ...
    Vinod JammulaVinod Jammula
    Apr 9, 2013 at 5:48 am
    Apr 9, 2013 at 8:44 am
  • Resending now that I am subscribed :)
    Enns, StevenEnns, Steven
    Apr 27, 2013 at 10:25 pm
    Apr 27, 2013 at 10:25 pm
  • Hi, I had to re-create my local Maven repository, and since then I'm not able to compile Avro (I need to do it to test a patch). Just to make sure I'm doing the right thing: 1. Get the 'trunk' from ...
    Nir_zamirNir_zamir
    Apr 18, 2013 at 7:42 am
    Apr 18, 2013 at 7:42 am
Group Navigation
period‹ prev | Apr 2013 | next ›
Group Overview
groupuser @
categoriesavro
discussions23
posts111
users24
websiteavro.apache.org
irc#avro

24 users for April 2013

Jonathan Coveney: 20 posts Nir_zamir: 15 posts Doug Cutting: 12 posts Martin Kleppmann: 10 posts Milind Vaidya: 9 posts Scott Carey: 7 posts Christophe Taton: 5 posts Jeremy Kahn: 5 posts Sripad Sriram: 4 posts Douglas Creager: 3 posts Bertrand Dechoux: 2 posts Enns, Steven: 2 posts Harsh J: 2 posts Jay Hacker: 2 posts Jeremy Karn: 2 posts Pankaj Shroff: 2 posts Philip Zeyliger: 2 posts Atin Sood: 1 post Curt Hagenlocher: 1 post Dave McAlpin: 1 post
show more