FAQ
Repository: hive
Updated Branches:
   refs/heads/master c9888dda3 -> 872260107


HIVE-12820: Remove the check if carriage return and new line are used for separator or escape character (Aihua Xu, reviewed by Yongzhi Chen and Chaoyu Tang)


Project: http://git-wip-us.apache.org/repos/asf/hive/repo
Commit: http://git-wip-us.apache.org/repos/asf/hive/commit/87226010
Tree: http://git-wip-us.apache.org/repos/asf/hive/tree/87226010
Diff: http://git-wip-us.apache.org/repos/asf/hive/diff/87226010

Branch: refs/heads/master
Commit: 87226010711ff98379aca9870fb5bd9f191cff79
Parents: c9888dd
Author: Aihua Xu <aihuaxu@apache.org>
Authored: Mon Jan 11 15:21:29 2016 -0500
Committer: Aihua Xu <aihuaxu@apache.org>
Committed: Tue Jan 19 13:56:39 2016 -0500

----------------------------------------------------------------------
  .../org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java | 4 ----
  1 file changed, 4 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hive/blob/87226010/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
----------------------------------------------------------------------
diff --git a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
index 11af860..46dfaa7 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
@@ -104,10 +104,6 @@ public class LazySerDeParameters implements LazyObjectInspectorParameters {
          needsEscape[b & 0xFF] = true; // Converts the negative byte into positive index
        }

- // '\r' and '\n' are reserved and can't be used for escape chars and separators
- if (needsEscape['\r'] || needsEscape['\n']) {
- throw new SerDeException("\\r and \\n cannot be used as escaping characters or separators");
- }
        boolean isEscapeCRLF = Boolean.valueOf(tbl.getProperty(serdeConstants.SERIALIZATION_ESCAPE_CRLF));
        if (isEscapeCRLF) {
          needsEscape['\r'] = true;

Search Discussions

  • Aihuaxu at Jan 19, 2016 at 7:12 pm
    Repository: hive
    Updated Branches:
       refs/heads/branch-2.0 dd95410fd -> e86abb9e6


    HIVE-12820: Remove the check if carriage return and new line are used for separator or escape character (Aihua Xu, reviewed by Yongzhi Chen and Chaoyu Tang)


    Project: http://git-wip-us.apache.org/repos/asf/hive/repo
    Commit: http://git-wip-us.apache.org/repos/asf/hive/commit/e86abb9e
    Tree: http://git-wip-us.apache.org/repos/asf/hive/tree/e86abb9e
    Diff: http://git-wip-us.apache.org/repos/asf/hive/diff/e86abb9e

    Branch: refs/heads/branch-2.0
    Commit: e86abb9e6f5df3314e75a6c077328377188f8f68
    Parents: dd95410
    Author: Aihua Xu <aihuaxu@apache.org>
    Authored: Mon Jan 11 15:21:29 2016 -0500
    Committer: Aihua Xu <aihuaxu@apache.org>
    Committed: Tue Jan 19 14:11:50 2016 -0500

    ----------------------------------------------------------------------
      .../org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java | 4 ----
      1 file changed, 4 deletions(-)
    ----------------------------------------------------------------------


    http://git-wip-us.apache.org/repos/asf/hive/blob/e86abb9e/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
    ----------------------------------------------------------------------
    diff --git a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
    index 11af860..46dfaa7 100644
    --- a/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
    +++ b/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySerDeParameters.java
    @@ -104,10 +104,6 @@ public class LazySerDeParameters implements LazyObjectInspectorParameters {
              needsEscape[b & 0xFF] = true; // Converts the negative byte into positive index
            }

    - // '\r' and '\n' are reserved and can't be used for escape chars and separators
    - if (needsEscape['\r'] || needsEscape['\n']) {
    - throw new SerDeException("\\r and \\n cannot be used as escaping characters or separators");
    - }
            boolean isEscapeCRLF = Boolean.valueOf(tbl.getProperty(serdeConstants.SERIALIZATION_ESCAPE_CRLF));
            if (isEscapeCRLF) {
              needsEscape['\r'] = true;

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommits @
categorieshive, hadoop
postedJan 19, '16 at 7:10p
activeJan 19, '16 at 7:12p
posts2
users1
websitehive.apache.org

1 user in discussion

Aihuaxu: 2 posts

People

Translate

site design / logo © 2021 Grokbase