Handling multi-line column values in hive


1 Answer(s)


Hi Keith,
This is one of the limitation of hive as we can't ignore the Line terminator value default set as new line. Read this article:
http://marcelkrcah.net/blog/how-newline-can-ruin-your-hive/

You can change the field delimiter but you can't change the line terminated value.

As far my knowledge there is no direct solution for it. I will look for it. In case if I found some solution or tweak. I will let you know.
You can use the solution mention the article, use of the third-party format as avro or parpequet format.

Hope this helps.
Thanks.