I was reading some of the documentation and I came across this statement:
"Note that if the target table (or partition) already has a file whose name
collides with any of the filenames contained in *filepath* - then the
existing file will be replaced with the new file."
I have rotating data logs that start at log.1 and go to log.512 and wrap
around back to log.1, does this mean that when I try to LOAD DATA log.1
again it's going to overwrite the other one?
In normal MySQL, this data is just constantly appended regardless of the
file name, but given how it's likely the file is being loaded in hdfs this
probably is different. If what I am thinking is happening, what is the
solution for rotating log files?