Comments on: Use flag –xml when you run mysqldump http://metaoptimize.com/blog/2009/10/14/use-flag-xml-when-you-run-mysqldump/ building machine learning and natural language processing tools Fri, 04 May 2012 20:09:00 +0000 http://wordpress.org/?v=abc hourly 1 By: Michael E Driscoll http://metaoptimize.com/blog/2009/10/14/use-flag-xml-when-you-run-mysqldump/comment-page-1/#comment-16 Michael E Driscoll Thu, 15 Oct 2009 01:47:36 +0000 http://blog.metaoptimize.com/?p=60#comment-16 XML has its place (somewhere), but in this programmer's humble opinion, exporting tabular data is not one of them. http://www.dataspora.com/blog/xml-and-big-data/ XML has its place (somewhere), but in this programmer’s humble opinion, exporting tabular data is not one of them.

http://www.dataspora.com/blog/xml-and-big-data/

]]> By: Joseph Turian http://metaoptimize.com/blog/2009/10/14/use-flag-xml-when-you-run-mysqldump/comment-page-1/#comment-15 Joseph Turian Wed, 14 Oct 2009 23:17:42 +0000 http://blog.metaoptimize.com/?p=60#comment-15 In response to <a href="http://groups.google.com/group/get-theinfo/browse_thread/thread/99c8a28bcaca685d" rel="nofollow">Joshua Reich</a>: Let me answer your last question first: > 4. Why aren't you using postgres ? I was getting data from someone that uses MySQL. Knowing what I know now, I believe should should have advised him to use the --xml flag. > 1. I am friends with awk & pals, and stripping out INSERT .. VALUE from > mysql dumps that I get from people is no biggy I am friends with perl, and you cannot simply split using /,/ to get your fields. The comma might be right in the middle of a string. With XML, though, it is simple to grep for <row>, because you know 100% that < will only be in the markup. > 2. I'm pretty sure MySQL supports dumping table data as CSV (SELECT ... > OUTHOUSE '/tmp/file.csv' ...) Same problems as above. > 3. For big data, XML is just silly big. Why? It gzips easily. Not being able to load it all into memory is less of an issue if it is easy to split the data using regular expressions. In response to Joshua Reich:

Let me answer your last question first:

> 4. Why aren’t you using postgres ?

I was getting data from someone that uses MySQL.
Knowing what I know now, I believe should should have advised him to use the –xml flag.

> 1. I am friends with awk & pals, and stripping out INSERT .. VALUE from
> mysql dumps that I get from people is no biggy

I am friends with perl, and you cannot simply split using /,/ to get your fields. The comma might be right in the middle of a string.

With XML, though, it is simple to grep for <row>, because you know 100% that < will only be in the markup.

> 2. I’m pretty sure MySQL supports dumping table data as CSV (SELECT …
> OUTHOUSE ‘/tmp/file.csv’ …)

Same problems as above.

> 3. For big data, XML is just silly big.

Why? It gzips easily.
Not being able to load it all into memory is less of an issue if it is easy to split the data using regular expressions.

]]>