zomo tech

MySQL 4.0 -> 5.0, unicode

Thursday, 2. 03. 2006  –  Category: all, sw

Things:

• Loading a ISO-8559-1 encoded dump into a UTF-8 database breaks, fields are truncated at the first non-valid character. Not terribly surprising, but MySQL is silent about the breakage.
• Content which looks like, and is declared, ISO-8559-1 might actually get rendered by browsers as CP1252 (aka MS-ANSI WINDOWS-1252)
• The difference between these two are that 8859 doesn’t use 0x7f to 0x9f, but Windows does – for long hyphens, ellipsis etc
• iconv -f cp1252 -t utf-8IYF

Links:

• http://en.wikipedia.org/wiki/ISO/IEC_8859-1#Code_table
• http://en.wikipedia.org/wiki/Windows-1252