Handling multibyte CSV files in PHP

Handling multibyte CSV files in PHP

• 1.
  Handling multibyte CSVfiles in PHP using fgetcsv() and setlocale() By Daniel Rhodes of Warp Asylum ( www.warpasylum.co.uk )
• 2.
  fgetcsv() fgetcsv() “Getsline from file pointer and parse for CSV fields”
• 3.
  There is nomb_fgetcsv() !
• 4.
  But “Locale settingis taken into account” by fgetcsv()
• 5.
  Let's see whatwe can do...
• 6.
  A case studyLet's say that we've got the following all on UTF-8: Mbstring.internal_encoding
• 7.
  Our database
• 8.
  Our PHP files
• 9.
  Our HTML output
• 10.
  But we needto process the following CSV file which is in EUC-JP encoding...
• 11.
  The CSV file
• 12.
  The CSV file source
• 13.
  The first attemptWell, let's try to process it as we would a “normal” non-multibyte CSV file...
• 14.
  The first attempt
• 15.
  Let's try againDoing nothing clearly didn't work!
• 16.
  Let's try settingmbstring.internal_encoding to that of our CSV file, EUC-JP...
• 17.
  Let's try again
• 18.
  Using setlocale() Mbstring.internal_encodingclearly didn't work!
• 19.
  Let's try usingthe setlocale() function...
• 20.
  Using setlocale()
• 21.
  Success! Setlocale() isthe key!
• 22.
  Just out ofcuriousity, let's remove the Japanese directive settings for mbstring and see if it still works...
• 23.
  Out of curiousity...
• 24.
  Solution Setlocale() isthe key
• 25.
  Set locale tothat of CSV file
• 26.
  Note that setlocale()doesn't permanently affect the system locale setting
• 27.
  Mbstring settings notimportant
• 28.
  Mbstring itself notactually needed!
• 29.
  That's all folks!I'll leave you with some things to think about: Locale:: class (from PHP 5.3) might also be of use
• 30.
  Specified locale forsetlocale() must be supported by OS of PHP server
• 31.
  Quoting string fieldsin the source CSV file may help enormously – so much so that setlocale() is not needed!
• 32.
  Questions welcome atdaniel.rhodes@warpasylum.co.uk