Home / server / Questions / 458340
Accepted
usr-local-ΕΨΗΕΛΩΝ
Asked: 2012-12-16 03:11:23 +0800 CST

Euro character messed up during FTP transfer

  • 772

My customer is using a very outdated ecommerce management system on my hosting service. For that product, no support is being provided anymore by the vendor.

Brief explanation: the shop website, that claims to run under LAMP stack, is built by an old Visual Basic Windows application running on MS Access. The user constructs the shop, defines the HTML template, adds products and categories, etc.

Then the VB exe builds the PHP pages (one for each template page) and the SQL script to run on MySQL. It also uploads everything via FTP and runs the installation/upgrade script on its own.

The problem

Browsing the website, many products' descriptions are cut before the euro sign. For example, what was supposed to be "Product price €1000" becomes "Product price"

The analysis

  • MySQL contains a cutted description until the € sign, so it's not PHP fault
  • The Access databases contain full description with € sign, so it's not fault of the webmaster writing bad description or eDisplay cutting them
  • The SQL that will run once the site gets uploaded, stored on my local machine before upload, contains the € sign
  • The same script, after being FTPed by eDisplay and opened with nano from SSH, shows the € sign messed up like this: ^À
  • vsftpd log reports (obfuscated for privacy) Sat Dec 15 11:16:57 2012 22 xxx.xxx.128.13 1112727 /srv/www/domains/xxxxxx.it/htdocs/db.sql b _ i r xxxxxxx ftp 0 * c which seems to be a binary transfer (and also a huge security vulnerability because you can download the whole database from unauthenticated HTTP)
  • The eDisplay internal FTP client provides no option for ascii/binary transfer modes
  • [Add] Trying to manually upload the SQL file via SFTP shows messing up euro
  • [Add2] Trying to manually upload using Xftp client with explicit ASCII mode doesn't fix too

It looks like the file gets uploaded as binary. Perhaps on the customer's previous host it all worked fine because that was a Windows host.

The server

It's an Azure virtual machine running openSUSE 12.2 with both vsftpd and openSSH

The question

Without asking the customer to manually upload files using FileZilla or replacing € with €, because he refuses, what can I do on server side to prevent vsftpd to screw up euro sign?

ftp

2 Answers

  1. You can try altering the encoding of the SQL file along with the line delimiter. Or YOU could change all the symbol to €.

    • 2
  2. Best Answer

    The Partial fix

    By setting MySQL's default character set different than UTF-8 I can display Euro correctly

    Source

    #default-character-set = utf8
collation-server = latin1_general_ci
#init-connect='SET NAMES latin1_general_ci'
character-set-server = latin1

    First line is commented because my version of MySQL didn't recognize it Third is commented because I got an error on every connection logged on server log and connection truncated (so every site offline)

    I'm saying the fix is partial because I bypassed the FTP upload and ran the SQL directly into phpMyAdmin with correct Euro sign

    • 0