Problems with sync software: timestamps and non-latin chars

[pizzaman]

Dear filezilla community,

I have a problem, and i'm not quite sure what the cause is. I have a home ftp server running FileZilla Server 0.9.32. I can log in, upload and download without problems. When i look at my files with filezilla client, everything is fine. But if i use other ftp client software (like windows explorer, allway sync and total commander portable from my winmo phone), the "last modified" time is 0:00 (midnight) or sometimes 1:00 or 2:00. The time is still correct.

This effectively makes it impossible for me to synchronize my files. What is the cause? Is most client software not compliant to some standard, and if so, which? Does it have anything to do with MDTM? Is filezilla server not configured properly?

I've read topics like Last modified timestamp is 1 hour off since Daylight Saving, Auto-updating the last modified date on the local side? and Last modified is appearing incorrectly in remote window, but these don't seem to answer my question. I really hope someone can explain the cause of this.

[pizzaman]

Or is it because filezille client uses the MLSD command?

[botg]

Other clients use LIST, which does not contain timestamps for files older than a few months.

FileZilla uses MLSD which is standardized and does include times for all files.

[pizzaman]

Thank you very much for answering. I now understand why the times are missing when using windows explorer as FTP client.

What i do not understand is that the program Allway Sync says the files are modified at one or two o'clock (second image), but it's probably just an artifact. I also don't understand why they offer FTP sync, when the program can't even retrieve modification times. Or could i reconfigure my server in any way so that it will work with allway sync?

I've added images, so everyone can use your help.

.

[botg]

Timezone conversion issues and daylight saving time trouble on top of it.

If I were supreme ruler of the world I'd banish timezones and daylight savings, whole world would just use UTC.

[pizzaman]

Agreed. And right-steered cars and non-metric units with that. All we need, really, is some car factories who could use some extra orders a new name for a quarter pounder. Neither could be to big a problem

Since i purchased the pro version of allway sync, i've asked the support desk some questions about this and pointed them to this thread. I don't quite understand how their ftp synchronization feature is ever supposed to work. Or could there be anything i could do about this on the server side? I'll report back what their response is.

[boco]

If I were supreme ruler of the world

So you're still working on it...

I'd banish timezones and daylight savings, whole world would just use UTC.

Count me in. Especially daylight savings are ridiculous.

[pizzaman]

So, here's my discussion with the Allway helpdesk:

Dear Arend,

Some FTPs often make incorrect time stamps of files. Therefore Allway Sync uses own methods to detect file modifications. The time stamp that you see in Allway Sync window after first synchronization is not real file time stamp (attribute) it is a file synchronization time stamp that saved in metadata. Allway Sync saves metadata in "metadata.xml" file that located in "_SYNCAPP" hidden folder in both source and destination folders. On the next sync the synchronizer will compare metadata from source and destination and detect any modifications with files. So Allway Sync does not look at real file time stamp.

You got the warnings that the files have different timestamps because you probably didn't finish the first sync correctly and metadata wasn't saved. So synchronizer does not know if there were any modifications or not. To solve this problem you just need to synchronize the files FULLY, ignoring any warnings because metadata will be written on the end of sync. [...]

[...]Thank you for your answer. The problem is i'm trying to keep about six devices synchronized. I would like to synchronize from my job pc to my home pc over FTP, but other devices also synchronize with my home pc over USB or the Windows network. And i occasionaly exchange bigger files with a usb harddisk in stead of over FTP. If I understand you correctly, the "last modified" time of files doesn't get synchronized properly. Won't your suggestion mess up the syncrhonizations then?

Even if i would only sync to that computer using FTP, I'd be afraid of synchronization mistakes. Allway sync doesn't notice a modification if the size and date aren't changed (but the modification time is) am i correct? This might sound very hypothetical, but in my case it's not, because that's what happens with many of my portable apps: files get modified the same day they were syncrhonized, the time stamp changes, but the size doesn't change, so the modification wouldn't get noticed.

So, am i to conclude the normal synchronization just isn't compatible with the FTP synchronization feature of Allway sync?[...]

Dear Arend,

Please understand. You synchronize your files through FTP server and when the synchronizer copies files to the server, FTP gives "last modified" timestamp and other timestamps to the files. That is why the "last modified" timestamp of your files is changing. You can make sure of this if you try to copy the files to FTP manually. Allway Sync does not change attributes of the files.

As I said, each FTP server makes timestamps of the files by different mechanism. This is because Allway Sync uses "metadata.xml" file to store information about file timestamps. Allway Sync does not look at the real file modification ("last modification") attribute, it uses metadata to detect any modifications with files correctly.

Again: Allway Sync does not change the file attributes and it is not Allway Sync issue.[...]

[pizzaman]

Yet...

I also have a problem in SuperFlexible sync and in GoodSync, be it a different problem. That means however that synching to a filezilla server doesn't work properly for three of the best, most used and most widely supported file syncrhonization programs.

Both SuperFlexible and GoodSync have issues with non-latin characters in files. When testing many (well, 8 ) different ftp clients and reading through the logs, it appears the problem can be solved by
1. using either the MLSD command in stead of LIST or LIST -a, or
2. sending the command "OPTS UTF8 ON" at the beginning of the session.

Both GoodSync and SuperFlexible do neither. But what i don't understand is: they were tested to just work with at least some FTP servers. What do these servers do differently Do they turn utf-8 on automatically or something?

[botg]

OPTS UTF8 ON is a nonsense command, it does absolutely nothing on modern servers. Also its totally unrelated to the problem at hand.

[pizzaman]

Still, some clients get it right with non-latin characters where others don't.





When i read through the filezilla server log, it seems some get it right even without using MLSD (as filezilla client does).

This is Allway sync, which does get the non-latin characters

Code: Select all

(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> Connected, sending welcome message...
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> 220-FileZilla Server version 0.9.32 beta
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> 220-written by Tim Kosse (Tim.Kosse@gmx.de)
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> 220 Please visit http://sourceforge.net/projects/filezilla/
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> USER uuu
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> 331 Password required for uuu
(000084) 11-8-2009 13:54:15 - (not logged in) (x.x.x.x)> PASS ********
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 230 Logged on
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> FEAT
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 211-Features:
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  MDTM
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  REST STREAM
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  SIZE
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  MLST type*;size*;modify*;
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  MLSD
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  UTF8
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  CLNT
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)>  MFMT
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 211 End
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> CLNT AllwaySync
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Don't care
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> OPTS UTF8 ON
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 UTF8 mode enabled
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> TYPE A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Type set to A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> PORT x,x,x,x,233,234
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Port command successful
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> LIST /New/Enya
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 226 Transfer OK
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> PWD
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 257 "/" is current directory.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> MKD /New/Enya
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 550 Directory already exists
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> TYPE A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Type set to A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> PORT x.x.x.x,234,6
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Port command successful
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> LIST /New/Enya/_SYNCAPP/metadata.xml
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 550 Directory not found.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> TYPE A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Type set to A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> PORT x,x,x,x,234,18
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Port command successful
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> LIST /New/Enya/_SYNCAPP/metadata.xml
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 550 Directory not found.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> CWD /New/Enya/_SYNCAPP
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 550 CWD failed. "/New/Enya/_SYNCAPP": directory not found.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> CWD /New/Enya
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> TYPE A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Type set to A
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> PORT x,x,x,x,234,32
(000084) 11-8-2009 13:54:15 - uuu (x.x.x.x)> 200 Port command successful
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> LIST
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 226 Transfer OK
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> PWD
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> CWD *
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 550 CWD failed. "/New/Enya/*": directory not found.
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> TYPE A
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 200 Type set to A
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> PORT x,x,x,x,234,52
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 200 Port command successful
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> LIST
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000084) 11-8-2009 13:54:16 - uuu (x.x.x.x)> 226 Transfer OK

And this is GoodSync, which doesn't get it right with the non-latin characters

Code: Select all

(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> Connected, sending welcome message...
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> 220-FileZilla Server version 0.9.32 beta
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> 220-Arends FTP server
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> 220-written by Tim Kosse (Tim.Kosse@gmx.de)
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> 220 Please visit http://sourceforge.net/projects/filezilla/
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> USER uuu
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> 331 Password required for uuu
(000079) 11-8-2009 13:51:28 - (not logged in) (x.x.x.x)> PASS ********
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 230 Logged on
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> SYST
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 215 UNIX emulated by FileZilla
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> TYPE I
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 200 Type set to I
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 257 "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> PORT x,x,x,x,161,113
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 200 Port command successful
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> STOR /New/Enya/_gsdata_/_test_.gs
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 150 Opening data channel for file transfer.
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 226 Transfer OK
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> SIZE _test_.gs
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 213 9
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> MDTM _test_.gs
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 213 20090811115128
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> MDTM 20080415012345 _test_.gs
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 550 File not found
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> DELE /New/Enya/_gsdata_/_test_.gs
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 File deleted successfully
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:28 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PORT x,x,x,x,161,153
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 200 Port command successful
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> LIST -a
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 226 Transfer OK
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 201 - Enya - Orinoco Flow (Sail Away).mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071302
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 202 - Enya - Ebud.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 File not found
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 203 - Enya - River.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071302
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 204 - Enya - The Longships.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071303
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 205 - Enya - Na Laetha Geal M'ige.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 File not found
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 206 - Enya - Book Of Days (English Rmx).mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071303
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 207 - Enya - Shepherd Moons.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071303
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 208 - Enya - Caribbean Blue.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071304
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 209 - Enya - Evacue.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 File not found
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 210 - Enya - Evening Falls.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071304
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 211 - Enya - Lothlrien.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 File not found
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 212 - Enya - Marble Halls.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 213 20090409071305
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PORT x,x,x,x,161,200
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 200 Port command successful
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> LIST -a
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 226 Transfer OK
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PORT x,x,x,x,161,216
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 200 Port command successful
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> LIST -a
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 226 Transfer OK
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_/_saved_
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 CWD failed. "/New/Enya/_gsdata_/_saved_": directory not found.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PWD
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 257 "/New/Enya/_gsdata_" is current directory.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> PORT x,x,x,x,161,236
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 200 Port command successful
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> LIST -a
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 150 Opening data channel for directory list.
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 226 Transfer OK
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> disconnected.

For completenes, this is superflexible, which also doesn't recognize that the filenames are in fact the same.

Code: Select all

(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> Connected, sending welcome message...
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> 220-FileZilla Server version 0.9.32 beta
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> 220-Arends FTP server
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> 220-written by Tim Kosse (Tim.Kosse@gmx.de)
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> 220 Please visit http://sourceforge.net/projects/filezilla/
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> USER uuu
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> 331 Password required for uuu
(000078) 11-8-2009 13:50:49 - (not logged in) (x.x.x.x)> PASS ********
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 230 Logged on
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> FEAT
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 211-Features:
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  MDTM
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  REST STREAM
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  SIZE
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  MLST type*;size*;modify*;
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  MLSD
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  UTF8
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  CLNT
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)>  MFMT
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 211 End
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> PWD
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 257 "/" is current directory.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> CWD /New/Enya
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> CWD /New/Enya
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya" is current directory.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> MODE S
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 200 MODE set to S.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> STRU F
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 200 Using file structure 'File'
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> TYPE I
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 200 Type set to I
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> PASV
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 227 Entering Passive Mode (x,x,x,x,12,147)
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> LIST
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 150 Connection accepted
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 226 Transfer OK
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> MODE S
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 200 MODE set to S.
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> STRU F
(000078) 11-8-2009 13:50:49 - uuu (x.x.x.x)> 200 Using file structure 'File'
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> TYPE I
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 200 Type set to I
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> PASV
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 227 Entering Passive Mode (x,x,x,x,12,148)
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> LIST
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 150 Connection accepted
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 226 Transfer OK
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> CWD /New/Enya/_gsdata_
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 250 CWD successful. "/New/Enya/_gsdata_" is current directory.
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> MODE S
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 200 MODE set to S.
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> STRU F
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 200 Using file structure 'File'
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> TYPE I
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 200 Type set to I
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> PASV
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 227 Entering Passive Mode (x,x,x,x,12,149)
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> LIST
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 150 Connection accepted
(000078) 11-8-2009 13:50:50 - uuu (x.x.x.x)> 226 Transfer OK
(000078) 11-8-2009 13:50:58 - uuu (x.x.x.x)> QUIT
(000078) 11-8-2009 13:50:58 - uuu (x.x.x.x)> 221 Goodbye
(000078) 11-8-2009 13:50:58 - uuu (x.x.x.x)> disconnected.

I synced over usb before doing this, so the file names (and modified times) should be identical.
What is the difference; why does allway sync manage to get the non-latin characters right, where the other two don't

And why do the two that don't get it right with filezilla server, claim they do work with other ftp servers?

btw thanks foor looking into this

[boco]

Some programs support UTF-8, these work with UTF-8 compliant servers like FZ Server. Some don't, with these you may not use characters other than 7bit US-ASCII.

The other servers may work because they are violating the specs and allow local encoding.

[pizzaman]

Goodsync claims to support utf-8 since version 7.7.0 http://www.goodsync.com/news.html

Superflexible claims to support utf-8 since version 3.66 http://www.superflexible.com/versions.htm

Do i understand you correctly that their implementation just isn't good enough? Can you see from the screens and logs i posted what they're doing wrong?

[boco]

GoodSync:

(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> MDTM 205 - Enya - Na Laetha Geal M'ige.mp3
(000079) 11-8-2009 13:51:29 - uuu (x.x.x.x)> 550 File not found

FAIL.

SuperFlexible version 3.66:

- UTF-8 encoding with SSH has been fixed

This is not for FTP.

Do i understand you correctly that their implementation just isn't good enough?

Obviously not. Maybe you need to enable it somewhere.

[pizzaman]

Again, thank you guys very much for helping me get to the bottom of this, i really appreciate it

Do i understand you correctly that their implementation just isn't good enough?

Obviously not. Maybe you need to enable it somewhere.

Of the three, only Allway sync doesn't allow you to enable or disable utf-8 filenames for ftp. The logs above are with the option turned on. (in goodsync off=ANSI, gave exactly the same problem).

So, there is no way do deduce from these logs why some programs get it wrong with non-latin characters.

I've asked Goodsync support about this, and i'll post here if that brings anything. Until then, one final note for those who stumble upon this forum: from the previous images it looks like goodsync doesn't get the "last modified times" from the ftp server, but as you can see in the logs: it does (all the MDTM commands). When i modified two files last night, goodsync noticed not only the modified date, but also the time...