FileZilla Log Analyzer Now Released!

Need help with FileZilla Server? Something does not work as expected? In this forum you may find an answer.

Moderator: Project members

Message
Author
Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#16 Post by Stunner » 2010-08-28 00:57

Ok guys, just released the new version(1.03 alpha) available here: http://sourceforge.net/projects/fla/. The new release consists of a handful of bug fixes so I recommend anyone using the older version of FLA to download it. I have thrown in some samples and screen shots to better illustrate what the script is capable of doing. If you have suggestions or come across any bugs please let me know via email(in the README) as I don't actively use the analyzer nearly as often as I would like. Thanks for using my script and for your support.

Version Changes:

Code: Select all

1.03 alpha:
BUG FIXES:
    -Fixed FLPModule's parsing issue when attempting to parse log files without AM or PM specified after time.
        -Ensured u, i, and f flags work with newly formatted log files.
    -Fixed issue that would prevent file from being written even though terminal output said otherwise.
    -Resolved issue which would write file in lieu of another without outputting correctly on command prompt.
    -'u' flag now replaces user names found in the action(message) portion of log line
Last edited by Stunner on 2010-09-22 02:21, edited 1 time in total.

User avatar
botg
Site Admin
Posts: 35491
Joined: 2004-02-23 20:49
First name: Tim
Last name: Kosse

Re: FileZilla Log Analyzer Now Released!

#17 Post by botg » 2010-08-28 08:51

Thanks.

I made this forum thread sticky.

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#18 Post by Legs » 2010-09-08 14:32

Ok tested it and allthough I do not get errors this time , I dont get any output .log files either.

Image

after the above the there is no log file. so the log file gets analysed correctly and read , but the output doesnt write to a log file.
I have admin rights on the cmd box so the program is allowed to write a log file. Any idea what I am missing?

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#19 Post by Stunner » 2010-09-08 21:43

You are using the flag('d') which merely displays login and logout user instances, without having the script do anything else. You have read the README, right? Because it is all explained there. If you want log files to be created, you would use this command: 'python FLA.py ftplog.log' without specifying any flags. There are several other things the script can do which you can learn about by consulting the README file. If anything is still unclear feel free to come back and ask away. :)

Edit: I am also quite curious as to why you are specifying the 'd' flag when running the program, as I just noticed you were also using it when you reported your previous issue. So my question to you is, what do you expect by specifying the 'd' flag when you run the program? As there may be something convoluted/confusing in the README that I may need to address.

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#20 Post by Legs » 2010-09-13 12:27

well to be honest i did read the previous readme and in the example there it showed the flag, so i just copied it ;)

but it works :) ill go play around with different settings now :) looks good sofar!

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#21 Post by Stunner » 2010-09-13 13:16

Legs wrote:well to be honest i did read the previous readme and in the example there it showed the flag, so i just copied it ;)

but it works :) ill go play around with different settings now :) looks good sofar!
Glad to hear it. :) Feel free to give me feedback and/or feature requests. I am working on implementing new features these days and hope to release a new version in the upcoming weeks.

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#22 Post by Legs » 2010-09-13 13:50

found a file missing by the way.
in the readme it says: '... If your server files are in separate log files themselves you may find the "fileMerge.py" script that I have included to be useful. ...."

but the filemerge.py is not included in the downloaded compressed file.

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#23 Post by Stunner » 2010-09-14 00:49

Legs wrote:found a file missing by the way.
in the readme it says: '... If your server files are in separate log files themselves you may find the "fileMerge.py" script that I have included to be useful. ...."

but the filemerge.py is not included in the downloaded compressed file.
Oh wow, I can't believe I missed that! Thanks for pointing that out. I posted version 1.03a alpha which includes a 'Tools' directory with that script in it, available at https://sourceforge.net/projects/fla/. Sorry for any inconvenience.

Version Changes:

Code: Select all

1.03a alpha:
    -Tools directory with fileMerge.py script included(accidentally omitted in 1.03 alpha release).
Last edited by Stunner on 2010-09-22 02:23, edited 1 time in total.

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#24 Post by Legs » 2010-09-15 08:58

Thanks its there now :)

Although I cant figure out how the syntax would be... (yeah shame on me).
Is there a special wildcard command in python?

i got 390 logfiles that i want to merge, but it does not accept fsz*.log or *.* for sourcelogs:

Image

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#25 Post by Stunner » 2010-09-16 00:12

Ah, right pesky Windows... :roll: I was having trouble with this myself, see this post: http://forum.notebookreview.com/windows ... -woes.html. I don't think I even ended up using the filemerge script on Windows in the end as "type *.log > [merged file name]" ended up working for me. Hopefully that solves your dilemma. :wink:

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#26 Post by Legs » 2010-09-17 09:44

hmm...

while the dos command does merge all the logs into one, it also does something with the log layout wich results in the FLA.py not accepting the log file as an original Filezilla log file, and this aborting:

Image

and thus not giving me any output :roll:

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#27 Post by Stunner » 2010-09-17 10:03

Could you paste the command you entered to produce the merged log file? And also could you send me a copy of the merged log file(you can send it via email if you would like to submit it to me privately)?

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#28 Post by Legs » 2010-09-17 18:52

did:
type *.log > all-log.txt
rename all-log.txt all-log.log

the log is over 1 year of information and not masked so rather not send it as is.. but its a 10 mb file , and the merge is flawless by date as far is i can see. no weird breaks or chars on the daybreaks. there a debug option?

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FileZilla Log Analyzer Now Released!

#29 Post by Stunner » 2010-09-17 20:23

I am your debugging option. :lol: I think there might be something wrong with the script's parser. Pretty much the only way for me to address the issue is to see the log file so I can run tests of my own. You can try running the script with the f,u, and i flags to make a new log file with your file names, user names and ip addresses scrambled and see how far it goes before throwing that error. How long does it analyze before it gives you that error message? If we can determine where in the file that problem is caused we can pinpoint that error and you can send me a few lines above and a few lines below of your log file. :wink:

EDIT: This may be easier... open up FLA.py in a text editor and go to line 1690, which should be this line:

Code: Select all

print "The file's formatting is funky... Must use an original FileZilla Server log file! Terminating..."
Add ", G.line" to the end of that line so that the resulting line is:

Code: Select all

print "The file's formatting is funky... Must use an original FileZilla Server log file! Terminating...", G.line
Save it, and run the script exactly as you did before, but this time when it errors, it should spit out the line number it was at in your log file. Once you have the line number, cut a few lines above and a few lines below that line number in the log file and submit it to me. :) Thanks.

Legs
504 Command not implemented
Posts: 11
Joined: 2010-08-23 13:20
First name: Le
Last name: gs

Re: FileZilla Log Analyzer Now Released!

#30 Post by Legs » 2010-09-23 12:09

ok adit the line print option and got

Image

so on line 91837:

Image

so just cut out the lines above, resubmitted the job and it finished as intended :)

would it be possible to not take all files into the listedsummary.log ?

for instance:
/DVD/441 - vacation to france (1999)/VIDEO_TS:
VTS_02_1.VOB ('30-1-2010', '11:33:45', 51044)
VTS_02_0.BUP ('30-1-2010', '11:33:45', 51054)
VTS_01_4.VOB ('30-1-2010', '11:33:46', 51061)
VTS_01_2.VOB ('30-1-2010', '12:23:51', 51112)
VTS_01_0.VOB ('30-1-2010', '13:03:24', 51122)
VTS_01_0.IFO ('30-1-2010', '13:03:35', 51127)
VTS_01_0.BUP ('30-1-2010', '13:03:35', 51132)
VIDEO_TS.VOB ('30-1-2010', '13:03:35', 51137)
VIDEO_TS.IFO ('30-1-2010', '13:03:37', 51142)
VIDEO_TS.BUP ('30-1-2010', '13:03:37', 51147)
VTS_02_0.IFO ('30-1-2010', '11:33:45', 51045)
VTS_01_5.VOB ('30-1-2010', '11:33:45', 51055)
VTS_01_3.VOB ('30-1-2010', '11:53:54', 51068)
VTS_01_1.VOB ('30-1-2010', '12:37:00', 51117)
/DVD/746 - Steven visit(2009)/VIDEO_TS:
VTS_11_1.VOB ('5-5-2010', '15:04:11', 78719)
VTS_11_0.BUP ('5-5-2010', '15:04:12', 78730)
VTS_10_0.VOB ('5-5-2010', '15:04:12', 78740)
VTS_10_0.BUP ('5-5-2010', '15:04:12', 78751)
VTS_09_0.VOB ('5-5-2010', '15:04:12', 78760)
VTS_09_0.BUP ('5-5-2010', '15:04:13', 78770)
VTS_08_0.VOB ('5-5-2010', '15:04:13', 78781)
VTS_08_0.BUP ('5-5-2010', '15:04:13', 78791)
VTS_07_0.VOB ('5-5-2010', '15:04:13', 78801)
VTS_07_0.BUP ('5-5-2010', '15:04:13', 78811)
VTS_06_0.VOB ('5-5-2010', '15:04:14', 78820)
VTS_06_0.IFO ('5-5-2010', '15:04:14', 78826)
VTS_05_1.VOB ('5-5-2010', '15:04:14', 78836)
VTS_05_0.IFO ('5-5-2010', '15:04:14', 78846)

i not really interested in the VTS files, just the directory he downloaded. There a flag to set it like that? :)
download / upload file sizes are not logged i reccon?(cuz i cant find any)

Post Reply