FTPstats GUI-based FileZilla log parser / stats generator

Need help with FileZilla Server? Something does not work as expected? In this forum you may find an answer.

Moderator: Project members

Message
Author
pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

FTPstats GUI-based FileZilla log parser / stats generator

#1 Post by pelotron » 2011-05-24 00:46

https://sourceforge.net/projects/ftpstats/

(8/2/2012) Latest version - 0.7.5

Code: Select all

CHANGELOG 
----------------

v0.7.5
------

: Date list is sorted by Y/M/D

: file dialog windows are initialized to the last location log files were chosen from

: window is resizable and remembers size and placement between sessions

----------------
Image

Image
Last edited by pelotron on 2012-08-03 03:41, edited 3 times in total.

User avatar
boco
Contributor
Posts: 24156
Joined: 2006-05-01 03:28
Location: Germany

Re: FTPstats GUI-based FileZilla log parser / stats generato

#2 Post by boco » 2011-05-24 07:58

Mhm, looks promising. I don't want to be the party-pooper, but:

1. If you include the GPL into the package, do so in a format everyone can easily open. A simple .txt is the best, however, .odt is NOT a good choice.
2. Sources? If you release a package under GPL, you must provide the full sourcecode (or at least a way to get it). Right now I see only an .exe file. Without (access to) the sources you violate the GPL. Maybe I just overlooked it?
### BEGIN SIGNATURE BLOCK ###
No support requests per PM! You will NOT get any reply!!!
FTP connection problems? Do yourself a favor and read Network Configuration.
All FileZilla products fully support IPv6. http://worldipv6launch.org
### END SIGNATURE BLOCK ###

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#3 Post by pelotron » 2011-05-24 14:07

Thanks for the tips. I added the source to the Files section and changed the GPL to a .txt document.

User avatar
boco
Contributor
Posts: 24156
Joined: 2006-05-01 03:28
Location: Germany

Re: FTPstats GUI-based FileZilla log parser / stats generato

#4 Post by boco » 2011-05-24 17:03

That's much better now. Good luck with your project! I made the topic a sticky.

@Other users: Got ''industrial-sized'' logs? Bring 'em on! Please test.
### BEGIN SIGNATURE BLOCK ###
No support requests per PM! You will NOT get any reply!!!
FTP connection problems? Do yourself a favor and read Network Configuration.
All FileZilla products fully support IPv6. http://worldipv6launch.org
### END SIGNATURE BLOCK ###

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#5 Post by pelotron » 2011-06-04 21:54

.
Last edited by pelotron on 2012-08-03 03:24, edited 3 times in total.

gorski
500 Command not understood
Posts: 3
Joined: 2011-07-23 20:38
First name: Krasimir
Last name: Hristov

Re: FTPstats GUI-based FileZilla log parser / stats generato

#6 Post by gorski » 2011-07-23 20:46

Hi,
I got error when I load my log dir

Image

fast stats 1187 log files in dir
size 607 MB (637 366 746 bytes)

I not dig to see where is my date time is bad, I have locale set to bulgaria and windows add to date one weird symbol "г." for example :)
program seem to be very useful :)

Greets,
Gorski
p.s. archived size of logs is 35MB where to send privately for debug ?:)

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#7 Post by pelotron » 2011-07-30 23:48

Gorski -

This might be caused by the program not correctly detecting your server's date/time settings. Download version 0.7.3 which includes the option to set the date/time culture manually. Let me know if it works for you!

If you're still having problems, my e-mail address is at the bottom of the readme.txt file.

- Zach

Stunner
226 Transfer OK
Posts: 63
Joined: 2009-03-31 01:19
First name: A
Last name: Dog

Re: FTPstats GUI-based FileZilla log parser / stats generato

#8 Post by Stunner » 2011-08-05 12:37

Hey Pelotron, nice to see someone else take a shot at making a log analyzer for this server (see my thread-also stickied-regarding FileZilla Log Analyzer). I think it would be wise for you to look into my project's source code (in Python - REALLY easy to pick up) and see what I parse for and how I handle it, as my project has been up for a good while now, long enough to hammer out most parsing bugs. I think it will save you time in trying to figure it all out for yourself.

Furthermore, if you with to use my work/add onto it I would be more than happy to make arrangements for that. Currently my program does a lot of utility work from analyzing the logs, to filtering/sorting by name, IP address, etc. However it does lack in the GUI area. Anyways, check it out and let me know what you think.

Another thing... people are hesitant to provide logs because of the sensitive information contained within them. So to address this issue my log analyzer has a "masking" feature which allows someone to create a copy of a log file but with the sensitive information replaced with bogus information, or just "X"ed out. So for those of you thinking of handing in industry-grade logs, check this feature out.

Good luck!
Stunner

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#9 Post by pelotron » 2011-08-12 20:31

Thanks Stunner. I'll get in touch with you soon to see if we can combine our powers.

gorski
500 Command not understood
Posts: 3
Joined: 2011-07-23 20:38
First name: Krasimir
Last name: Hristov

Re: FTPstats GUI-based FileZilla log parser / stats generato

#10 Post by gorski » 2011-09-03 21:20

Hi Pelotron,
now all looks fine i not get errors after i set my strange region date time :)
Image

this amount of memory use little surprise me ?:) my pc monster got little lagged when i navigate in program :)

Greets,
Gorski

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#11 Post by pelotron » 2011-09-06 18:04

That is quite a lot... how large is the batch of files you loaded? Another user told me 150mB of log files translated to about 750mB of memory usage.

For the next version I'm working on using a database to store the parsed data so it won't gobble up memory like that. Glad it's at least working for you though. :)

gorski
500 Command not understood
Posts: 3
Joined: 2011-07-23 20:38
First name: Krasimir
Last name: Hristov

Re: FTPstats GUI-based FileZilla log parser / stats generato

#12 Post by gorski » 2011-09-17 21:33

Hi Pelotron,
Image

807MB logs :)
have and strange reports for date time but not have errors. my logs have mixed date time format. because some time i first run FileZilla and after this i change region settings.

Greets,
Gorski

p.s. sorry bad english :)

pelotron
504 Command not implemented
Posts: 11
Joined: 2011-05-18 21:21
First name: Zach
Last name: Rice

Re: FTPstats GUI-based FileZilla log parser / stats generato

#13 Post by pelotron » 2011-09-24 04:18

Thanks for the info Gorski. Like I said the next version is going to be a little different. It will use a database to use way less memory, and I think I can rig up a system to check for inconsistent DateTime region formatting and either try to guess it correctly or let you set it manually per logfile.

Meagan
500 Command not understood
Posts: 3
Joined: 2011-11-23 15:48
First name: Meagan
Last name: Jones

Re: FTPstats GUI-based FileZilla log parser / stats generato

#14 Post by Meagan » 2011-11-23 17:17

Thanks a lot! I should find this to be very useful. I have been looking for something similar to this for the site that I'm building. This stats generator should fit the bill nicely for this project, and it will save me a lot of time and work. Now that I have this, I am ready to move forward and hopefully wrap up this project and launch it very soon!
Last edited by Meagan on 2011-11-29 19:57, edited 1 time in total.

chrisfairbrother
500 Command not understood
Posts: 2
Joined: 2011-11-29 12:04
First name: Chris
Last name: Fairbrother

Re: FTPstats GUI-based FileZilla log parser / stats generato

#15 Post by chrisfairbrother » 2011-11-29 12:16

Hi Pelotron, a few suggestions for your execellent program:-

1) A config file to hold the path to the log file directory.
We have several logfiles on a server that has a long path.

2) Date combo box is sorted by D/M/Y, can it be sorted by Y/M/D (date order)

3) While reading a 40M log file, there is no indication of activity.
How about a busy cursor while the log file is read in.

Post Reply