Thousands of Files in one Directory

Come here to discuss FileZilla and FTP in general

Moderator: Project members

Post Reply
Message
Author
Possum
504 Command not implemented
Posts: 6
Joined: 2008-04-26 09:36
First name: Peter
Last name: Skinner

Thousands of Files in one Directory

#1 Post by Possum » 2010-10-02 21:21

Hi

Due to the nature of the content Content management system I am designing I need to have 1000s of files in one directroy.

Can filezilla handle this?

Thank you

User avatar
botg
Site Admin
Posts: 35565
Joined: 2004-02-23 20:49
First name: Tim
Last name: Kosse

Re: Thousands of Files in one Directory

#2 Post by botg » 2010-10-02 22:56

Yes. It can even handle a million files and more in the same directory.

artneko
500 Command not understood
Posts: 1
Joined: 2010-10-16 16:51
First name: Candice
Last name: Jordan

Re: Thousands of Files in one Directory

#3 Post by artneko » 2010-10-16 16:57

I have recently merged two companies which has resulted in over 2000 files in my product images. Since doing that on the server side I am only able to view a partial listing of the files and any operations such as sorting by filename, etc., only operates on that set which is at the front of the alphabetical listing. Is there some setting somewhere that I can change to allow my server side panel to show all files? I am a novice and not very good with technical language so please dumb down any replies to a very low level. Thank you.

User avatar
botg
Site Admin
Posts: 35565
Joined: 2004-02-23 20:49
First name: Tim
Last name: Kosse

Re: Thousands of Files in one Directory

#4 Post by botg » 2010-10-16 20:12

@artneko: Broken server. It is artificially limiting the size of directory listings even though there is absolutely no technical nor social reason to do so. Contact the server administrator so that he can fix this problem.

madriss
500 Syntax error
Posts: 12
Joined: 2007-12-11 14:38

Re: Thousands of Files in one Directory

#5 Post by madriss » 2010-10-17 22:14

The following info is only relevant for Linux servers, I hope it helps:

Do you have full root access to the server you're using? If you're using shared hosting then you would have to ask your host if they can increase the limit, but on a dedicated or VPS server you'll be able to increase the limit in the FTP conf file.

For pure-ftpd the setting is called LimitRecursion.
If you used "LimitRecursion 8000 8" that would mean you can go 8 directories deep and show up to 8000 files in one directory. Whatever the first number is it cuts off after showing that number of files.

It's usually set at a rather low number by default, which is pretty ridiculous and as botg said there's no reason for it, but it's extremely common, I have to change this value whenever I get a new server.

The setting is probably the same for pro-ftpd I'm not sure.

The settings file for pure-ftpd is often at /etc/pure-ftpd.conf but this will depend on your configuration and operating system.

User avatar
boco
Contributor
Posts: 26938
Joined: 2006-05-01 03:28
Location: Germany

Re: Thousands of Files in one Directory

#6 Post by boco » 2010-10-18 05:00

For ProFTPd it's ListOptions with maxfiles/maxdirs.
No support requests over PM! You will NOT get any reply!!!
FTP connection problems? Please read Network Configuration.
FileZilla connection test: https://filezilla-project.org/conntest.php
FileZilla Pro support: https://customerforum.fileZilla-project.org

Post Reply