FileZilla Pro + AWS S3 Multi-part uploads

Come here to discuss FileZilla and FTP in general

Moderator: Project members

Post Reply
Message
Author
BMoreE
500 Command not understood
Posts: 3
Joined: 2023-10-17 16:28
First name: Eric
Last name: Hastings

FileZilla Pro + AWS S3 Multi-part uploads

#1 Post by BMoreE » 2023-10-17 16:34

Considering purchasing Pro, but specifically to enable getting very large files from my Mac up to S3.

Therefore I need to know if multi-part upload is supported in FileZilla Pro - I couldn't find any answer to that question (not for lack of searching!)

This guy tried - but he ended up at the customer forum probably: viewtopic.php?f=2&t=53549&p=175835&hili ... rt#p175835

Anyone have any clue if I can get files > 5MB uploaded to S3 via FileZilla?

thanks!
E

User avatar
botg
Site Admin
Posts: 35566
Joined: 2004-02-23 20:49
First name: Tim
Last name: Kosse

Re: FileZilla Pro + AWS S3 Multi-part uploads

#2 Post by botg » 2023-10-17 18:15

Absolutely, FileZilla Pro can upload files of any largeness to Amazon S3, and automatically resume in case of interruptions.

Please note that if you are using a third-party hosting provider that merely emulates S3, make sure they emulate all of it, not just some select few parts.

BMoreE
500 Command not understood
Posts: 3
Joined: 2023-10-17 16:28
First name: Eric
Last name: Hastings

Re: FileZilla Pro + AWS S3 Multi-part uploads

#3 Post by BMoreE » 2023-10-18 13:42

Awesome, thanks for the quick reply. Yeah, I have my own AWS instance so I was going to create a bucket to back up some stuff in Glacier, but realized I'd have to go write code to get these big-ass video files up there. 25 bucks is well worth it to avoid that :)

Does anyone happen to know if it actually does use the multi-part upload feature of S3? That can help make transfers MUCH faster by parallelizing the transfer - otherwise I'm afraid it'll just take way too long.

I could check the open-source code myself, but I'm guessing since this is a "Pro" feature that that particular implementation would not be viewable in the repo?

User avatar
botg
Site Admin
Posts: 35566
Joined: 2004-02-23 20:49
First name: Tim
Last name: Kosse

Re: FileZilla Pro + AWS S3 Multi-part uploads

#4 Post by botg » 2023-10-18 14:35

Multi-part uploads are always used for files larger than 5MiB. The different parts of a single file are always uploaded sequentially. You can upload multiple different files in parallel though.

BMoreE
500 Command not understood
Posts: 3
Joined: 2023-10-17 16:28
First name: Eric
Last name: Hastings

Re: FileZilla Pro + AWS S3 Multi-part uploads

#5 Post by BMoreE » 2023-10-18 16:46

Great, thanks again!

Post Reply