Skip to main content

View Post [edit]

Poster: tracey pooh Date: Oct 6, 2009 10:02am
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

there can be massive contention for the disks with heavy fragmented reading especially at times. so the speed can be be very bad at times.

we have mostly given up on FTP technology here at archive for exactly the reasons you point out -- why is it going so slow when i can add a second uploader and get 2x the throughput? (that *is* interesting 8-) why are the disks not maxxed out fully by the ftp application? why does resumption not work? all these questions and more were unanswerable by myself and our staff so we have made our single remaining FTP "WIGIWYG", unfortunately ("what you get is what you get").

nonideal to be sure -- but our pure-ftpd server program has had so many problems that we've stopped trying to fix and/or patch around it.

another option is S3 (HTTP PUT) that we support...
-tracey

Reply [edit]

Poster: Shiva Ho Date: Oct 13, 2009 10:14am
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

The "NEW" system has even more flaws & times out repeatedly making it unusable...
Lets FACE it FLASH SUCKS ALWAYS HAS & ALWAYS WILL...
If you can't do it with straight html & java then stop wasting our time & Bandwidth

Reply [edit]

Poster: Shiva Ho Date: Oct 13, 2009 10:16am
Forum: forums Subject: FLASH SUCKS

Your rational is flawed!!! FTP WORKS & Flash doesn't!!!!

Reply [edit]

Poster: tracey pooh Date: Oct 13, 2009 11:36am
Forum: forums Subject: Re: FLASH SUCKS

then don't use flash! 8-)

there is a "prefer to not use flash?" link
on the uploader (new item) page and
one on the edit item files (for an existing item) page.

--tracey

Reply [edit]

Poster: aronsson Date: Oct 6, 2009 10:18am
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

My friends mentioned the TCP window scaling option. With my ping roundtrip time of 194 ms (from 130.236.254.105 in Sweden) TCP without window scaling might max out at 320 kbyte/s.

It is on at my end. I'm running a standard Ubuntu Linux 9.04 and "cat /proc/sys/net/ipv4/tcp_window_scaling" answers "1" (meaning true/on).

Reply [edit]

Poster: kzns.pl Date: Oct 26, 2009 8:56am
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

Hi.
Is there a way to automatic upload of a file to add to an item I've already created? (ie use external program to upload)

We have a community radio (internet based) and are give a .wav file recorded by journalists, and local artists.

We have an in-house specialist computer program which with one-click takes the file, converts it to .mp3, adds ID3 tags, adds it to our database, converts it to text, and creates a webpage for it and (up to now) uploads the mp3 to a server (so the non-technical staff do not have to waste their time doing what a computer can do). Also it means technical staff can concentrate on more taxing issues than upload a file.

We would like to use the Internet Archive for this as it is the best or proper place for it for archiving purposes, but... what technical methods exist, however complex, for automating the process of getting that mp3 file from an inhouse computer to a published and accessible version on Internet Archive?

There were some methods floating around (using php) to upload uears ago when the FTP was all working well.


kzns.pl

Reply [edit]

Poster: tracey pooh Date: Nov 2, 2009 6:30pm
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

yes there is -- i can try to put you in touch w/ an engineer here who can point you to S3. you'd want something like curl (ideally) or wget on a unix-like cmd-line if that's possible. then it's relatively straightforward from there.

we can proceed if that sounds good/plausible and you reply!
-tracey

Reply [edit]

Poster: tracey pooh Date: Nov 2, 2009 6:33pm
Forum: forums Subject: Re: Stale .pureftpd-upload* file blocks checkin

yes there is -- i can try to put you in touch w/ an engineer here who can point you to S3. you'd want something like curl (ideally) or wget on a unix-like cmd-line if that's possible. then it's relatively straightforward from there.

we can proceed if that sounds good/plausible and you reply!
-tracey