View Post [edit]
Poster: | brewster | Date: | Apr 12, 2004 4:06pm |
Forum: | etree | Subject: | Download Speeds: how you can help |
If we figure it out together we all win. Here are a few things going on:
Something happened today to cause our website usage to spike. We dont know what, but here is the evidence of a 2x spike:
http://homeserver.archive.org/http_rrd/www.html
Jon Aizen and the ops guys at the archive figured out how to speed up the website dramatically last friday. Yippie. This might be retaining some users that got sick of the past delays.
Also, we are constantly hitting our bandwidth cap from our ISP:
http://homeserver.archive.org/new/index.html
We are negotiating to buy more, but we dont want to buy too early because it costs us real money and we can use the money for other things (machines, staff, digitization, etc). Even if we wanted to, it will take us a couple of months to get more, but more is coming.
http://homeserver.archive.org/new/index.html
An Archive guru (jim shankland) wrote a bandwidth sharer on our linux router (very very cool) that seems to limit most people to the same max download rate, which seems to be more effective than the older cisco router cap used to work. this is goodness becase we can then use 90% of our bandwidth to keep everyone in music and movies.
What we could use:
* an inexpensive way to monitor our download rate to a bunch of typical user systems (dsl, cable, university). keynote for free, or something.
* sites that can offer 100Mb/sec of bandwidth or more to the commons (read: help host popular files). We have a cache system (freecache.org) that can automate the distribution of the load.
* dont download what you dont need. pls don't just hoard.
* download or stream low quality if you are just listening (and not really picky). lossless quality if you are trading.
* use the p2p systems as we set them up again (we tried 4 different ones and they were not very effective because we did not have concentrated enough hotspots)
* donate money to the Internet Archive. We really are run on donations. Please help.
* If you work for an ISP, offer us Internet transit for about $10-15 a month for a megabit/sec.
* If you work for a dsl or cable provider, offer us a free peering agreement.
* If you work for Internet2 or calren or cenic, please help us serve those users without large fees.
* in San Francisco, use sflan.org to download stuff because it does not go over our outside bandwidth.
* Anything we are missing?
Bottom line: We will get more bandwidth, but being efficient with non-profit resourses is always a good idea. Together we are making the commons work.
-brewster
Reply [edit]
Poster: | Randy D | Date: | Apr 14, 2004 4:17am |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Couple more thoughts/suggestions.
I think you are seeing a spike in intrest due to the advent of the Grateful Dead shows, I've scene chat on many boards about it.
May I suggest people download stuff at night, just before you go to bed. I was looking at some of the stats and there seems to be a low from 9:00PM to 6:00AM (not sure what time zone that chart was for). . .plus what do you really care if it takes a long time if you're sleeping anyways.
Another suggestions, is there a way to disable the higher stream if too much bandwidth is being used at one time?? Basically only allow the lower MP3 to be streemed (I guess I'm assuming that there's a lot of people streeming music durring the day, if this is not the case it probably wouldn't save anything.)
One last thing, is there an "instant" graph or way to see how many users vs how much bandwidth. . .if so putting a link on the main Audio page to it and a suggestion that people check before DL may help you save.
Just suggestion, love the Archive (not only the audio section).
Randy
Reply [edit]
Poster: | datgeek | Date: | Apr 14, 2004 3:33pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Reply [edit]
Poster: | Tradewalker | Date: | Apr 14, 2004 10:45pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
It needs only be a dollar a show. Let's face it I-tunes seems to be coping well at 99 cents per track (I know they are out to make money, but the revenue generated could be ploughed back into hardware or bandwidth costs).
I've only just joined this group after noting a post on a newsgroup about the fabulous download speeds compared to torrent sites such as www.sharingthegroove.org. However, I must say I'm seeing very little difference in speeds between the two, so allowing downloads via torrents as well as FTP, could be a decent solution.
Reply [edit]
Poster: | lazarus0314 | Date: | Apr 15, 2004 2:50am |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
And i'm by all means not a pro, but it may be possible to remain a non-commecial not-for-profit organization and still impiment a "membership fee" or something of the sort. It may not be as profitable as a per show fee but could stop the freeloaders and generate some sort of funds and hopefully increase bandwidth and equiptment.
James (truely grateful for archive.org)Boncek
Reply [edit]
Poster: | ssj4android | Date: | Apr 15, 2004 3:19am |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Reply [edit]
Poster: | brewster | Date: | Apr 15, 2004 1:34pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
if anyone has a serious pipe to share that would be great. for instance, universities on internet2 would be perfect.
-brewster
Reply [edit]
Poster: | abulluck | Date: | Apr 13, 2004 12:02pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Reply [edit]
Poster: | brewster | Date: | Apr 13, 2004 12:06pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
While we have growing pains, I am proud of the progress on bringing lots of interesting material to lots of people. The Grateful Dead was seminal in non-commercial starting the tape trading to a mainstream practice-- I am proud that we have the ability to store and provide access to their creative works.
I think we can figure out how to make this all work, and not even go broke. Thank you all for helping.
-brewster
Reply [edit]
Poster: | norvarchivist | Date: | Apr 13, 2004 12:22pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
(wise,glassburg, others) are myy heros...they were all pulling amazing tapes DECADES ago with a fraction of the technolgy available to modern tapers...
Thank you to anyone involved w/ this project
Reply [edit]
Poster: | abulluck | Date: | Apr 13, 2004 12:20pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Reply [edit]
Poster: | bisq | Date: | Apr 13, 2004 1:35pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
Reply [edit]
Poster: | HipGerm | Date: | Apr 13, 2004 2:32pm |
Forum: | etree | Subject: | Re: Download Speeds: how you can help |
This post was modified by HipGerm on 2004-04-13 21:32:58