Internet Archive Forums: Petabox

Re: I assume this forum is now obsolete

"There are still uses for vary large arrays of (mostly) idle disks (MAID), when you have very very large collections of data that needs to be available.": Coderjoe not exactly! this site http://www.g...

Posted by: jack liu

Re: I assume this forum is now obsolete

we are doing *both* now, actually! the majority of our data (the items we have /details/ pages for) are still on this petabox set of red boxes. we've morphed the motherboard over the years, and upp-e...

Posted by: tracey pooh

Re: Is the Archive site no longer acrhiving

Yes, we are archiving, but you may be referring that the wayback machine is not up-to-date. This is partially on purpose (for the data donated by Alexa Internet we may not show the most recent 6 mon...

Posted by: brewster

Re: Is the Archive site no longer acrhiving

echo (echo, echo, echo) (even the misspelling is echoed - cool)

Posted by: direwolf0701

Is the Archive site no longer acrhiving

Is the Archive site no longer acrhiving?

Posted by: maxadds

Re: I assume this forum is now obsolete

There are still uses for vary large arrays of (mostly) idle disks (MAID), when you have very very large collections of data that needs to be available. However, I suspect that the Internet Archive ha...

Posted by: Coderjoe

I assume this forum is now obsolete

This is now a very dead forum it seems. But storage seems to have taken off to insane heights following the development of perpendicular magnetic recording and the first drives in 2006. We've gone fr...

Posted by: Javik

Visiting the installation

I'm working with some clients who need a massive storage solution, one of my partners and I are meeting in San Francisco near the end of the year. Is there a possibility of coming by to visit the ins...

Posted by: glenn

Re: Intel Atom based motherboards?

Greg?

Posted by: NoiseCollector

Intel Atom based motherboards?

I wondered if you guys had looked at the Intel Atom based boards e.g. http://www.tranquilpc-shop.co.uk/acatalog/Motherboards.html For your storage nodes?

Posted by: TimSmall

VIA NAS 7800-15LST

looks like it would be a good choice for a lot of storage applications. iirc infrant had a similar board based around an embedded sparc core.

Posted by: dunno

Re: Possible solution: Disk Array Rackmounts

The cost was also one of our drawbacks and we went with 4 boxes, each doing a different action. Two would write and 2 would read. This way we did not have to use one box which was overloaded in the...

Posted by: HDRJapan

Re: Drive spin-down? Low-RPM drives? Power saving?

Is it not true that the more the drive is tagged that the longer the recovery becomes? We have a similar situation with a expired domain search engine at http://www.findeteer.com in which where the dr...

Posted by: HDRJapan

Re: software specs

Has the software been released yet. If so, can someone point me in the right direction? Thanks

Posted by: singod

Re: hey. I built something like that

How is 250GB of storage comparable to 1+ PB?

Posted by: JohnSebastianBach

Re: Understanding all that technical blather :-)

Maybe this article can help? http://en.wikipedia.org/wiki/Serial_Attached_SCSI I am in a hurry and thus not (yet) enough time to read completely....

Posted by: elhoim

Re: Make that --144-- 2.5" drives on one SAS channel

Heh, SuperMicro has some really powerful products but their product info pages do not do a good job of explaining the full capabilities of the hardware. If you take a look at the manual for the E1/...

Posted by: Javik

SuperMicro Cascaded 128/256/384-drive SAS/SATA chassis

(NOTE: The following is a brief excerpt from SuperMicro's SC933 product manual. The manual has lots more information and diagrams that you will find useful. This is listed in the addendum section, pag...

Posted by: Javik

Understanding all that technical blather :-)

Learning about SAS and expander technology is quite a challenge, so this is my simple breakdown of what I think the facts about this chassis, for the rest of us SAS/SATA dummies. :-) 1. The...

Posted by: Javik

24-drives on one SAS channel, from SuperMicro

There is, however, another way to get your hands on SAS expanders that are not so expensive. SuperMicro for example, is making a SATA hot-plug drive enclosure which incorporate SAS expanders right ...

Posted by: Javik

Oh look, the first ever 2.5 inch SAS hard drive

Hmm, okay, so this is sort of new. Bleeding-edge new. :) Fujitsu MAV2073RC 74GB 10,000 RPM 8MB Cache Serial Attached SCSI (SAS) Hard Drive, OEM, $639 http://www.newegg.com/Product/Product.asp?It...

Posted by: Javik

FYI, don't need more PCI slots, just SATA-II or SAS

For people building huge arrays of SATA drives, and then using a huge pile of SATA controllers running one drive cable back to a controller port... you don't really need to do that. You do not need a ...

Posted by: Javik

Huge storage = huge challenges?

I am doing a techtalk on managing beyond terrabytes and I was wonder what are the challenges that are faced with the petabox and what challenges were there creating it, is 1PB something we could be se...

Posted by: cchipmunks

Re: hi

Don't think...FEEL. It is like a finger pointing to the moon. Do not concentrate on the finger or you will miss all that heavenly glory...you understand?

Posted by: cosmicharlie

hi

hi i am new so what do i do do i get to do flips i can but can't sime to land it but u can cause u train really hard can i train with u please cause i won't to be like u

Posted by: karatekid

Re: software specs

Publication of the Petabox software The Archive uses is forthcoming, pending a more complete and formal packaging of the software. But in the meantime we can talk about it informally. The Petabox ha...

Posted by: billmoyer

Re: As many pci slots as possible?

Take a look at: http://www.sbs.com/products/family/33/ http://www.mobilityelectronics.com/expansion/products/pci_expansion/index.html http://www.asanst.com/pciexpansion/pci-expansion.htm Else, jus...

Posted by: elhoim

As many pci slots as possible?

So how do i do this? I need a solution where i can get as many pci slots available in my system as possible. Today i have a system with 12x pci slots and another with 18 pci slots (both servers ...

Posted by: AWP

Re: all archive storage is on petabox now!

coooooooool.... I love it when virtual entropy is eliminated through teh power of organization! Really, I do. Go archive.org, and go consolidation of information into free organized units in ...

Posted by: protobadger

Re: Hitachi 500GB drives

you also have to think of cost-performance ratio... you even could put 750 GB drives into the boxes. 500 GB drives today cost about 33 percent more per gigabyte than drives with a capacity of 250 GB...

Posted by: Nethacker

all archive storage is on petabox now!

Our deprecated older storage system has been replaced with Petaboxes fully. Go Petabox! -tracey, website and petabox engineer

Posted by: tracey pooh

powernode rack

we are building a powernode rack with dual athalon nodes. this takes more power than our powerstrips can handle so we are using 1u powerstrips. here is the layout. this is the motherboard: http...

Posted by: brewster

Re: powernode rack

we are using dual athalon mATX boards as our "power node" or one that is used for computation rather than storage+computation which we use farms of vias. -brewster

Posted by: brewster

Re: powernode rack

I guess the next question then is: What is a powernode?

Posted by: Coderjoe

Re: powernode rack

we use those for storage racks. -brewster

Posted by: brewster

Re: powernode rack

Dual Athlon nodes? What happened to using VIA Mini-ITX boards?

Posted by: Coderjoe

Re: current configuration?

It's still a living system. Try pinging cap again.

Posted by: jkrauska

Re: current configuration?

Does anyone know if the petabox is a dead product? I have had no reponse to my post, and no response to an email sent to capricorn-tech in December. Looking at the forum no one have responded to posts...

Posted by: fgleason

current configuration?

What are the motherboard, switch, and power strip you are currently using? Are you expecting to move to SATA, or gigE, anytime soon?

Posted by: fgleason

Re: my shot at massive network storage.

mmmmmmmmmmmmmmmmm

Posted by: angelbassmuffin

Re: 18 PCI slots, 72 SATA drives per computer?

The SBC or CPU card plugs directly into the PICMG slot which communicates with corresponding ISA and PCI slots on the backplane. For your SBC I would instead recommend an 800MHz FSB board. This boa...

Posted by: caiser

Still sept / oct for LMA > petabox move?

SSIA.. status of the LMA move to petabox? Time frame? what's been done and what is left to do?

Posted by: Tyler

software specs

I am interested in the software that is running this configuration. (OS / Management / Monitoring / Specific configuration instructions or examples) Is anyone planning to publish this information u...

Posted by: jer0mey

Open Source Specs

Here are the specs (attached Excel file) for people interested in building their own red boxes. Happy building!

Posted by: BeatriceM

Hitachi 500GB drives

I read somewhere that this setup uses 4 250GB drives per motherboard. I'm wondering, since Hitachi now has 500GB drives, it may be able to strink the size to 1/2...

Posted by: ngngokkiu

Re: Filesystem

At my company (not the archive) we're implementing a large storage system for image storage (almost entirely a write once, read many for some, and read almost never for the rest) and we are looking a...

Posted by: foundation

Re: about 400TB of this design shipped to the Archive

Quick plug; http://www.pegasosppc.com/pegasos.php Dual gigabit ethernet, fully supported under 2.6.12, could even cluster over Firewire (that's a fun trick :) We don't have SATA though on the...

Posted by: matt-genesi-usa

Re: Serial console cables?

how about using one of these ? http://opengear.com/product-cm4148.html

Posted by: sxpert

hey. I built something like that

I built a similar setup (currently resting on a shelf, while waiting for the money to get a nice 1U rack. 4x250G seagate in a raid 5 configuration...

Posted by: sxpert

1PB and Counting

Capricorn has now shipped 1PB to the Archive: http://www.capricorn-tech.com/press_rel/pr050622.html

Posted by: CR Saikley