(logo)
(navigation image)
Home Wayback Machine | Blog | Researcher Access | FreeCache | Community Wireless | Petabox | Heritrix | Open Source Media | BookMobile

Search: Advanced Search

UploadAnonymous User (login or join us) 
 Reference Links
Researcher access is currently not available pending redesign. This material has been retained for reference and was current information as of late 2002.

Data Available
Tools Available
Example Projects
Tool Documentation
Example Code
av_divvy
USAGE : av_divvy [-p prefix] [-s suffix] [-n count] [-k size (K Bytes)] [-m max_open] [files...]
Deals the lines of input into a number of output files with the specified prefix and suffix, which is to say of the form "prefix N suffix" or "prefix N_M suffix" so with -p /0/A. and -s .crawl one would get files like /0/A.72.crawl or perhaps /0/A.163_94.crawl

-n specifies the total number of files. -k specifies the maximum size of each output file

At least one of (-n -k) must be specified. -k may only be used with all normal files (e.g. no stdin)

-m specifies the maximum open files at a time (default 200). Multiple passes will be used if necessary.

If the number of output files desired is more than the maximum number of open files, the actual number of files created will be rounded up to the nearest multiple of the maximum number of open files.

Multiple files are treated as though cat'ed together


Terms of Use (10 Mar 2001)