FTP search mirror setup

The cost estimates here are based upon configuring a server that indexes all ftp servers that are indexed by ftpsearch.ntnu.no. For a smaller number of ftp servers, less resources are needed, and the server does not need to run on a dedicated machine.

An estimate of the cost of a dedicated machine configured the same way as the current incarnation of ftpsearch.ntnu.no. With over 550000 requests/day, the machine will be somewhat overloaded:

2 MS160SE cards.
320 MB memory:
3 x 4 GB disks for data:
Pentium 100 machine with
$7000 (currency is USD)

An estimate of the cost of a dedicated machine that might be able to handle about twice the above mentioned traffic load, without using special purpose hardware:

512 MB system memory
7 x 4 GB disks for data:
Machine (e.g. PC with 200 MHz Pentium Pro Processor running FreeBSD 2.2).
$17000 (currency is USD)

Without the MS160SE card, you need suffix tables. This substantially increases the memory or disk requirements of the data set generation.

With suffix tables you need 160 MB extra memory and 3 extra 4 GB disks. The data set generation time will also be increased, e.g., from 3 to 6 hours on an otherwise idle machine.

Using suffix tables instead of the MS160SE cards thus has the following disadvantages:

and the advantages:

[ FTP search | Search page | Mirrors | Technical info | Software ]

Last modified: Mon Feb 10 04:58:00 MET 1997