Tuesday, December 13, 2005

What "Manifesting" means

In the Alexa Web Search Platform documentation, you will run across the word manifesting. That's right, it's a gerund!


Here's an example of how the AWSP docs use it:

For instanace, the Platform's Default framework is responsible for manifesting a collection and distributing a user's application across multiple compute nodes to efficiently process the collection.

The AWSP docs use manifesting as a fancy computer science way of saying: collecting, grouping and assigning to a particular bucket. More simply, they mean requesting that a specific bunch of documents be grouped and named into a collection.

Alexa Web Search Platform Beta

http://websearch.alexa.com/welcome.html


Alexa / Amazon just announced a beta for their open crawl super-computer system.


If you are handy at Unix, can write Perl and C, you know can schedule time on their compute clusters to access Alexa's 100 Terabyte internet archive.


This is gonna be great.


I plan to blog my progress as soon as I can get an account.