299 guests

Ghoulish Delight · 03-08-2005, 07:33 PM

Spiders and bots are programs used by search engine websites that go out and "crawl" the web, cataloging the sites they find. They load a web page, figure out what key words are on the web page, as well as where that page links to and many other bits of information that they use. All of that is cataloged and indexed in the search site's database so that it will come up in a search.

For instance, thanks to msn's spiders, if you put cameltoe and the phrase "moser jam" (yes, that's moser, not monster) in msn's search, you'll find thread on this site.

03-08-2005, 07:33 PM	#10
Ghoulish Delight I Floop the Pig Join Date: Jan 2005 Location: Alternative Swankstyle Posts: 19,348	Spiders and bots are programs used by search engine websites that go out and "crawl" the web, cataloging the sites they find. They load a web page, figure out what key words are on the web page, as well as where that page links to and many other bits of information that they use. All of that is cataloged and indexed in the search site's database so that it will come up in a search. For instance, thanks to msn's spiders, if you put cameltoe and the phrase "moser jam" (yes, that's moser, not monster) in msn's search, you'll find thread on this site. __________________ 'He who receives an idea from me, receives instruction himself without lessening mine; as he who lights his taper at mine, receives light without darkening me.' -TJ
	Submit to Quotes