. . .
? .
.
:
1. spider (). , , . .
2. crawler ( ). , , , .
3.. . , . , , . .
4. . , , .
5. . , , .
?
. , , . . , .
, , . , . , . . -, , .
:
-, ( , ).
-, . , , . .
, .
, , , .
|
|
, - , , , . Web , , ( ). - , . Google ( www.google.ru), , . Open Directory Project (www.dmoz.org) : 2 . .
1994 ., , : Yahoo (www.yahoo.com). Web, Open Directory Project.
, Open Directory Project. Open Directory Project, Netscape, - , 24 2 . b 200 . . Open Directory Project , : AltaVista (www.altavista.com), HotBot (www.hotbot.com), Lycos (www.lycos.co.uk) .
, , Open Directory Project , . . Open Directory Project , Google: .
, : , .