Standard for robot exclusion




<World-Wide Web> A proposal to try to prevent the havoc wreaked by many of the early World-Wide Web robots when they retrieved documents too rapidly or retrieved documents that had side effects (such as voting).

The proposed standard for robot exclusion offers a solution to these problems.

(http://info.webcrawler.com/mak/projects/robots/norobots.html).



< Previous Terms Terms Containing standard for robot exclusion Next Terms >
stand-alone
standard
Standard Commands for Programmable Instruments
Standard d'Echange et de Transfert
standard deviation
spider
standard for robot exclusion
Standard for the exchange of product model data
Standard Generalised Markup Language
Standard Generalized Markup Language
standard input/output
Standard Instrument Control Library