PHP Classes

File: www/robots.txt

Recommend this page to a friend!
  Classes of Fernando Val   Springy   www/robots.txt   Download  
File: www/robots.txt
Role: Documentation
Content type: text/plain
Description: Documentation
Class: Springy
Microframework for Web application development
Author: By
Last change:
Date: 7 years ago
Size: 147 bytes
 

Contents

Class file image Download 
User-agent: *

#Request-rate: 10/5         # maximum rate is 10 pages every 5 seconds
#Crawl-delay: 0.1           # 100ms entre uma pagina e outra