The Web Robots Pages

4 February 2011 at 11:22 pm Leave a comment

Web Robots (also known as Web Wanderers, Crawlers, or Spiders), are programs that traverse the Web automatically. Search engines such as Google use them to index the web content, spammers use them to scan for email addresses, and they have many other uses.

If you want to create some robot.txt just go here
http://www.mcanerin.com/en/search-engine/robots-txt.asp

Hope this will usefull for you..

Advertisements

Entry filed under: Blog and Website. Tags: , .

Example script of virus Putting HTML code for your website

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Trackback this post  |  Subscribe to the comments via RSS Feed


Blog Stats

  • 56,450 hits
free counters


AziesT on Facebook


Yahoo bot last visit Msn bot last visit SEO Stats

Our Teams

Gudang Artikel AZIZALFIAN.COM

%d bloggers like this: