link directory
Link Directory
main menu
Free Templates
Free Template Stats
Total Templates: 336
Total Categories: 15
Total Downloads: 9404
Internet Jobs #2
SeaShore 1.0 WordPress
Cook Off WordPress
Iris Joomla
golmaal WorsPress
Internet Market
Subtle Impression WordPress
Bluesky Joomla
Ally-Bid PHPLinkBid Template
Prime Cube Joomla
free resources
 Total Links: 1039
 Total Categories: 40
Site Reviews

"I think Invision-Graphics.com is a great site, they have helped me alot when it comes to customizing my theme for wordpress and I can always find lots of mods and themes in..."


Robots.txt Generator Tool
Robots.txt files are used by web owners and webmasters to signify to spider-bots and search engines not to crawl or index certain files and directories. The Robots.txt file is a command file that most creditable search-bots will obey and check for on entry to your website URL. To create a robots.txt file, use the following form and select the fields to either disallow certain bots, disallow directories or deny access from bad-bots. If you have any questions please use our support forums.
Support future development
Make a donation! If you enjoy our services and online resources consider making a donation to support our efforts.
Menu
| Creating A Robots.txt File | List of Bad-Bots |
Default Robots.txt file setting
Default - All Robots are: Crawl-Delay:
Specific Search Robots
Search Engine Choose Setting Bot-Name
Google googlebot
MSN Search msnbot
Yahoo yahoo-slurp
Alexa/Wayback ia_archiver
Ask/Teoma teoma
DMOZ robozilla
GigaBlast gigabot
Scrub The Web scrubby
Specific Special Bots:
Search Engine Choose Setting Bot-Name
Google Image googlebot-image
Yahoo MM yahoo-mmcrawler
MSN Pic-Search psbot
Yahoo Blogs yahoo-blogs/v3.9
Extra Exclusion features:
Search Engine Choose Setting Bot-Name
Google googlebot
MSN msnbot
Yahoo yahoo-slurp
Disallow Bad Bots:
Select this option to block the most common "Bad-Bots," also known for spam and email harvesting from accessing your domain.
Disallow Bad-Bots: 
Restricted Directories:
The path is relative to root and must contain a trailing "/"
Exclude Directory: "/"
Exclude Directory: "/"
Exclude Directory: "/"
Exclude Directory: "/"
Exclude Directory: "/"
Create The Robots.txt

Click here to download the robots.txt file!

Now, copy and paste this text above into a blank text file called "robots.txt" and put it in the root directory of your website. Make sure it's permissions are set so that visitors and search engines can read it.

Example: http://www.yoursite.com/robots.txt

The Robots Txt Generator is Copyright © 2009 Invision-Graphics Inc.
Valid HTML 4.01 Transitional


Click Here to Advertise
Affordable Hosting! http://www.invision-graphics.com/images/banners/468X60_VISIONHOSTING.gif
 Today: 28,319  Yesterday: 34,916  Total Hits: 41,492,693
Page Rendered in: 0.71s - Total Queries: 4 - MySQL DB: 20 mb's - Pages served in past 5 minutes: 285