ROBOTS.txt

Get help with installation and running phpwcms here. Please do not post bug reports or feature requests here.
Post Reply
User avatar
jsw_nz
Posts: 907
Joined: Fri 2. Apr 2004, 02:42
Location: New Zealand

ROBOTS.txt

Post by jsw_nz »

Hi All at Phpwcms

I am using the standard install of the phpwcms robots.txt
- seems Google is not indexing the website - not sure why

Step 1
Google Search: Calder Stewart Roofing - (looking for (http://www.roofer.co.nz)
Google Listing:
Calder Stewart Roofing
http://www.roofer.co.nz/‎
A description for this result is not available because of this site's robots.txt – learn more.


here is the content of robots test file:

Code: Select all

# www.robotstxt.org/
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

User-Agent: *
Disallow: /
Disallow: /download.php*
Disallow: /login.php
Disallow: /phpwcms.php
Disallow: /content/
Disallow: /template/
Disallow: /filearchive/
Disallow: /img/
How can I remedy this - thanks in advance
Additional measures - tips also appreciated
jsw_nz (john)
User avatar
top
Posts: 535
Joined: Fri 11. Aug 2006, 15:03
Location: Eutin

Re: ROBOTS.txt

Post by top »

This is not the standard robots.txt (Look here: https://github.com/slackero/phpwcms/blo ... robots.txt )

This is too much:

Code: Select all


Disallow: /

It says: Disallow everything! Image
Post Reply