Page 1 of 1

ROBOTS.txt

Posted: Wed 20. Nov 2013, 22:43
by jsw_nz
Hi All at Phpwcms

I am using the standard install of the phpwcms robots.txt
- seems Google is not indexing the website - not sure why

Step 1
Google Search: Calder Stewart Roofing - (looking for (http://www.roofer.co.nz)
Google Listing:
Calder Stewart Roofing
http://www.roofer.co.nz/‎
A description for this result is not available because of this site's robots.txt – learn more.


here is the content of robots test file:

Code: Select all

# www.robotstxt.org/
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

User-Agent: *
Disallow: /
Disallow: /download.php*
Disallow: /login.php
Disallow: /phpwcms.php
Disallow: /content/
Disallow: /template/
Disallow: /filearchive/
Disallow: /img/
How can I remedy this - thanks in advance
Additional measures - tips also appreciated
jsw_nz (john)

Re: ROBOTS.txt

Posted: Thu 21. Nov 2013, 08:46
by top
This is not the standard robots.txt (Look here: https://github.com/slackero/phpwcms/blo ... robots.txt )

This is too much:

Code: Select all


Disallow: /

It says: Disallow everything! Image