Serendipity Forums

Hi Guys;

We are getting 404 error,

google is trying to crawl these pages where as these pages does not even exist;
http://www.imagesofasia.com/asia_-1.php
http://www.imagesofasia.com/asia_-1_-1.php
http://www.imagesofasia.com/asia_-1_-1_-1.php

we have checked paging section of each page. We are using .htaccess file for paging and all, we have blocked .htaccess file from robot & config file.

Anyone having any idea on this issue, what is happening ?

Reagrds
Jay

Hi!

This can happen if people on the web linked to your pages with those URLs. Those do not come from the s9y sitemap tool, you cannot do anything about people collecting "wrong" urls of your homepage on the web.

Since your pages return 404, they will not be a problem for Googlebot. Additionally you might want to add rewriterules or robots.txt rules so that Googlebot will not inspect asia*.php pages.

Regards,
Garvin

garvinhicking wrote:Hi!

This can happen if people on the web linked to your pages with those URLs. Those do not come from the s9y sitemap tool, you cannot do anything about people collecting "wrong" urls of your homepage on the web.

Since your pages return 404, they will not be a problem for Googlebot. Additionally you might want to add rewriterules or robots.txt rules so that Googlebot will not inspect asia*.php pages.

Regards,
Garvin

Hi Garvin;

Google is crawling from our own sitemap; these urls are generated by google web master tool, under http errors.
If you can solve the proble we will make you happy.
Regards
Jay

Hi!

I believe additionally to your sitemap google also crawls urls that it gets from other URLs. Your sitemap is NOT the sole source that Google crawlers use.

Inside http://www.imagesofasia.com/sitemap.xml I don't see those URLs. But, also this sitemap does not look as if it is created by Serendipity?

Regards,
Garvin