[ic] missing.html and a 404

Grant emailgrant at gmail.com
Tue Jan 25 12:38:45 EST 2005


> >>Some search engine spiders keep coming around looking for the same
> >>pages that send them to my missing.html page again and again.  I was
> >>wondering if missing.html returns a 404, and I found the following in
> >>the docs:
> >>
> >>[tag op=header]Status: 404 missing[/tag]
> >>
> >>But If I add that to missing.html I get a blank page (and probably a
> >>404).  Does the missing.html page always return a 404 so robots know
> >>what's up?
> >>
> >>- Grant
> >>
> >>
> >>
> >Grant, here is a link to a tool that I often use to check things like this:
> >
> >http://www.searchengineworld.com/cgi-bin/sim_spider.cgi
> >
> >When I use it to query a non-existing page it appears that the default
> >missing.html is in actuality returning a code: 200 Status ok.
> >
> >I placed [tag op=header]Status: 404 missing[/tag] in the missing.html
> >page like this:
> >
> >@[email protected]
> >[tag op=header]Status: 404 missing[/tag]
> >
> >Now when I check the page, I am indeed getting a true 404 code.
> >
> >It looks like I will be updating my catalogs with this change. I hadn't
> >noticed it before. Thanks for pointing this out.
> >
> >-Gary
> >
> Ok, I just realized that I did not test the missing page in my browser
> after this change. The spider does indeed get the 404 code with the
> changes above, but the browser does not properly parse the page.
> 
> The following change seems to be working in both the browser and the spider:
> 
> [tag op=header]
> Status: 404 Not found
> Content-type: text/html
> [/tag]
> @[email protected]
> 
> Sorry about that 8).
> 
> -Gary

Either of those [tag] tags just returns a blank page for me.  Probably
a 404 too though.  You get the whole page when browsing?

- Grant


More information about the interchange-users mailing list