Comments on: PHP and Wget sitemap generator for search engines

By: lxer

lxer — Wed, 18 Mar 2009 09:46:18 +0000

nice, but it shouldn’t mirror the whole website. it would be better if it worked like this:
1. download single webpage
2. extract the url’s and add to a temp file
3. remove file
4. go to next file (1)

this way you wouldn’t need much free diskspace to do the same

By: Paolo Ardoino

Paolo Ardoino — Mon, 11 Aug 2008 07:35:51 +0000

You should create multiple sitemaps and submit a sitemap index file.

By: Germán Schultz

Germán Schultz — Sat, 09 Aug 2008 20:15:33 +0000

Paolo:

My sitemap contains more than 50,000 urls. Do you know how can I split the file?

Germán

By: Fredi

Fredi — Fri, 04 Jul 2008 13:25:56 +0000

I completely agree with all that here is told PHP and Wget sitemap generator for search engines Fredi

By: TechJammer

TechJammer — Tue, 27 May 2008 22:12:55 +0000

Ok, New question for Paolo,

Is it possible to disable ‘mirror’ functionality? I have a VERY large site, and apparently the mirror function completely exhausted my 1G of disk space.

By: TechJammer

TechJammer — Tue, 27 May 2008 18:00:38 +0000

Paolo:

Ignore the message above. I was able to use ‘var’ in place of public and the class seems to be working ok using that change under php4.

By: TechJammer

TechJammer — Tue, 27 May 2008 16:25:34 +0000

Paolo:
My web server is stuck at php v4. The ‘Public’ scope is not available in php4. Is there an alternative scope I can use to make your class work in php4?

By: Paolo Ardoino

Paolo Ardoino — Tue, 26 Feb 2008 08:54:23 +0000

Hello,
from wget man page you can see two options: –reject and –accept
You need this: –reject .gif
So edit this line:
exec(”wget -m “.$this->opts["website_url"].” 2> wget.log”);
as follows:
exec(”wget -R .gif -m “.$this->opts["website_url"].” 2> wget.log”);

This should work

By: Larry

Larry — Tue, 26 Feb 2008 02:47:46 +0000

Hi. Thanks for the scripts

I’m working with you PHP Wget Sitemap generator v0.2 script and was wondering if it’s possible to exclude gifs?