Results 1 to 14 of 14

Thread: Building google sitemaps

  1. #1
    Working. Masetek's Avatar
    Join Date
    Aug 2005
    Location
    Aust
    Posts
    543

    Building google sitemaps

    What doyou use to build the xml google sitemap? I found a tool called site map builder that works but it ignores robots.txt. Hence, it adds all the forum stuff in the that I dont want indexed. This creates a huge sitemap (3mb+) and most of it is useless stuff like search.php, private.php etc from vb.

  2. #2
    Site Contributor stymiee's Avatar
    Join Date
    Dec 2004
    Location
    Between the Pipes
    Posts
    275
    I code it by hand. I use PHP to create the sitemap for the dynamic parts of my site and use apache forcetype to make it recognize the sitemap.xml file as a php file. I now only need to go and edit file whener I add a major page to my site. Otherwise all articles, blog posts, directory submissions, and forum posts are automatically added to it.
    John Conde :: brainyminds
    Merchant Account Services -- Merchant Services Resources
    IT'S HERE: Integrate the Authorize.net Payment Gateway with PHP
    Everything you need to integrate Authorize.net into your website with PHP. Includes an explanation of how transactions work, validating credit cards, and the source code for free.

  3. #3
    Trench Warfare
    Join Date
    May 2003
    Location
    Australia
    Posts
    813
    My not be what you need, but there is a good sitemap generator plugin for wordpress that allows you to add/take away pages/folders that you don't want included.

    I'll go and look for the name of it.

  4. #4
    Registered
    Join Date
    Apr 2006
    Posts
    184
    I suually just write a script to generate it from the database content, but if that's not practical or if I'm feeling lazy, I'll just use this:

    http://sitemap.xmlecho.org/

  5. #5
    Senior Member agua's Avatar
    Join Date
    Sep 2005
    Location
    Pottsville, NSW
    Posts
    531
    I just found this Sitemap Generator and it listened to my robots.txt file

    http://www.xml-sitemaps.com/
    I Do Website Design - but I am here to learn all about publishing

  6. #6
    Registered Giles's Avatar
    Join Date
    Mar 2006
    Posts
    226
    I only have a few sites and they are all wordpress so the WP sitemap builder plugin is my saviour, it automatically updates itself too.

  7. #7
    Gimme Fries with that!
    Join Date
    Aug 2004
    Posts
    1,469
    cool aqua I am going to check that out and see what I think.

  8. #8
    Your average angry alien dc dalton's Avatar
    Join Date
    Mar 2006
    Location
    Stuck in FREAKING PA
    Posts
    127
    I have and LOVE gSite Crawler ... really awesome tool!

    Check it out here:

    http://johannesmueller.com/gs/

  9. #9
    Is Still Alive! Johnny Gulag's Avatar
    Join Date
    Feb 2006
    Location
    North Texas
    Posts
    242
    Quote Originally Posted by Giles
    I only have a few sites and they are all wordpress so the WP sitemap builder plugin is my saviour, it automatically updates itself too.
    Hey thanks for that. I did not know that existed. Now i do. You rock!

  10. #10
    I've use www.xml-sitemaps.com on several sites. It offers an online free service for sites with <500 pages. For sites of more than this you need to buy it and install it on your domain - not expensive though. I've used the bought version on www.childrenwebmag.com quite successfully for several months.

    The only problem with the free online version is that it will parse multiple versions of the same page with many strings (e.g. page?sort=asc and page?sort=desc etc.) which leads to more than 500 pages even on a small site. If it still is less than 500 pages then a quick regex is needed to remove all the duplicate pages.

    The paid for version lets you filter this out automtically.
    Jeremy
    Children Webmag - Child Care Articles
    Dunstable.tv - Just Dunstable
    Rugged Rhino - Web Marketing & Web Design, Dunstable

  11. #11
    Working. Masetek's Avatar
    Join Date
    Aug 2005
    Location
    Aust
    Posts
    543
    Just some follow up...

    I tested loads of free sitemap builders and this one is the best one I can find that builds a clean sitemap

    http://enarion.net/google/phpsitemapng/

    You download it and install on your server. Theres loads of config options. A couple of test runs and I had a clean sitemap.

  12. #12
    Thanks Masetek,
    I've been looking for an Open Source Google XML sitemap generator for a while and never found this one. I've just installed it and it is as expected a breeze.

    It would nice to have the ability to setup a "cron" style job that reran it every day/week/month. But as it is only a click or two away its OK.

    You also have to deal with security yourself with .htaccess files.
    Jeremy
    Children Webmag - Child Care Articles
    Dunstable.tv - Just Dunstable
    Rugged Rhino - Web Marketing & Web Design, Dunstable

  13. #13
    Working. Masetek's Avatar
    Join Date
    Aug 2005
    Location
    Aust
    Posts
    543
    Quote Originally Posted by jeremycurtis
    Thanks Masetek,
    I've been looking for an Open Source Google XML sitemap generator for a while and never found this one. I've just installed it and it is as expected a breeze.

    It would nice to have the ability to setup a "cron" style job that reran it every day/week/month. But as it is only a click or two away its OK.

    You also have to deal with security yourself with .htaccess files.
    Have u had a look at the source? I'm sure it wouldnt be hard to modify so it can run on the cron

  14. #14
    Registered Giles's Avatar
    Join Date
    Mar 2006
    Posts
    226
    There is also the google official sitemap builder, that runs on perl, it is available from google.

Similar Threads

  1. Review: Google Adsense
    By Chris in forum Advertising Networks
    Replies: 16
    Last Post: 12-02-2017, 02:32 AM
  2. Google sitemaps question
    By Skeewe in forum General Promotion
    Replies: 4
    Last Post: 03-06-2006, 03:55 PM
  3. The power of Google Sitemaps
    By Blue Cat Buxton in forum General Management Issues
    Replies: 8
    Last Post: 01-04-2006, 09:36 AM
  4. Google Sitemaps
    By ozgression in forum Search Engine Optimization
    Replies: 1
    Last Post: 10-16-2005, 09:31 PM
  5. Local Rank stuff...
    By chromate in forum Search Engine Optimization
    Replies: 41
    Last Post: 02-07-2004, 03:53 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •