Results 1 to 5 of 5

Thread: Creating a crawlable URL

  1. #1
    Registered
    Join Date
    Apr 2004
    Location
    UK
    Posts
    59

    Creating a crawlable URL

    Hi, I need some help.

    Doing some SEO on my car classified website www.purpleads.com and have hit a hurdle.

    Am trying to get the car advert pages indexed (by google) but not having any success yet.

    Because the site basically only has about 19 pages (all other pages being off these from DB queries) we initially created the 'Quicklinks' links to get some more pages crawled. This resulted in 200+ pages being indexed. The next step is to get some of the car advert pages indexed.

    Bear with me.....Now to stop the car advert pages being scraped we put a cipher URL for each ad (don't ask me the technicallities ) but this (or so we thought) prevented the ads being crawled as the URL ended up being huge. We implemented a ModReWrite a few weeks ago to shorten the URL to something like;

    purpleads.com/ad.php?modTerm=BMW-used-cars-for-sale.html&id=480690&type=1&postcode1=ws5&postcode2 =3ab

    ....but they still aren't being indexed. (http bit missed out so the full URL showed up in post)

    So, my question is, is there anything obvious in that URL that would prevent it from being crawled and that we should ommit.

    Sorry for being long winded but appreciate your help.

    Best regards, John

  2. #2
    Administrator Chris's Avatar
    Join Date
    Feb 2003
    Location
    East Lansing, MI USA
    Posts
    7,055
    Sounds like you need to modrewrite it again. Ideally you'd want to remove the ? entirely.

    Plus, with the .html in the query string Google may be seeing it as malformed.
    Chris Beasley - My Guide to Building a Successful Website[size=1]
    Content Sites: ABCDFGHIJKLMNOP|Forums: ABCD EF|Ecommerce: Swords Knives

  3. #3
    Web Monkey MarkB's Avatar
    Join Date
    Nov 2003
    Location
    London, UK
    Posts
    1,783
    Break it down to something like:

    purpleads.com/ad/BMW/used/480690/1/ws5/3ab/

    or summat
    Stepping On Wires - the new blog

  4. #4
    Registered
    Join Date
    Apr 2004
    Location
    UK
    Posts
    59
    Ok, thanks guys. We are going to try and implement your suggestions. Will get back to you with results.

    Cheers, John

  5. #5
    Registered
    Join Date
    Apr 2004
    Location
    UK
    Posts
    59
    Ok, we implemented a new more readable URL and its worked....but just our luck it looks like most of the engines crawled the site midway through getting it cracked as it's indexed some 'work in progress' if you know what I mean. What it meant though is that we have also implemented a piece of code which means if a page doesn't exist it will automatically redirect to a search results page, so not all bad.

    Just need for things to settle back down again now.

    Cheers all, John

Similar Threads

  1. Creating centrered HTML pages with Fireworks (MX)
    By reinh in forum HTML, CSS, Layout, and Design
    Replies: 0
    Last Post: 09-15-2004, 08:04 AM
  2. Creating a link within a text variable in Flash
    By Mayihkan in forum Graphics & Multimedia
    Replies: 2
    Last Post: 06-08-2004, 12:10 PM
  3. Creating 100's of non-domain amazon sites...
    By incka in forum Advertising & Affiliate Programs
    Replies: 5
    Last Post: 11-09-2003, 05:24 PM
  4. creating revenue on a content site
    By Cloughie in forum Advertising & Affiliate Programs
    Replies: 5
    Last Post: 10-28-2003, 10:09 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •