Results 1 to 10 of 10

Thread: getting deep crawled

  1. #1

    getting deep crawled

    i just noticed only about 35,000 of my 200,000 or so subpages have been crawled / indexed by google, and i've been floating between a PR4 and 5 for several months now.. is there anything i can do to get it to crawl the rest of the pages? it would probably boost my PR back to 5 and up my traffic significantly if i got all the pages indexed

  2. #2
    Senior Member AndyH's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    553
    It appears to me that the higher PR you have, the more pages Google will crawl.
    New website released. ya rly!

  3. #3
    Registered
    Join Date
    Jan 2004
    Posts
    183
    What site is it? How many levels deep are most of the pages? If you have 4,5 etc. level pages it should take a while for Google to index them.
    If you change the linking structure to accomodate less clicks from the home page to get to all of the pages, that should help.

  4. #4
    it's my lyrics site. most of the links it never grabbed are like 4-5 pages in... the format goes something like: home --> browse --> artist --> album --> song

    it has all the home and browse pages (all PR4), i think it has all the artist pages (like 13,000)... then it has some of the album pages and some of the song pages

    i can't really think of any easier way to get to the album / song pages quicker, even if i made a site map...

  5. #5
    Registered
    Join Date
    Jan 2004
    Posts
    183
    i can't really think of any easier way to get to the album / song pages quicker, even if i made a site map...
    Yeah, I can see this.
    Maybe it's a matter of waiting then. When Google indexes all of your pages, your PR should rise with such an amount of content.

  6. #6
    yea, i probably just have to go back to waiting then... i guess it's better that i'm getting the traffic i am now with only 1/6 the site indexed rather than the entire thing, it's just more frustrating knowing i could be getting so much more ;-)

  7. #7
    Registered
    Join Date
    Sep 2004
    Posts
    50
    Ive been getting deep crawls from googl for weeks - jeteye also

    about every other day

  8. #8
    Gimme Fries with that!
    Join Date
    Aug 2004
    Posts
    1,469
    interesting. Google this and spiders me daily for my content, i use it to get my friends sites spidered since it is daily hits. Google however doesnt do a deep crawl, it only goes a few pages deep.

    I am interested in hearing approaches for deep crawls.

  9. #9

  10. #10
    Registered
    Join Date
    Oct 2004
    Posts
    66
    Jeteye has been annoying me recently - the hits mess up my 'unique visitor' stats as there are various Jeteye subdomains coming in on different IP addresses.

    Well hopefully it will pay off with search engine results.

Similar Threads

  1. what does deep crawl mean ?
    By s2kinteg916 in forum Search Engine Optimization
    Replies: 4
    Last Post: 12-04-2017, 12:47 AM
  2. How long after deep crawl?
    By flyingpylon in forum Search Engine Optimization
    Replies: 2
    Last Post: 04-07-2004, 06:56 AM
  3. no incoming links, crawled by Ink, no.2 on MSN
    By Apollo in forum Search Engine Optimization
    Replies: 2
    Last Post: 01-31-2004, 11:14 AM
  4. How do you know when you're deep crawled?
    By dolphin in forum Search Engine Optimization
    Replies: 3
    Last Post: 01-27-2004, 06:06 AM
  5. Getting deep crawled
    By chromate in forum Search Engine Optimization
    Replies: 14
    Last Post: 11-14-2003, 10:52 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •