Just a question...

[mitov]

I know this may be a stupid question, but when for examples googlebot craws your site, does it only index a specific amount of words, or the whole page? And will it follow links from images and dhtml menus?

Miro

[bizNorthEast.co.uk]

it stores all the page but only uses first 500 words to work out search results.

[mitov]

i see....

And there is no way to make it index only displayed text? Or specific text?

[roy]

The robots.txt file can tell it to miss pages I think. Might be worth investigating further.

[mitov]

Hi roy,

Yes. thats what i understood from the google website. Im just asking into this becasue i have a script already, and it dosent want to index my site propery, so i was thinking it would be the same with searchengines????

[roy]

Forgot I had this article on one of my 'play' sites about robot.txt:

http://www.internet-toolbox.biz/Sear...iders_Lost.htm

[mitov]

Thanks. Ill have a read through it.

[peterjhale]

well, no one really knows what they capture

They certainly crawl the whole page becuase that's what appears in your cache - and some people think that if your search term is at the beginning and at the end then this will improve your rankings

unfortunately it's all a guessing game

at present, it's best to have "hard" links to pages you want indexed rather than images

[mitov]

will this include links from dhtml menus?