vorneweg, die Limits der Suchbots von MSN, Yahoo und Google sind jeweils:
Yahoo 210 KB
Google 520 KB
MSN 1.030 KB
Interessantes Experiment von Sitepoint:
The SEO community boasts a multitude of different opinions as to the volume of text indexed by the search engines on a single Web page. The question is, how large should the optimized page be? At what point is the balance between a page so short that SEs disregard it as „non-informative“, and one that’s so long that it leaves potentially important content beyond the spiders‘ attention?
As far as I know, no one has yet tried to answer this question through their own experimentation. The participants of SEO forums typically confine themselves to quoting guidelines published by the engines themselves. Today, the belief that the leading search engines limit the volume of indexed text by the notorious „100 KB“ limit is still is still widely held within the SEO community, leaving SEOs‘ customers scratching their heads as they try to figure out what to do with the text that extends beyond this limit.
und kommt zu folgenden Ergebnissen:
Thus, this experiment established the fact that the leading search engines differ considerably in terms of the the amount of page text they’re able to crawl. For Yahoo!, the limit is 210KB; for Google, 520KB; and for MSN, it’s 1030KB. Pages smaller than these sizes are indexed fully, while any text that extends beyond those limits will not be indexed.
Heisst: Eine Webseite, die größer als die o.g. Limits sind, wird von den drei wichtigsten Bots nicht mehr komplett bis zum Ende gescannt. Abzuleitende Fausregel: Begrenze Deinen Inhalt auf 210 KB, wenn Dir Yahoo wichtig ist, sonst gehe bis maximal 520 KB. Oder, schau zu, dass die wichtigsten Inhalte vor der Limitgrenze „oben“ erscheinen, während unwichtigere Dinge eher nach „unten“ verschoben werden können.
via Webdesignblog
