There is an up-to-date list of spiders on the official vBulletin forum.

Download the spiders xml file and copy it to your includes/xml directory. vBulletin will read the file and include it in its spider identification for the who is online facility.

Footer Archive Links - get the Google Page Ranking to your threads

As many arguments as there are for and against accumulation of Google Page Ranking, the underlying principle remains - have the least number of clicks to pages holding your content.

So I personally have numbered links to each of the main archive/sitemap pages added to the footer template. Why numbered links? The objective is to get Google Page Ranking to the pages, not to have those archive pages ranking in their own right. Therefore, having the links numbered uses the least amount of page space possible.

Additionally, you can have a conditional on them to only show to guests, ie including the search engine spiders

<if condition="$show['member']"></if>

[Code Monkey]

Actually the above left out that you need to change the name of the file to the same name as the vbulletin file. Which will replace the file. vBulletin will not read this file as named.

[Loco]

oh ya, I forgot that on another site too

[Eric]

Installed it, just wondering what all those spiders do in the end, seems everybody wants to have it's own to cram hdd full of data

[Code Monkey]

They send people to visit you. So it's a good thing. This site is very young yet google is still the number one source of referrals. It's even bigger than direct links.

[Eric]

That's true but let's be honnest, how many of the sites (once you digg who the spider is from) you actually know ? We all know the big ones like yahoo slurping , google crawling, msn searching ..... you ever heard about project kolinka ? (one that is spidering right now over mine...)
Crazy the multitude you have. I don't care since I have no limit on bandwidth but I had to help people in the past. They had a little account and finally spiders just ate it all. Luckely robot.txt exists (but I wonder if all respect that).

[pooman]

that is a wicked cool mod, thanks for the linkage

[G_Man]

Okay... I've seen this somewhere else and I still don't get it.

First, where is this so called Mod?!? And secondly, how does having a bunch of numbers across the bottom of your page linking to the archives help Google. It seems to me that it just gets Google to your Archives sooner and I thought we wanted to avoid that.

me be confused...