Go Back   vBulletin Modification Discussions > vBulletin Discusions > Knowledge Base > Tutorials
Home Register FAQ Members List Calendar Mark Forums Read
vBSEO Info Tags

About This Page: This is a discussion on vBulletin Optimizing Tips within the Tutorials forums, part of the Knowledge Base category, at vBulletin Modification Discussions. Here are some quick and easy optimizing tips that I found on a site I'll link to at the bottom 1. Store CSS StyleSheets as Files By default, vBulletin will store the CSS of your pages as HTML within


Comment
 
LinkBack Tutorial Tools
<!-- google_ad_section_start -->vBulletin Optimizing Tips<!-- google_ad_section_end -->
vBulletin Optimizing Tips
Published by Loco
09-16-2006
Tutorial Tools

Featured Tutorials

Want to submit your sitemap to all search engines in one shot?

Use the new sitemap standard to submit your sitemap to all search engines that recognize the standard.
vBulletin Optimizing Tips

Here are some quick and easy optimizing tips that I found on a site I'll link to at the bottom

1. Store CSS StyleSheets as Files

By default, vBulletin will store the CSS of your pages as HTML within the head of the document. This, when taken over thousands of pages, can be quite a heavy burden.

Storing CSS Stylesheets as files will allow users/spiders to cache the CSS as a file, and make each page smaller, HTML wise, giving your server a bit of a breather.

To begin, ensure your forums/clientscript/vbulletin_css directory is chmod 777 so the stylesheet files can be created.
Next, in the AdminCP, select the vBulletin Options menu then vBulletin Options.
Select Style and Language Options.
Set "Store CSS Stylesheets as Files?" to Yes.
Click Submit.


2. Gzip those pesky pages!

Many hosts these days come with gzip as standard, meaning if you enable it within vBulletin you can actually slow pages down.

If your host has gzip installed, follow these instructions:

Go to the AdminCP, expand the vBulletin Options menu and select vBulletin Options.
Select Cookies and HTTP Header Options.
Set "GZIP HTML Output" to No, set "GZIP Compression Level" to 0 and click Submit.

If your host does not have gzip installed, choose Yes and 1 for the above.

3. Restrict Search Engine Crawling

Those spiders..they index your content, but there are always places that you don't want or need them to go.
To restrict the pesky critters to only eating up your Content, do the following.

In your root (public_html) directory, upload the following robots.txt::


Code:
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
Remove any lines that you WANT the spiders to see.. if you want them to crawl the Calendar, take out Disallow: /forums/calendar.php.

4. Move Attachments to the File System

Stock vBulletin Attachments are stored in the Database. Large attachments or frequent viewing of them can cause a strain.

To move them to the File System, create an attachments directory above your public_html (at the same level as it.. /root/username/public_html | root/username/attachments) and CHMod it 777.

By placing it at this level, we prevent anyone from being able to access the attachments directly (ie: not through vBulletin).

Next, go to the AdminCP and expand the Attachments menu.
Click on Attachment Storage Type.
Move your attachments out of the database and into the file system.

Attachment Path: /home/*username*/attachments


5. Move Avatars and Profile Pics to the File System

As with the Attachments above, but the Avatars are on every post, so cause a burden to the server whenever a post is viewed.

To move them to the filesystem, chmod your forums/customavatars and forums/customprofilepics directories to 777.
Go to the AdminCP and expand the Avatars menu.
Click User Picture Storage Type.
Choose to Move Avatars and Profile Pics to the File System.

Avatar Path: /home/*username*/public_html/forums/customavatars

Avatar URL: /forums/customavatars

Profile Pic Path: /home/*username*/public_html/forums/customprofilepics

Profile Pic URL: /forums/customprofilepics


6. Increase Cached Posts Lifespan

Posts can be "cached", meaning the server doesn't have to pull them from the database every time they are viewed.
To enable Post Caching, do the following:

Go to the AdminCP, expand the vBulletin Options menu and select vBulletin Options.
Select Server Settings and Optimization Options in the drop down menu.
Set "Cached Posts Lifespan" to 90.
Click Submit.
If you have very little spare space, drop it to 30.


7. Disable Search and Who's Online for Guests

Why should guests (which are often mainly Spiders) see your Who's Online and Search? Do the following to stop them and reduce the load.

Go to your AdminCP.
Expand the Usergroups menu.
Select Usergroup Manager.
Select Unregistered / Not Logged In.
Set both "Can Search Forums" and "Can View Who's Online" to No.
Click Submit.

8. Turn on fulltext searching

Go to your AdminCP and expand the vBulletin Options menu
Select Search Type.
Set "Empty postindex and word tables?" to Yes.
Click Submit.


9. vBulletin.org Optimisation Mods

The following link willl provide the various Modifications that have been written by the Community at vBulletin.org:

vB3.5 Add-ons - vBulletin.org Forum

[Source....] thx to Kall @ vbenhanced.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Old 09-16-2006, 08:20 PM   #2 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
If you have my vBulletin AJAX Cron mod you should add the following to your robots text as well.

Code:
Disallow: /forums/ajax_cron.php
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 09-16-2006, 09:58 PM   #3 (permalink)
Senior Member
 
Loco's Avatar
 
Join Date: Aug 2006
Location: Kansas
Posts: 263
Loco is on a distinguished road
yup and any other files that you don't want spiders to index

the idea behind this is to get the good content spidered, not the stuff unrelated to your site
Loco is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 06:23 AM   #4 (permalink)
Senior Member
 
Join Date: May 2006
Posts: 140
Kihon Kata is on a distinguished road
Quote:
Originally Posted by Loco View Post
Here are some quick and easy optimizing tips that I found on a site I'll link to at the bottom

1. Store CSS StyleSheets as Files

2. Gzip those pesky pages!

3. Restrict Search Engine Crawling

4. Move Attachments to the File System

5. Move Avatars and Profile Pics to the File System

6. Increase Cached Posts Lifespan

7. Disable Search and Who's Online for Guests

8. Turn on fulltext searching
Hi Loco!

I have taken you up on your optimization tactics here. I was already doing a few of these things as in attachments running from file system, css running from file system, disable search allowing guests to use it

I added the rest! Let's see how it goes on my semi busy forum

Thanks!
Kihon Kata is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:31 AM   #5 (permalink)
Senior Member
 
Eric's Avatar
 
Join Date: May 2006
Location: France
Posts: 458
Eric is on a distinguished road
Send a message via ICQ to Eric Send a message via MSN to Eric
I have set the robot test file but I spidered them and Google doesn't follow the rules. They just ignore it, like it is still going over members list.
And I did check the net, seems I'm not the only one thinking this .
Eric is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:39 AM   #6 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
I have not had one google bot overstepping the line. And VBSEO gives me a complete list of it's activity.

Did you name it robots.txt? That's robots not robot. I see you call it robot test file above. It's not a test file but a txt file.

Also, it goes in your root directory not forum directory.
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:43 AM   #7 (permalink)
Senior Member
 
Join Date: May 2006
Posts: 140
Kihon Kata is on a distinguished road
Here's mine if you wanna use it. I put it in my root of my site(not root of forums)
Attached Files
File Type: txt robots.txt (1.1 KB, 4 views)
Kihon Kata is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 10:58 AM   #8 (permalink)
Member
 
smacklan's Avatar
 
Join Date: Sep 2006
Posts: 64
smacklan is on a distinguished road
Good tips Loco! One thing I will point out however...vBulletin does not parse external files so when you store css stylesheets as files you will run into problems with some commercial styles that rely heavily on css and especially those that rely on the replacement variable in the style mananger.
smacklan is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 11:39 AM   #9 (permalink)
Senior Member
 
Eric's Avatar
 
Join Date: May 2006
Location: France
Posts: 458
Eric is on a distinguished road
Send a message via ICQ to Eric Send a message via MSN to Eric
my robots.txt file seems ok

this is what's in it
Quote:
User-agent: *
Disallow: /forum/arcade.php
Disallow: /forums/ajax.php
Disallow: /forums/attachment.php
Disallow: /forums/calendar.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/inlinemod.php
Disallow: /forums/joinrequests.php
Disallow: /forums/login.php
Disallow: /forums/member.php
Disallow: /forums/memberlist.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattachment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/showgroups.php
Disallow: /forums/subscription.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php
Disallow: /forums/ajax_cron.php
and it is /public_html/
maybe I should set it a level lower, though it should respect it.

And for the moment none is where it shoudln't as usual same as when you go to the garage for a screeming brake that suddenly doesn't
Attached Images
File Type: jpg robots.txt.jpg (4.3 KB, 9 views)
Eric is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:10 PM   #10 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
Here is mine.

Code:
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/ajax_cron.php
Disallow: /forums/attachment.php
Disallow: /forums/checkspelling.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/external.php
Disallow: /forums/faq.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/joinrequest.php
Disallow: /forums/login.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattatchment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/payment_gateway.php
Disallow: /forums/payments.php
Disallow: /forums/pdfthread.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/subcription.php
Disallow: /forums/subcriptions.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php

Disallow: /forums/admincp/
Disallow: /forums/images/
Disallow: /forums/modcp/
Disallow: /forums/articlebot/
Disallow: /forums/clientscript/
Disallow: /forums/customavatars/
Disallow: /forums/customprofilepics/
Disallow: /forums/files/
Disallow: /forums/install/
Disallow: /forums/cpstyles/
Disallow: /forums/images/
Disallow: /forums/includes/
Disallow: /forums/subscriptions/
Disallow: /forums/attachments/
Disallow: /forums/frm_attach/
Disallow: /forums/vbweather/
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:15 PM   #11 (permalink)
Senior Member
 
Join Date: May 2006
Posts: 140
Kihon Kata is on a distinguished road
Quote:
Originally Posted by Code Monkey View Post
Here is mine.

Code:
User-agent: *
Disallow: /forums/ajax.php
Disallow: /forums/ajax_cron.php
Disallow: /forums/attachment.php
Disallow: /forums/checkspelling.php
Disallow: /forums/cron.php
Disallow: /forums/editpost.php
Disallow: /forums/external.php
Disallow: /forums/faq.php
Disallow: /forums/global.php
Disallow: /forums/image.php
Disallow: /forums/joinrequest.php
Disallow: /forums/login.php
Disallow: /forums/misc.php
Disallow: /forums/moderator.php
Disallow: /forums/newattatchment.php
Disallow: /forums/newreply.php
Disallow: /forums/newthread.php
Disallow: /forums/online.php
Disallow: /forums/payment_gateway.php
Disallow: /forums/payments.php
Disallow: /forums/pdfthread.php
Disallow: /forums/poll.php
Disallow: /forums/postings.php
Disallow: /forums/printthread.php
Disallow: /forums/private.php
Disallow: /forums/profile.php
Disallow: /forums/register.php
Disallow: /forums/report.php
Disallow: /forums/reputation.php
Disallow: /forums/search.php
Disallow: /forums/sendmessage.php
Disallow: /forums/subcription.php
Disallow: /forums/subcriptions.php
Disallow: /forums/threadrate.php
Disallow: /forums/usercp.php
Disallow: /forums/usernote.php

Disallow: /forums/admincp/
Disallow: /forums/images/
Disallow: /forums/modcp/
Disallow: /forums/articlebot/
Disallow: /forums/clientscript/
Disallow: /forums/customavatars/
Disallow: /forums/customprofilepics/
Disallow: /forums/files/
Disallow: /forums/install/
Disallow: /forums/cpstyles/
Disallow: /forums/images/
Disallow: /forums/includes/
Disallow: /forums/subscriptions/
Disallow: /forums/attachments/
Disallow: /forums/frm_attach/
Disallow: /forums/vbweather/
oh, I'll add some of those...
I take it when it's like this: disallow: forums/images that it ignores the entire directory?
Kihon Kata is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:20 PM   #12 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
Yep, there is nothing in those directories that Search Engine bots need to see.
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:35 PM   #13 (permalink)
Senior Member
 
Join Date: May 2006
Posts: 140
Kihon Kata is on a distinguished road
I added some of those directories also.
Kihon Kata is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:44 PM   #14 (permalink)
Senior Member
 
G_Man's Avatar
 
Join Date: Oct 2006
Posts: 475
G_Man is on a distinguished road
Just replaced mine with your CM... a little more up to date.

I also noticed that the one I picked up earlier has some bots being disallowed?

Are there 'bad' bots?
G_Man is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:56 PM   #15 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
There can be depending on what kind of site you run. That's why it's important to keep the bot script up to date with the lates bots. So when you see one you never heard of in WOL you can google it and find out what it is. Most are good. But some are specifically hired by companies and such to look for their name mentioned for example.
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 07:58 PM   #16 (permalink)
Senior Member
 
G_Man's Avatar
 
Join Date: Oct 2006
Posts: 475
G_Man is on a distinguished road
Quote:
Originally Posted by Code Monkey View Post
There can be depending on what kind of site you run. That's why it's important to keep the bot script up to date with the lates bots. So when you see one you never heard of in WOL you can google it and find out what it is. Most are good. But some are specifically hired by companies and such to look for their name mentioned for example.
Do you have any disallowed in your robots.txt ??

I am scared now!! robots scare me!!
G_Man is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 08:24 PM   #17 (permalink)
Administrator
 
Code Monkey's Avatar
 
Join Date: May 2006
Posts: 2,194
Code Monkey is on a distinguished road
No I don't have any. I live a good clean life and have nothing to hide.
__________________
Please do not PM me unless it's personal. General vBulletin or mod questions by PM will be ignored.

Try the vBSEO Demo

Click here for Instant Community
Code Monkey is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 10-17-2006, 08:26 PM   #18 (permalink)
Senior Member
 
G_Man's Avatar
 
Join Date: Oct 2006
Posts: 475
G_Man is on a distinguished road
Quote:
Originally Posted by Code Monkey View Post
No I don't have any. I live a good clean life and have nothing to hide.
The file I had has a bunch of disallowed bots. Perhaps I'll remove them...

Thanks.
G_Man is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Old 11-06-2006, 09:53 AM   #19 (permalink)
Junior Member
 
Join Date: Oct 2006
Posts: 14
DigitALL is on a distinguished road
Nice optimization tips! I have used few of them.
DigitALL is offline  
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote