I have it limited to 2.5 seconds between requests. This is a screen shot of my current online users that I took just a few minutes ago. I have 7 pages like this (this is just the top 1/2 of the page), but only six actual users are on line right now and 12 legitimate guests.
I nearly went over my bandwidth limit last month, so I've been watching the online users periodically through the day, and there are always dozens of instances of the googlebot agent all over the board, all with the same IP (22.214.171.124), and they're there 24/7.
I checked the stats for the site over at Google's webmaster tools, and the reported crawl rate was WAY off, saying that the high end of the average was only 17 pages per day. I just counted 35 google-guests.
Obviously I don't want to disallow the thing, and I did put a delay in the robot.txt, but it seems weird to me that the bot just literally moved into my site permanently!
One thing I did notice was that the robots.txt reads:
Disallow: /index.php?app=calendar$ ..... etc.
My board, however is not in the root directory, but is at mysite.com/forums/index.php
Should I prepend the /forums/ directory to all of those urls?
I'm running 2.3.5 (I'll be switching to 3.3.0 very shortly).
I could have sworn there was a setting to make a new member's first post so that it had to be mod-approved, but I'm not finding anything. The only way I can think of doing it is to create a noob group that's all-posts-moderated and then automatically promotes to an un-moderated group after one post.
WQell, it's two months later, and I see no miracles, but ever the optimist, I sprung for an IPB license for my site (I'm moving an IPS-hosted IPB to my own server, requiring a license rather than the monthly fee).
Let's hope that IPB doesn't let me or my many members down. Is there anywhere where CMS discussion is taking place, a wish list of features, etc? The single most important feature I need is a robust and flexible review system like JReviews for Joomla.
I was just excitedly reading a thread discussing the immanent early summer release of IPD, and then realized it was two years old. Two years ago it was being hinted that it may be vaporware.
I'm using Joomla, a free open-source CMS, and IPB for a forum. I love the huge extensibility, ease of management, and the price, of Joomla. I love the robustness and flexibility of IPB. I don't love the fact that the two aren't talking to one another. The double login has had a noticeable negative impact on my site.
I actually came here today to see if any progress might have been made on IPD before I pull the plug on IPS altogether; I simply can't wait anymore.
There are free open source solutions that more than fill the bill, and the only things keeping me from switching to phpBB3 have been the promise of an IPS CMS, the gigantic pain it's going to be converting a huge forum, and the risk of losing five years of online history. Right now IP.D looks like a carrot that someone is telling me is at the end of a stick I can't see.