A while ago, I did a plugin for myself to track robots activity on my websites and display them with jpgraph. While preparing for a release here, I discovered Cr@wltr@ck. So this is a Cr@wltr@ck Plugin for WordPress.
It integrates with your WordPress installation - let me know if for some reason it doesn’t 
Demo: see the demo at the Cr@wlTr@ck Website
Download: Bot Tracker
Version: 2.3.0
Usage:
- As always: download, unzip and upload to your WordPress plugins directory
- activate the plugin within you WordPress Administration Backend
- be patient and wait until Cr@wltr@ck gets some stats*
* Can’t wait? There is a test-crawler at the “Tools” menu of Cr@wltr@ck, you could set up yourself:
Be careful with the other Cr@wlTr@ck options. Cr@wlTr@ck has been modified for this Plugin to integrate with WordPress and doesn’t function standalone anymore.
Share This Tags: Wordpress Plugins
August 8th, 2007 at 6:02 pm
I am getting an error. I am using wordpress 2.2.1 here is ther error,
Fatal error: Cannot redeclare dprx_tracker_include() (previously declared in C:\wamp\www\blog\wp-content\plugins\bot-tracker\bot-tracker.php:66) in C:\wamp\www\blog\wp-content\plugins\bot-tracker\bot-tracker.php on line 68
August 8th, 2007 at 6:04 pm
hmmmmm weird, I went back to it to try and fix the problem and it works fin now. but still I thought you should know that there was an error!
August 8th, 2007 at 7:13 pm
@Eric:
Thanks for the feedback! I’ll do some additional testing for a 1.1 release…
August 9th, 2007 at 7:38 am
Hi,
I have installed that plug-in for my 2.0.4 wordpress blog site… and it’s working fine but that plug-in showing only character “D” in its menu bar and in its submenu instead of Crawler, page viewed, source etc…
August 9th, 2007 at 7:48 am
@Nakul:
Which version of WordPress are you running? Does Firebug (http://www.getfirebug.com/) say something about javascript errors? Have you tried a re-install?
August 9th, 2007 at 10:35 am
Hi.. i m using 2.0.4 version and re-install that plugin…. but showing same error again
September 1st, 2007 at 10:32 am
i installed the bot tracker ystrday and i check and work fine, but today before 10 minutes doesnt show anything? how can i fix this one?
By the way great work….
September 1st, 2007 at 10:41 am
@Lazaros,
If you haven’t done anything to the code, and it did work well yesterday, it probably just takes time until the next bot hits the site
Reasons for not receiving robot hits besides that can be:
- your .htaccess file prevents them indexing the site
- your meta information tell the robots NOINDEX, NOFOLLOW
- etc.
It also depends on the popularity of your website:
e.g.: yesterday this website received 108 hits from 11 crawlers on 47 pages
I do have cutomers, who have days with no visit from a robot at all.
September 9th, 2007 at 6:18 am
Hi,
I’m using WP 2.2.3, haven’t done anything to the code at all.
keep getting this:
Warning: main(include/menumain.php) [function.main]: failed to open stream: No such file or directory in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 37
Warning: main(include/menumain.php) [function.main]: failed to open stream: No such file or directory in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 37
Warning: main(include/menumain.php) [function.main]: failed to open stream: No such file or directory in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 37
Warning: main() [function.include]: Failed opening ‘include/menumain.php’ for inclusion (include_path=’[…]wp-content/plugins/’) in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 37
same 4 warnings for lines 38 and 39 each.
then just below the pie chart, this:
Warning: main(include/mapgraph.php) [function.main]: failed to open stream: No such file or directory in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 279
Warning: Division by zero in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 477
Warning: Division by zero in […]wp-content/plugins/bot-tracker/crawltrack/include/display-all-crawlers.php on line 486
I have deactivated and re-uploaded the whole file, same result.
All the charts render though.
September 9th, 2007 at 6:54 am
@Tony,
This might be a crawltrack issue. My Bot tracker installation does just fine on WordPress 2.2.3. Division by zero might mean, that there is zero data somewhere, do you have a lot of robots traffic?
Also, please ask support questions at the forum http://wpforum.designpraxis.at/ from now on.
September 9th, 2007 at 7:01 am
Yes I get bots, and I apologize for not going to the forum, you may want to put a link to it in your plugin.
I have about 60 plugins, so I just use the link provided.
Thanks for the quick response.
September 9th, 2007 at 7:01 am
Please delete my question if it clutters up your page.
September 9th, 2007 at 8:02 am
@Tom,
no problem
I installed the forum just a few days ago. I’ll update my plugins’ readme asap!
September 10th, 2007 at 12:53 pm
Hi,
Great plugin for WordPress2.2.3 though I have noticed a few things after it installed.
1) The box, under CrawlTrack, does not resize for Opera 9.23. It is very small and makes viewing very difficult to read.
2) Resizing the box, see #1, by IE 7.0 is slow. However I find no issues with Netscape 8.1.2
3) File to transfer via FTP is quite large, quite time consuming when compared to other plugins ins from WordPress and not all files transferred eventhough initially they appeared to have transferred. It only after the graphs not displaying did I notice most of the folders in the graph folder did not trasfer. Might I recommend a flatter file structure to in order to locate file issues or finding a way to use less files. Maybe less files that are bigger in size might be a solution or possibly having each section as a different install so if there is an issue with files it can be easily identified?
4) When you go to the bot graph for example and then click msn bot pie slice nothing pulls up. I feel that if the slice is clickable then it should pull up the information associated with the ’slice’ that was clicked.
September 10th, 2007 at 9:02 pm
Brad,
Thank you for your feedback,
ad 1) does “box” mean the iframe, which wraps crawltrack?
ad 2) I’ll have a look at it in IE7 as soon as I get my hands on a windows machine
ad 3) Crawltrack is developed here: http://www.crawltrack.fr/, my plugin just wraps the work of these guys
ad 4) see 3), If you have support questions regarding crawltrack, check the crawltrack website.
I’m happy for any kind of testing and bug reporting! Therefore I installed a forum:http://wpforum.designpraxis.at/. Please post support issues there, thanks a lot!
October 17th, 2007 at 3:43 am
I get this error on Vers 2.3 wordpress
thanks
Jeff
Warning: dir(../cache/) [function.dir]: failed to open dir: No such file or directory in […]wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 33
Fatal error: Call to a member function on a non-object in […]wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 34
October 17th, 2007 at 8:20 am
jeff, thanks for the comment! I’ve added the empty cache directory to the svn. Please download and reinstall again.
October 24th, 2007 at 2:19 pm
Anybody else having trouble with the Bot Tracker plugin? Mine was working fine till last night. Now all of the menus just display “s” instead of “crawler”, “keywords”, etc…
I just installed the SimpleMachines Forum on my server last night. Do you think this could have anything to do with it. I can’t imagine how these two products would collide but I guess anything is possible.
I have tried deactivating and re-activating the plugin but it did not help. I can still navigate but it is a real pain to use now.
Thanks!
October 25th, 2007 at 8:41 pm
Keith, did you install your forum software within the same database? Unless the distribution doesn’t include another CrawlTrack installation the forum could hardly be the cause of the conflict.
October 26th, 2007 at 3:47 pm
Roland,
I looked into this further and found that it is the WP_SMF plugin (the Wordpress to SimpleMachines Forum bridge) that is causing the problem. I believe it is changing the default language from whatever the default Wordpress language is to something else (maybe non-utf or vice versa). I have tried to take a quick look at the plugin to see if I could prevent this change but I haven’t had any luck. I know this plugin is causing the problem because if I deactivate the WP_SMF plugin then your Bot Tracker plugin displays correctly. Would you have a chance to look into this further? You can download the WP_SMF plugin from the following link.
http://www.earthorbit.com/opensource/
Thanks!
October 31st, 2007 at 7:39 pm
I’m using WP 2.3.0 and I’m getting an error when activating this plugin. I really want to use this plugin so if there is any hack or fix I can do, please let me know. thanks.
The error occurs at the very bottom of the page, after the copyright.
Fatal error: Cannot redeclare crawlt_sql_quote() (previously declared in […]wp-content\plugins\bot-tracker\crawltrack\crawltrack.php:53) in […]wp-content\plugins\bot-tracker\crawltrack\crawltrack.php on line 63
October 31st, 2007 at 8:13 pm
I’ve checked the current release, the code is allright. Deactivate, uninstall and reinstall the plugin. Since your blog is on a windows platform, take care of unix linefeeds when unpacking.
October 31st, 2007 at 8:17 pm
Keith, regarding the WP_SMF conflicting with BotTracker: WP_SMF is a BETA release, so problems are expected to occur. Try to install required languages for WP_SMF from here.
November 2nd, 2007 at 10:31 pm
Roland - Thanks for looking into this… I have the required languages but there are a few lines of code in the WP_SMF plugin that are messing with the Wordpress language settings (not the SMF language settings). This causes your plugin to be displayed incorrectly. At least that is my best guess as to what is happening.
For now I am just going to deactivate the WP_SMF plugin and manually handle users between the two systems. I don’t have that many registered users (yet…) so it’s not a big deal.
Thanks again and keep up the great work on all your plugins!
By the way… You might be interested in a project I am working on for developing a Wordpress Plugin Framework. You can take a look at it at by following the link below.
http://www.doubleblackdesign.com/2007/11/01/wordpress-plugin-framework-v001-released/
November 10th, 2007 at 2:54 am
I don’t get any errors now but I don’t think it is tracking any of the bots. I’ve looked at the logs and see Yahoo, Google, and other hit the site (almost every day). I’ve checked the Webmasters Tools on Google and they confirm that they index the site, but the Bot Tracker shows nothing.
Using WP 2.3.0 (on dedicated windows server)
I tried the test crawler and it worked.
Should I uninstall and reinstall yet again? Is anyone else having similar problems?
Roland, You had mentioned removing Unix linefeeds when unpacking. How do I do that exactly? I don’t see anything that looks like a linefeed in the code.
Thanks for your help.
November 16th, 2007 at 4:45 pm
i get always this error message: (second try to isntall) thanks for helping me or fixing it!!
Warning: unlink(../cache/index.htm) [function.unlink]: Permission denied in …wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 41
Warning: session_start() [function.session-start]: Cannot send session cookie - headers already sent by (output started at …wp-content/plugins/bot-tracker/crawltrack/php/login.php:41) in …wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 136
Warning: session_start() [function.session-start]: Cannot send session cache limiter - headers already sent (output started at …wp-content/plugins/bot-tracker/crawltrack/php/login.php:41) in …wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 136
Warning: Cannot modify header information - headers already sent by (output started at …wp-content/plugins/bot-tracker/crawltrack/php/login.php:41) in …wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 153
November 19th, 2007 at 11:05 pm
Michael, have you tried to chmod 777 your wp-content/plugins/bot-tracker/crawltrack/cache/ directory & it’s contents?
November 23rd, 2007 at 7:04 pm
Dumb quesion;
What login is BotTracker asking for at the login screen?
Local DB?
WP login?
Some login at the Bot TRacker site?
November 23rd, 2007 at 8:15 pm
This looks ingenius. But I am not a programmer and I’m not sure what I’ve done wrong; I’m getting a number of error messages.
Warning: main(include/nocache.php): failed to open stream: No such file or directory in wp-content/plugins/bot-tracker/crawltrack/index.php on line 359
Warning: Cannot modify header information - headers already sent by (output started at wp-content/plugins/bot-tracker/crawltrack/index.php:359) in wp-content/plugins/bot-tracker/crawltrack/include/header.php on line 17
November 26th, 2007 at 9:33 pm
Bithead, there should be no login at all. You must have got something wrong, Please try to reinstall BotTracker.
November 26th, 2007 at 9:35 pm
Cao, please be sure, if you unzip locally, to upload all the files. Your plugin installation simply misses some required files.
November 27th, 2007 at 6:15 am
I have installed bot tracker, and now, when I went to check for some results (a couple of days into it) it is asking me for a user name and password.
I don’t recall putting one in, nor do I recall it asking for one before…
How do I remedy this?
Please Email me the response too, or notify me you made one???
November 29th, 2007 at 11:58 pm
Brilliant plugin thanks! I also wanted to say thanks for your backup plugin which is exactly what i needed and seems to be the best backup plugin for WordPress. Loving the automated and email features
Cheers again for your time and efforts in sharing these with us, much appreciated thanks.
November 30th, 2007 at 3:38 am
I have this installed. However, I first installed it on an offline address so I could work on setting up the site while/before I had decided on the URL and set that all up with my server/provider.
Now that I have set up the permanent URL, I am noticing that in the control panel (under dashboard) for Bottracker that it still says the old offline setup URL. And I never set that URL to anything.
Anyway, it says you can change this in the Bottracker tools, and I did so, and it said that the new URL was added to the user database, but it still says the old URL and does not allow for the new URL in any way.
What do I need to do the change this? I even uninstalled (deleted from directory) BotTracker and reinstalled it (uploaded a clean version back into Wordpress)…
November 30th, 2007 at 7:42 am
Tim, thanks a lot for your comment! I am happy to hear that my stuff works fo you. cheers, rr
December 19th, 2007 at 8:34 pm
since dec 12 bot says no crawlers. from what I see at google this is unlikely. what happened? How cn I find out?
December 21st, 2007 at 4:57 am
I show no bots since Dec 12, while many every day before that, is there a configuration problem? How can I find out?
December 21st, 2007 at 7:00 pm
hm; hard to tell. Have you tried to reinstall allready?
December 27th, 2007 at 8:55 pm
Hello,
I installed this plugin some time ago. After some time, I noted that when viewing site visits with the plugin “wassup” that spiders were visiting my site, but bot tracker was not showing them. So, what I did was deactivate, remove it (via FTP) from the files, and remove the databases with phpMyAdmin.
Now I have reinstalled the plugin, and activated it. But, I don’t see any databases at all in phpMyAdmin.
Do/should these databases generate automatically when it is installed and activated? Or does it create databases on the fly when it gets a “hit”?
December 30th, 2007 at 11:34 pm
Warning: unlink(../cache/index.htm): Permission denied in /home/www/web2/html/blog/wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 41
Warning: Cannot modify header information - headers already sent by (output started at /home/www/web2/html/blog/wp-content/plugins/bot-tracker/crawltrack/php/login.php:41) in /home/www/web2/html/blog/wp-content/plugins/bot-tracker/crawltrack/php/login.php on line 158
This is my Problem after Installation need help please
January 3rd, 2008 at 4:45 pm
I have installed his about 5-6 weeks ago. Submitted site for search engine indexing then too. No visits since. I have the correct URL in the database for the site. When I use a test crawler, nothing happens when I visit the site.
Safari, Wordpress 2.3.1.
Please let me know how I can verify this is set up right or working???
January 3rd, 2008 at 4:50 pm
Steve, create an empty directory named “cache” inside of wp-content/plugins/bot-tracker/crawltrack/ and chmod it tom 777. Also, check out our forum if you run into any further troubles
January 3rd, 2008 at 5:02 pm
RB, the crawltrack database for Bot-Tracker should be initialized on plugin activation. Maybe some other plugin or htaccess-entry is preventing Bot-Tracker from logging crawlers? I am running Wassup AND Bot-Tracker with no problems whatsoever.
January 13th, 2008 at 2:47 am
I just installed the Bot Tracker w/ 2.3.2. Had to change permissions on cache folder to 777, but everything seemed to work fine and it even performed an upgrade. Can’t wait to see what this sucker picks up.
February 16th, 2008 at 10:10 pm
Hi, I installed your lastest version of wordpress 2.33. I changed the permissions on the cache folder to 777.
I know I have had bot visits but nothing is reflected in Bot Tracker. I am running usersonline so I know I have had bot visits. Also the bot didn’t show up either.
No error codes or anything unusual it just doesn’t seem to work. Please advise if you get a moment.
Thank you.
PS, I checked the forum and didn’t see anything there that would help…
February 16th, 2008 at 10:11 pm
Sorry the first sentence should read ‘I installed your latest version ON wordpress 2.33.
February 18th, 2008 at 9:54 pm
Patrick, have you tried the test crawler that comes with cr@wltrack?
February 20th, 2008 at 6:33 pm
Yes I have…
February 21st, 2008 at 8:50 am
seems wordpress changed the download links i cant open the link please advise
February 21st, 2008 at 8:41 pm
QueenEve, Thanks for the hint! Download links are corrected…
February 21st, 2008 at 8:54 pm
Patrick, if the test crawler works ad you see some entries, cr@wltr@ck is recording. Additional you could set up c@wltr@ck as a standalone application from scratch…
June 17th, 2008 at 1:44 pm
I was looking for something like this desperately and it is more then what I expected. Well done!
I am using in Wordpress 2.5 and it’s working fine.
Thanks
July 16th, 2008 at 11:13 pm
I like this plugin. Now i installed this on my new Wordpress blog an anything works great. This Plugin is a must for new blogs.