Dungeon Master Forum

I just saw the following user logged on: "Google [Bot]". No profile.

What's that supposed to mean ?

It means google is indexing the site.

Which Gambit has said isn't supposed to happen...

Google is soooo Big Bro.

Of course. And moreover: If you type "Google" into Google, you can break the internet! Seriously. So - don't try it! Even for a fun!

Any spider can still see the root site, it's a free country.

What the spider can't do is hit every one of our subpages simultaneously to catalogue, that's where the spider block is

beowuuf wrote:Any spider can still see the root site, it's a free country.

What the spider can't do is hit every one of our subpages simultaneously to catalogue, that's where the spider block is

Spiders are icky, they don't deserve freedom!

If it's working as it's supposed to, though, that's good.

What Beo said.

Beo:

Any spider can still see the root site, it's a free country.

You mean UK? The site is located in Czech server

Jan, is Czech free?

It can't be that expensive to buy... You'd be paying for the vast quantities of alcohol mostly.

beowuuf wrote:Jan, is Czech free?

Yes, at least now. Depends on what Russians intend to do.

Are you suggesting to move our servers Beo?

Are you suggesting that Russians are coming back, Zyx? Boy, you must have better informations than me - are you in Mossad or something? Anyhow, I believe you!

*runs*

Our servers are through already through czech, zyx - equus/zpc hosted for cows, and now hosts for me

Yahoo [Bot] is on now. Related?

Just people are noticing it now it's pointed out. I'm on an obscene amount, and trust me, we get alot of bots! We got them back before phpbb3, just then they were invisible. Now, our board nows the IPs of these things and makes them visible to us.

So technically speaking we know they are bots through their IP? we could play a paranoia game here but I think it's better to listen to the stars (coming soon).

Jan: don't panic. I'm just asking.

Zyx wrote:Jan: don't panic. I'm just asking.

Why are the bots registered users though?

It's not very reassuring coming back to file share a game I worked hard on, to reading about hack ins recently and seeing bots around.

Bots are not registered users, but they are recognised by phpBB. Note that by bots we mean search bots (Googlebot, Yahoobot, etc.) not spam bots, so stop worrying

From the phpBB docs:

“Bots”, “spiders” or “crawlers” are automated agents most commonly used by search engines to update their databases. Since they rarely make proper use of sessions they can distort visitor counts, increase load and sometimes fail to index sites correctly. Here you can define a special type of user to overcome these problems.

We've disabled forum-wide searches by search bots, so none of the well behaved search bots can go beyond the index page -- which is why it can appear that they are all stuck there.

Spam bots on the other hand are a different problem.