Member
245 posts
Registered:
Jan 2006
Take a look at this url:
http://pfodere.com/pfo/QWCD-URL-Updated--a.html?a=35f71e290f6155a58e9b717bbad3ff52
Then...
http://quakeworld.nu/forum/viewtopic.php?id=1908
Why?
Member
115 posts
Registered:
Mar 2006
is that you raket in that pic ? :>
one of the good guys! so please don't ban - jogi.netdome.biz
Member
1026 posts
Registered:
Feb 2006
wtf is this supposed to be?
Member
1011 posts
Registered:
Feb 2006
http://en.wikipedia.org/wiki/Internet_bot
"Web site scrapers that grab the content of web sites and re-use it without permission on automatically generated doorway pages"
Member
1011 posts
Registered:
Feb 2006
p.s. http://en.wikipedia.org/wiki/Robots_Exclusion_Standard
but be careful not to disallow everything, as it is still useful to be able to find forum posts via google
Member
1732 posts
Registered:
Jan 2007
Member
1101 posts
Registered:
Jan 2006
Do those exploiting/harvesting robots actually abide a robots.txt?
Administrator
1864 posts
Registered:
Feb 2006
Haha, i'm called miki there, and damn do i look gay.
But i don't think that they care about robots.txt
Member
245 posts
Registered:
Jan 2006
Haha i like the ugly pic of me.
Member
245 posts
Registered:
Jan 2006
is that you raket in that pic ? :>
ROFL.
News