|
¿What is PWeBot and why visits my page?
PWeBot is a webcrawler that surfs the net for useful information
under user demand.
Eventually it stores web pages keywords for our search engine and follows page links.
¿How can I prevent PWeBot?
Like the most robots, PWeBot obeys the
robots.txt
exclusion protocol
you can ban this robot from your site or a part of it using the user-agent
pwebot in your robots.txt file.
When working under user demand in one of our web analysis tools will not obey robots.txt, but will also not store any information or follow any link. |
|
|
Versión en español