06-16-2017, 07:49 AM
Hello.
As I'm new, I'm still learning what I can about userspice. I haven't found anything that addresses this subject.
Issue: I've noticed in my log a constant logging of certain IPs and did some research and noticed they are the search engine web crawlers. I'd like the log to omit entries of known bots (google, amazon, etc.)
Thoughts: I was thinking of exploring the tomfool php file and support files to see if I could put an exception in but before hand, was interested in seeing if any others have done this already. Another thought is to explore code in the htaccess files in select directories to block bots from scanning those directories.
Your thoughts? Thank you for any insight you can provide on this. I just dont want my log bloated with bot hits.
JDM
As I'm new, I'm still learning what I can about userspice. I haven't found anything that addresses this subject.
Issue: I've noticed in my log a constant logging of certain IPs and did some research and noticed they are the search engine web crawlers. I'd like the log to omit entries of known bots (google, amazon, etc.)
Thoughts: I was thinking of exploring the tomfool php file and support files to see if I could put an exception in but before hand, was interested in seeing if any others have done this already. Another thought is to explore code in the htaccess files in select directories to block bots from scanning those directories.
Your thoughts? Thank you for any insight you can provide on this. I just dont want my log bloated with bot hits.
JDM