nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-10 10:06:52 +00:00

100 lines
1.1 KiB
Text

AwarioBot
AwarioSmartBot
BackWeb
Backlink-Ceck
Badass
Bitacle
Boardreader
Bullseye
BunnySlippers
CazoodleBot
ChatGPT-User
CheeseBot
ChinaClaw
Cloud mapping
Copier
Curious
Custo
Demon
Dispatch
Ebingbong
EyeNetIE
Fimap
Freeuploader
FyberSpider
GalaxyBot
Grabber
Grafula
HEADMasterSEO
HMView
Id-search
InfoNaviRobot
Internet Ninja
JennyBot
Jetty
JikeSpider
Jorgee
Kinza
LinkWalker
Litemage_walker
MQQBrowser
MarkWatch
MauiBot
MeanPath Bot
Meanpathbot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
Navroad
Octopus
Offline Explorer
Openfind
POE-Component-Client-HTTP
PageThing.com
Pavuk
Probethenet
RealDownload
SBIder
SearchmetricsBot
Seekport
SeekportBot
SiteExplorer
SiteSucker
SmartDownload
Snake
Snapbot
Sociscraper
T8Abot
TeleportPro
TurnitinBot
VB Project
Virusdie
WEBDAV
WWW::Mechanize
WallpapersHD
Web Sucker
WebBandit
WebCollage
WebImageCollector
Webalta
Webster
Whack
Whatweb
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
arquivo-web-crawler
crawler.feedback
evc-batch
facebookscraper
gopher
linkfluence
serpstatbot
sexsearcher
sitechecker.pro
spyfu
voyagerx.com
webpros.com
zgrab