nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-21 10:07:00 +00:00

100 lines
1.1 KiB
Text

360Spider
AIBOT
AfD-Verbotsverfahren
AllSubmitter
Anarchie
Anarchy99
Anthill
BDFetch
BackDoorBot
Bigfoot
Blow
Bolt
Brandwatch
CSHttp
Calculon
Cloud mapping
CopyRightCheck
Copyscape
CrunchBot
Curious
DBLBot
DIIbot
Dragonfly
Drip
Ebingbong
Express WebPictures
ExtractorPro
FDM
Freeuploader
FyberSpider
HMView
Heritrix
Hloader
IDBot
InterGET
Jbrofuzz
Jyxobot
LWP::Simple
LeechGet
Likse
LinkextractorPro
LinqiaRSSBot
Litemage_walker
MQQBrowser
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Net Vampire
Octopus
OnCrawl
OpenLinkProfiler
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
Pi-Monster
PleaseCrawl
Proximic
PxBroker
Quick-Crawler
RankActiveLinkBot
RankingBot
Reaper
RocketCrawler
Rogerbot
SEOlyticsCrawler
ScoutJet
Searchestate
SentiBot
SeoSiteCheckup
SiteLockSpider
Siteimprove
Snapbot
Spinn3r
Sucker
Swiftbot
Turnitin
UnisterBot
VoidEYE
WISENutbot
WPScan
WeSEE
Web Auto
WebSauger
Whacker
Wprecon
arquivo.pt
coccocbot
crawl.sogou.com
facebookscraper
magpie-crawler
oBot
pcBrowser
ripz
s1z.ru
satoristudio.net
zauba.io