nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-10 10:07:14 +00:00

100 lines
1,003 B
Text

01h4x.com
404enemy
80legs
ASPSeek
BBBike
BacklinkCrawler
BatchFTP
Blackboard
Bolt
Buck
BuiltWith
Calculon
CheeseBot
Citoid
Claritybot
Cogentbot
CopyRightCheck
Copyscape
CyotekWebCopy
DIIbot
DatabaseDriverMysqli
Demon
Deusu
Devil
DomainStatsBot
EirGrabber
FDM
Freeuploader
HonoluluBot
Image Fetch
InterGET
Jbrofuzz
JetCar
Jetty
Larbin
Leap
LinksManager
Lipperhey
Litemage_walker
MFC_Tear_Sample
Mata Hari
MeanPath Bot
MegaIndex.ru
Mister PiX
MolokaiBot
Mr.4x3
Nameprotect
NetMechanic
Nibbler
Niki-bot
OutfoxBot
PECL::HTTP
Papa Foto
PleaseCrawl
Pockey
Probethenet
Psbot
RSSingBot
RankurBot
RedesScrapy
SEOlyticsCrawler
Screaming
Seekport
Seomoz
SiteExplorer
SiteSnagger
SmartDownload
Spinn3r
Sqworm
Swiftbot
TheNomad
Tracemyfile
Trendiction
Trendictionbot
Turnitin
Twice
Vacuum
Virusdie
WWWOFFLE
WebBandit
WebCollage
WebReaper
WebSauger
Webster
Whacker
Wprecon
Zade
ZoominfoBot
crawler4j
dataforseobot
demandbase-bot
gopher
heritrix
internetVista monitor
lwp-request
mediawords
oBot
openai
s1z.ru
sysscan