nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-25 22:07:16 +00:00

250 lines
2.5 KiB
Text

360Spider
404enemy
AIBOT
ALittle Client
Abonti
Aboundex
Anarchie
Aspiegel
Asterias
Atomseobot
BBBike
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Blackboard
Boardreader
Brandprotect
Buck
Buddy
BuiltWith
BunnySlippers
CODE87
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Cosmos
Craftbot
CrunchBot
Curious
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Discobot
DnyzBot
DomCopBot
Dotbot
Drip
EMail Wolf
EasyDL
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
Fimap
FrontPage
GermCrawler
GetRight
Gigabot
GoZilla
Gotit
Grabber
Grafula
HMView
Haansoft
Heritrix
Humanlinks
Iblog
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
InterGET
Iria
Iskanie
JennyBot
Jetty
Jorgee
Kenjin Spider
Kozmosbot
LexiBot
LibWeb
Likse
LinkScan
Linkbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MIIxpc
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Mata Hari
MauiBot
MeanPath Bot
Metauri
MolokaiBot
Morfeus Fucking Scanner
Msrabot
Musobot
Nameprotect
NearSite
Needle
NetSpider
Nettrack
Nibbler
Niki-bot
Nimbostratus
Nuclei
Nutch
Octopus
OpenVAS
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PageGrabber
PageThing.com
Pandalytics
Pavuk
Petalbot
Piepmatz
Pixray
PleaseCrawl
Pump
RankFlex
RankingBot2
Rankivabot
Re-re
ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
Spammen
Sqlworm
Sqworm
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Telesphorep
The Intraformant
TheNomad
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turnitin
TwengaBot
Twice
Typhoeus
VCI
VelenPublicWebCrawler
WASALive-Bot
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Pix
Web Sucker
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebSucker
WebWhacker
Webshag
Webster
Whatweb
Who.is Bot
Widow
Xaldon_WebSpider
Xenu
Zade
Zauba
Zitebot
ZmEu
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
clark-crawler
coccocbot
dataforseo.com
evc-batch
gopher
instabid
internetVista monitor
ips-agent
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
muhstik-scan
netEstate NE Crawler
plumanalytics
polaris version
probe-image-size
ripz
satoristudio.net
seobility
seocompany.store
seostar
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webprosbot
x09Mozilla