nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-07 22:07:07 +00:00

250 lines
2.5 KiB
Text

80legs
ADmantX
ALittle Client
Aboundexbot
AhrefsBot
Aipbot
Alligator
Anarchy99
BDFetch
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
Black Hole
Blackboard
Blow
Brandwatch
Buck
BunnySlippers
CATExplorador
CODE87
CensysInspect
CheTeam
CheeseBot
CherryPicker
Citoid
Claritybot
Collector
Copier
Copyscape
Cosmos
Craftbot
Crescent
DataCha0s
DatabaseDriverMysqli
Deusu
DigitalPebble
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Extractor
FemtosearchBot
Fimap
Firefox/7.0
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler
Go!Zilla
GrabNet
GrapeFX
GridBot
HMView
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
HonoluluBot
IDBTE4M
Iblog
Id-search
Image Fetch
IndeedBot
InfoNaviRobot
InternetSeer
Iria
Iskanie
JustView
Jyxobot
Kinza
LWP::Simple
Lanshanbot
LeechGet
LexiBot
Lftp
Libwhisker
Likse
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic12
Masscan
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Minefield
Mojolicious
MolokaiBot
Mr.4x3
Musobot
Navroad
Nessus
NetAnts
NetZIP
Netvibes
Nikto
NimbleCrawler
Ninja
Not
Octopus
OnCrawl
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
Re-re
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
SEOkicks
SEOprofiler
SMTBot
ScanAlert
ScoutJet
Screaming
ScreenerBot
Searchestate
Seekport
SemanticJuice
Seomoz
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitevigil
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
Spbot
Sqlmap
Sucker
Sucuri
SuperBot
Surfbot
Suzuran
Szukacz
T0PHackTeam
TeleportPro
Telesoft
Telesphorep
The Intraformant
Titan
Toata
TwengaBot
Twice
UnisterBot
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
Voil
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WallpapersHD
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebAuto
WebBandit
WebFetch
WebPix
WebReaper
WebSauger
WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zade
Zauba
Zitebot
ZmEu
ZoominfoBot
ZyBorg
adscanner
arquivo.pt
cognitiveseo
com.plumanalytics
evc-batch
magpie-crawler
muhstik-scan
pcBrowser
plumanalytics
s1z.ru
scalaj-http
seobility
seocompany.store
seoscanners
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.de
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zgrab