nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-08 22:08:16 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
AIBOT
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alligator
Ankit
Anthill
Asterias
Atomseobot
Attach
BBBike
BDCbot
Badass
Bandit
Bigfoot
BlackWidow
Blackboard
Boardreader
BotALot
Brandprotect
BuiltBotTough
BuiltWith
Bullseye
CCBot
CensysInspect
CheTeam
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
DIIbot
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
Disco
Dispatch
DnyzBot
DomainSigmaCrawler
Domains Project
Download Wonder
EMail Wolf
EasyDL
Ecxi
Exabot
Express WebPictures
Extractor
EyeNetIE
Ezooms
FDM
FHscan
Foobot
Freeuploader
FyberSpider
GetRight
Gigabot
GoZilla
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Heritrix
Hloader
Humanlinks
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
JamesBOT
JennyBot
JetCar
Joomla
Jorgee
LWP::Simple
LeechGet
LexiBot
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkScan
Linkbot
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
MarkMonitor
MarkWatch
Mb2345Browser
MeanPath Bot
Meanpathbot
Mister PiX
Mojeek
Mojolicious
Mozlila
Mr.4x3
Musobot
NPbot
Name Intelligence
NearSite
Net Vampire
NetMechanic
Nettrack
NextGenSearchBot
Ninja
Nmap
Not
Nutch
OpenLinkProfiler
OpenVAS
Openfind
OutclicksBot
OutfoxBot
PageAnalyzer
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Pixray
ProPowerBot
ProWebWalker
Pu_iN
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankurBot
Re-re
RebelMouse
RedesScrapy
RepoMonkey
SEOstats
SMTBot
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Snake
SocialRankIOBot
Sogou web spider
Sosospider
SpankBot
Spinn3r
SputnikBot
Sucker
SuperHTTP
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
True_Robot
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
V-BOT
VCI
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Fuck
Web Pix
WebCopier
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebmasterWorldForumBot
Who.is Bot
Widow
Wonderbot
Xenu
ZyBorg
arquivo.pt
check1.exe
clark-crawler
coccocbot
com.plumanalytics
dataforseo.com
demandbase-bot
iubenda-radar
linkdexbot
lwp-request
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
ripz
s1z.ru
seocompany.store
seostar
serpstatbot
sitechecker.pro
spyfu
sysscan
xpymep1.exe
zgrab