nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-11 10:09:27 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
Abonti
Aboundexbot
AfD-Verbotsverfahren
Alligator
Anarchie
Anarchy
Apexoo
Attach
BBBike
BDFetch
BackStreet
Backlink-Ceck
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
Boardreader
BotALot
Brandwatch
CCBot
Calculon
CheTeam
CherryPicker
ChinaClaw
Chlooe
Claritybot
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
DigitalPebble
Disco
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Exabot
EyeNetIE
FHscan
FrontPage
GT::WWW
GetRight
GetWeb
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Harvest
Hloader
Humanlinks
IDBTE4M
Id-search
IlseBot
Iria
JOC Web Spider
JetCar
JikeSpider
Jorgee
JustView
LWP::Simple
Lftp
Likse
Ltx71
MJ12bot
MQQBrowser
Mail.RU_Bot
Mass Downloader
Masscan
Mata Hari
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Mojolicious
Mozlila
Nameprotect
Nessus
NetSpider
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Octopus
Offline Explorer
Openfind
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Papa Foto
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
ProPowerBot
Psbot
PyCurl
RankActive
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
RedesScrapy
Ripper
RocketCrawler
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteSnagger
SiteSucker
Sitebeam
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
SpankBot
Sqlworm
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
Teleport
TeleportPro
Telesoft
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Turnitin
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow
VCI
Vagabondo
VoidEYE
Voil
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Auto
Web Fetch
Web Pix
Web Sucker
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebWhacker
Website Quester
WebsiteExtractor
WebsiteQuester
Widow
WiseGuys Robot
Woobot
Xenu
Zermelo
Zeus
ZmEu
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
cognitiveseo
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
probe-image-size
ripz
s1z.ru
scan.lol
seobility
seocompany.store
seostar
serpstatbot
siteripz
sogouspider
sp_auditbot
tAkeOut
trendiction.de
webgains-bot
webpros.com
webprosbot