nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-18 22:07:55 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
Abonti
AfD-Verbotsverfahren
Alexibot
AllSubmitter
AlphaBot
Asterias
Attach
AwarioSmartBot
BackWeb
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlackWidow
Blackboard
Blow
BlowFish
Brandprotect
Buck
Buddy
BuiltBotTough
Bullseye
CSHttp
Cegbfeieh
CensysInspect
Citoid
Claritybot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Curious
DBLBot
DTS Agent
DataCha0s
Demon
Digincore
DigitalPebble
Discobot
Discoverybot
DomainStatsBot
Domains Project
Dotbot
Drip
ECCP/1.0
EMail Siphon
Ebingbong
EroCrawler
Evil
FHscan
Fuzz
FyberSpider
Genieo
GetRight
Go!Zilla
Go-Ahead-Got-It
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
Harvest
Havij
Hloader
IDBot
Iblog
IlseBot
IndeedBot
Indy Library
InterGET
JOC Web Spider
JamesBOT
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LeechFTP
Libwhisker
LieBaoFast
Likse
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
Magnet
Mass Downloader
Mata Hari
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
MolokaiBot
Mozlila
Mr.4x3
Musobot
NPbot
Nessus
Net Vampire
NetAnts
NetMechanic
NetSpider
NetZIP
Netcraft
Niki-bot
Nimbostratus
Nuclei
Offline Navigator
OnCrawl
OrangeSpider
OutclicksBot
PHPCrawl
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Pavuk
Petalbot
Picscout
Piepmatz
PleaseCrawl
Psbot
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Re-re
ReGet
Recorder
RepoMonkey
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScreenerBot
SearchmetricsBot
SemanticJuice
SemrushBot
SiteExplorer
SiteSucker
Siteimprove
SmartDownload
Snake
Snoopy
Sociscraper
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqworm
Stripper
Sucker
Sucuri
SuperBot
SurveyBot
Telesoft
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
VCI
VelenPublicWebCrawler
VidibleScraper
Voltron
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers
Web Auto
Web Fuck
WebBandit
WebFuck
WebLeacher
WebPix
WebReaper
WebSauger
WebWhacker
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
Zeus
Zitebot
ZoomBot
ZumBot
backlink-check
clark-crawler
com.plumanalytics
dataforseo.com
demandbase-bot
instabid
internetVista monitor
isitwp.com
iubenda-radar
linkdexbot
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
scalaj-http
scan.lol
seocompany.store
seoscanners
sitechecker.pro
spyfu
sysscan
trendiction.de
webgains-bot
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe