nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-17 14:22:31 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Alligator
Anarchy99
Anthill
Apexoo
Aspiegel
Asterias
BDCbot
BLEXBot
BackDoorBot
BackStreet
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
BlowFish
Brandprotect
BuiltWith
BuzzSumo
CATExplorador
CSHttp
Chlooe
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Copyscape
Crescent
Curious
DIIbot
DTS Agent
DatabaseDriverMysqli
Devil
Dirbuster
Dispatch
DomCopBot
DomainSigmaCrawler
Drip
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
Evil
Express WebPictures
ExtLinksBot
FemtosearchBot
Firefox/7.0
FlashGet
Freeuploader
Fuzz
FyberSpider
GT::WWW
Genieo
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
Harvest
Heritrix
Humanlinks
HybridBot
IRLbot
Iblog
IlseBot
Indy Library
Internet Ninja
Iria
JamesBOT
JikeSpider
Jorgee
LNSpiderguy
LWP::Simple
LeechFTP
Lftp
Lightspeedsystems
LinkWalker
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Magnet
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Metauri
MicroMessenger
Mojolicious
Mozlila
NICErsPRO
NPbot
Nameprotect
Navroad
NearSite
Nessus
Net Vampire
NetAnts
NetLyzer
NetZIP
Nettrack
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nuclei
Nutch
Offline Navigator
OnCrawl
Openfind
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
Panscient
Pavuk
Picsearch
Piepmatz
Pixray
PleaseCrawl
Pockey
Probethenet
Psbot
Pu_iN
Pump
PxBroker
Quick-Crawler
RSSingBot
RankActive
RankingBot
Re-re
Ripper
SEOlyticsCrawler
SalesIntelligent
Scanbot
Screaming
ScrepyBot
SeobilityBot
Seomoz
Shodan
Site Sucker
Siteimprove
SlySearch
Snoopy
Sociscraper
Sottopop
Spinn3r
SputnikBot
Sqlworm
Sqworm
Sucker
Sucuri
Suzuran
T8Abot
Teleport
TeleportPro
Telesphorep
TheNomad
Thumbor
Titan
Trendiction
Trendictionbot
Turingos
TurnitinBot
URLy Warning
UnisterBot
VB Project
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
WISENutbot
WWWOFFLE
WeSEE
Web Enhancer
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebGo IS
WebReaper
WebSauger
WebSucker
Webalta
Webshag
WebsiteQuester
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xenu
Zade
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
arquivo-web-crawler
arquivo.pt
check1.exe
cognitiveseo
com.plumanalytics
demandbase-bot
facebookscraper
heritrix
instabid
internetVista monitor
lwp-request
lwp-trivial
netEstate NE Crawler
s1z.ru
seoscanners
seostar
siteripz
spyfu
voyagerx.com
zauba.io
zgrab