nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-17 22:07:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Ankit
Atomseobot
Attach
AwarioSmartBot
BDFetch
BackDoorBot
Backlink-Ceck
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
BlackWidow
Blackboard
BotALot
Brandprotect
Buck
BuiltBotTough
Bullseye
CATExplorador
CCBot
CSHttp
CazoodleBot
CensysInspect
Citoid
Cogentbot
Collector
Crawling at Home Project
Custo
DSearch
DTS Agent
DatabaseDriverMysqli
Disco
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
ECCP/1.0
EasyDL
Evil
Exabot
Express WebPictures
EyeNetIE
Freeuploader
Fuzz
Gigabot
Go!Zilla
GoZilla
Gotit
Grabber
GridBot
HMView
HTTP::Lite
HaosouSpider
Humanlinks
Iblog
InfoTekies
Intelliseek
Internet Ninja
Iria
Jbrofuzz
Jetty
JikeSpider
JustView
Kinza
LNSpiderguy
LWP::Simple
Leap
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinkpadBot
Ltx71
MJ12bot
MSIECrawler
Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
MolokaiBot
Morfeus Fucking Scanner
Musobot
Nameprotect
NearSite
Nessus
Net Vampire
NetMechanic
Nibbler
NimbleCrawler
Not
Nuclei
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Pavuk
Picsearch
PictureFinder
Piepmatz
Pimonster
Pockey
Probethenet
Psbot
QueryN Metasearch
RSSingBot
RankurBot
Re-re
ReGet
Recorder
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
Scanbot
ScoutJet
Searchestate
SemanticJuice
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteSucker
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snapbot
Sociscraper
Sottopop
Spammen
SpankBot
Spanner
Spbot
SputnikBot
Sqworm
Steeler
SuperBot
SuperHTTP
Suzuran
Swiftbot
Szukacz
T8Abot
The Intraformant
Thumbor
Titan
Toata
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
V-BOT
VB Project
Vacuum
Vagabondo
VidibleScraper
VoidEYE
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
Web Collage
Web Fetch
WebAuto
WebCollage
WebFuck
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebmasterWorldForumBot
Website Quester
Whack
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Zauba
Zermelo
Zeus
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
gopher
heritrix
instabid
isitwp.com
linkdexbot
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
pcBrowser
plumanalytics
ripz
s1z.ru
scan.lol
seostar
serpstatbot
sitechecker.pro
siteripz
sogouspider
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zgrab