nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-06 22:07:12 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
AIBOT
Abonti
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
Ankit
Anthill
Apexoo
Asterias
AwarioSmartBot
BackWeb
Backlink-Ceck
Badass
BatchFTP
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Buck
Bullseye
CODE87
CazoodleBot
CensysInspect
ChinaClaw
Chlooe
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
Crescent
DIIbot
DatabaseDriverMysqli
Demon
Dirbuster
Disco
Discobot
DnyzBot
Download Wonder
ECCP/1.0
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
Firefox/7.0
Flunky
Foobot
Freeuploader
FyberSpider
GalaxyBot
GetRight
GetWeb
Go-Ahead-Got-It
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
HonoluluBot
HybridBot
IDBTE4M
IRLbot
Iblog
Id-search
IndeedBot
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Jetty
Jorgee
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
LibWeb
Libwhisker
Linkdexbot
LinkextractorPro
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MIIxpc
MJ12bot
Magnet
Mail.RU_Bot
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
Nessus
NetAnts
NetSpider
Netvibes
NextGenSearchBot
NimbleCrawler
Ninja
Nmap
OpenVAS
OrangeSpider
Page Analyzer
PageAnalyzer
Papa Foto
PeoplePal
Picscout
Picsearch
Pockey
ProPowerBot
Probethenet
Pump
PxBroker
RSSingBot
RankActiveLinkBot
Re-re
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Screaming
SearchmetricsBot
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SmartDownload
Snapbot
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
Sqworm
Stripper
Sucker
Sucuri
SuperBot
Suzuran
T8Abot
TheNomad
Titan
Toweyabot
Trendiction
True_Robot
Turnitin
TwengaBot
Twice
UnisterBot
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
Voil
WEBDAV
WWW-Mechanize
WWWOFFLE
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Sauger
Web Sucker
WebFetch
WebFuck
WebLeacher
WebSauger
WebWhacker
WebZIP
Webalta
WebsiteExtractor
Whack
Whatweb
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
coccocbot
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
iubenda-radar
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
plumanalytics
ripz
s1z.ru
satoristudio.net
seocompany.store
serpstatbot
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe