nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-01 22:07:35 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ADmantX
AIBOT
Abonti
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchie
Ankit
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
BackStreet
Barkrowler
Battleztar Bazinga
Bigfoot
BlackWidow
Blow
Bolt
BotALot
Brandprotect
BuiltBotTough
BunnySlippers
CCBot
CazoodleBot
Chlooe
Citoid
Claritybot
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Custo
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Dirbuster
Disco
Discobot
DittoSpyder
DomainCrawler
DomainStatsBot
EasyDL
Ebingbong
ExtLinksBot
ExtractorPro
EyeNetIE
Firefox/7.0
Flunky
Foobot
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
Getintent
GrabNet
Grafula
HEADMasterSEO
HTTrack
Haansoft
Havij
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
Id-search
Image Fetch
Intelliseek
InterGET
Iskanie
JamesBOT
Jbrofuzz
JennyBot
Jetty
JustView
Jyxobot
Kinza
LWP::Simple
Larbin
Leap
LeechFTP
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MIIxpc
MJ12bot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
MolokaiBot
Mr.4x3
Musobot
NPbot
Name Intelligence
Navroad
Needle
Nessus
NetSpider
NetZIP
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
Picsearch
Piepmatz
Pimonster
PleaseCrawl
Pockey
ProPowerBot
PyCurl
Quick-Crawler
RankActiveLinkBot
Rankivabot
RealDownload
Reaper
RedesScrapy
Ripper
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scrapy
Screaming
ScrepyBot
Searchestate
Seekport
Semrush
SentiBot
Shodan
Siphon
SiteExplorer
SiteSucker
Siteimprove
Snapbot
Sociscraper
Spammen
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqworm
Sucker
Suzuran
Swiftbot
Telesphoreo
True_Robot
Turingos
URLy Warning
VB Project
Vacuum
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebBandit
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebSauger
WebStripper
WebWhacker
WebsiteQuester
Webster
Whack
Whatweb
Widow
Zermelo
Zitebot
ZmEu
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
backlink-check
check1.exe
crawler.feedback
evc-batch
gopher
ips-agent
lwp-trivial
mediawords
muhstik-scan
polaris version
ripz
scalaj-http
seocompany.store
seoscanners
sogouspider
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io