nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-08 22:08:40 +00:00

250 lines
2.6 KiB
Text

404enemy
ALittle Client
Aboundex
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Anarchy
Aspiegel
Attach
AwarioRssBot
BBBike
BDFetch
BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
BlackWidow
BlowFish
Brandprotect
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CODE87
CSHttp
Calculon
CensysInspect
Chlooe
Cocolyzebot
Cogentbot
Collector
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
Crescent
CrunchBot
DIIbot
DSearch
DTS Agent
Demon
DigitalPebble
Dirbuster
Discobot
Dispatch
DnyzBot
DomainCrawler
DomainStatsBot
Dotbot
ECCP/1.0
EasyDL
Ecxi
Evil
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FlashGet
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
Go!Zilla
GoZilla
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
Haansoft
Havij
Hloader
HybridBot
IDBTE4M
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
JOC Web Spider
JennyBot
JustView
Kinza
Kozmosbot
Lanshanbot
LexiBot
LibWeb
Libwhisker
Likse
LinkScan
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MSFrontPage
Magnet
Majestic SEO
Majestic12
MarkWatch
MeanPath Bot
Microsoft URL Control
Mister PiX
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Navroad
NearSite
Needle
Nessus
Net Vampire
NetAnts
NetZIP
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Octopus
OpenLinkProfiler
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Papa Foto
Picscout
Picsearch
Probethenet
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot2
RealDownload
Reaper
RebelMouse
RedesScrapy
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
Sitebeam
Snapbot
Sociscraper
SpaceBison
Spinn3r
SputnikBot
Sqlmap
Steeler
Stripper
Sucuri
SuperBot
Swiftbot
Szukacz
T0PHackTeam
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toata
Tracemyfile
Trendiction
Turingos
TwengaBot
V-BOT
VCI
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WASALive-Bot
WPScan
WWW-Collector-E
WallpapersHD
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebFuck
WebGo IS
WebImageCollector
WebReaper
WebSauger
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whack
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xenu
YoudaoBot
Zauba
ZmEu
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
cognitiveseo
crawler.feedback
demandbase-bot
facebookscraper
gopher
instabid
internetVista monitor
magpie-crawler
meanpathbot
muhstik-scan
plumanalytics
probe-image-size
scalaj-http
sexsearcher
sitechecker.pro
sogouspider
spyfu
trendiction.de
voyagerx.com
xpymep1.exe
zauba.io