nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-13 10:09:07 +00:00

250 lines
2.6 KiB
Text

ADmantX
ALittle Client
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Anarchy
Anarchy99
Anthill
Apexoo
Asterias
BBBike
BDCbot
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Blackboard
BlowFish
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CSHttp
CheTeam
CheeseBot
Chlooe
Claritybot
Cocolyzebot
Collector
CopyRightCheck
Curious
Custo
DSearch
DataCha0s
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Discobot
DittoSpyder
DomainSigmaCrawler
Domains Project
Dotbot
Drip
ECCP/1.0
EasyDL
Exabot
Extractor
EyeNetIE
FDM
FHscan
Fimap
FlashGet
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Getintent
GoZilla
Grabber
HTTP::Lite
HTTrack
Harvest
Hloader
Iblog
Id-search
Image Fetch
IndeedBot
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
Iria
JOC Web Spider
Jyxobot
LWP::Simple
Larbin
LeechGet
LexiBot
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaRSSBot
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MSIECrawler
Mag-Net
Majestic-SEO
Majestic12
MarkWatch
Mb2345Browser
Meanpathbot
Minefield
Mr.4x3
Msrabot
Musobot
Navroad
NearSite
NetAnts
NetLyzer
Nibbler
Nikto
Nmap
Nuclei
OnCrawl
Openfind
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageScorer
PageThing.com
Picscout
Piepmatz
Pimonster
Pockey
PxBroker
Quick-Crawler
RSSingBot
RankFlex
RankurBot
ReGet
RealDownload
RebelMouse
Recorder
RepoMonkey
SBIder
SEOkicks
SEOstats
SalesIntelligent
Scanbot
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SemrushBot
SentiBot
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitebeam
SocialRankIOBot
Sogou web spider
SpankBot
Spanner
Spinn3r
Sqworm
Suzuran
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
The Intraformant
Toweyabot
Trendiction
Turnitin
URLy.Warning
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
WBSearchBot
WISENutbot
Wallpapers/3.0
Web Enhancer
Web Fuck
Web Pix
Web Sauger
WebBandit
WebCollage
WebGo IS
WebImageCollector
WebWhacker
Webshag
Website Quester
WebsiteExtractor
Whack
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
crawler.feedback
domainsproject.org
evc-batch
gopher
instabid
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
seocompany.store
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
sysscan
tAkeOut
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io