nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-04 10:09:14 +00:00

250 lines
2.6 KiB
Text

80legs
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Anarchy99
BDCbot
BDFetch
BackStreet
Backlink-Ceck
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
BlowFish
Boardreader
Bolt
Brandwatch
Buck
BuiltBotTough
BuiltWith
CATExplorador
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cocolyzebot
Cogentbot
Copier
Copyscape
Craftbot
CrunchBot
DTS Agent
Deusu
Devil
DigitalPebble
Dirbuster
Discoverybot
DomainAppender
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EroCrawler
ExtLinksBot
FHscan
FlashGet
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
GetRight
Go-Ahead-Got-It
GrapeFX
HTMLparser
HaosouSpider
IRLbot
IndeedBot
InfoNaviRobot
InterGET
JOC Web Spider
JennyBot
JetCar
Jetty
Jorgee
JustView
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
LibWeb
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkpadBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Mojolicious
Mozlila
Mr.4x3
Name Intelligence
NearSite
Nessus
NetLyzer
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nutch
Offline Navigator
OpenVAS
Openfind
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Panscient
PictureFinder
PleaseCrawl
ProWebWalker
Psbot
Pump
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
Re-re
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scrapy
ScreenerBot
Searchestate
SemanticJuice
SentiBot
Seomoz
Siphon
SiteLockSpider
SiteSnagger
Sitebeam
SmartDownload
SocialRankIOBot
Sosospider
Spanner
Spbot
Spinn3r
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
Telesphoreo
Thumbor
Titan
Trendiction
True_Robot
Turingos
TwengaBot
Twice
UnisterBot
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fuck
WebAuto
WebEnhancer
WebFuck
WebImageCollector
WebSauger
WebStripper
WebWhacker
WebZIP
Webalta
Webshag
WebsiteQuester
Whacker
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zitebot
ZoomBot
ZyBorg
autoemailspider
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
crawler4j
eCatch
facebookscraper
gopher
heritrix
isitwp.com
magpie-crawler
page scorer
ripz
s1z.ru
scan.lol
seobility
seocompany.store
seoscanners
serpstatbot
siteripz
sp_auditbot
tAkeOut
trendiction.com
webgains-bot
webmeup-crawler
xpymep1.exe