nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-02 10:09:35 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
ALittle Client
Aboundex
AwarioRssBot
BDFetch
Backlink-Ceck
Badass
Bandit
BatchFTP
BetaBot
Bigfoot
Bitacle
Black Hole
Blackboard
Blow
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
CODE87
CSHttp
Calculon
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cocolyzebot
Collector
Copier
Copyscape
Crawling at Home Project
Crescent
DBLBot
Demon
Deusu
Digincore
DigitalPebble
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
Domains Project
Dotbot
Download Wonder
Drip
EMail Wolf
EasyDL
Ecxi
EroCrawler
Evil
Express WebPictures
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
GridBot
HMView
HTMLparser
HTTP::Lite
HTTrack
HybridBot
IDBTE4M
IDBot
Id-search
Indy Library
InterGET
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JetCar
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Larbin
LeechFTP
LexiBot
Lftp
LinkScan
Linkbot
LinkpadBot
LinksManager
Lipperhey Spider
MQQBrowser
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Needle
Nessus
NetAnts
Niki-bot
Nikto
Ninja
Octopus
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PageAnalyzer
PageScorer
PageThing.com
PeoplePal
Petalbot
Pockey
Probethenet
Pump
PxBroker
Quick-Crawler
RSSingBot
RankingBot2
Rankivabot
ReGet
RealDownload
RedesScrapy
SEOkicks-Robot
ScanAlert
SeobilityBot
SiteCheckerBotCrawler
Siteimprove
SlySearch
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
Spbot
Spinn3r
Steeler
Stripper
Surfbot
Swiftbot
Telesphorep
The Intraformant
Toweyabot
Tracemyfile
Trendiction
Turingos
Turnitin
Twice
Upflow
VB Project
VelenPublicWebCrawler
VidibleScraper
Voil
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Enhancer
Web Fuck
WebAuto
WebFetch
WebFuck
WebWhacker
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
Widow
WinHTTrack
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
ZyBorg
arquivo.pt
check1.exe
clark-crawler
coccocbot
crawler.feedback
eCatch
evc-batch
heritrix
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
muhstik-scan
page scorer
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seobility
seocompany.store
seostar
sp_auditbot
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler
zauba.io
zgrab