nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-23 10:09:21 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
ADmantX
AIBOT
ASPSeek
Acunetix
Anarchy
Anthill
Asterias
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot
BackWeb
Battleztar Bazinga
Bitacle
BlowFish
Bolt
BotALot
Buck
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
CODE87
CheTeam
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
Copyscape
Curious
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Digincore
Disco
Discobot
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Drip
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
Fimap
FlashGet
Flunky
Foobot
GetWeb
Getintent
Gotit
Grabber
HMView
HaosouSpider
HonoluluBot
IndeedBot
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Joomla
Jorgee
JustView
Jyxobot
Larbin
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
MFC_Tear_Sample
MIDown tool
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
Microsoft URL Control
Mojeek
Musobot
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
NetZIP
Nettrack
Niki-bot
Ninja
Not
Nutch
Octopus
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Psbot
QueryN Metasearch
Quick-Crawler
RankActive
Rankivabot
ReGet
RebelMouse
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
Scanbot
Screaming
ScreenerBot
Searchestate
SemanticJuice
Semrush
SemrushBot
SentiBot
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snake
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
Spbot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Sucker
Sucuri
Swiftbot
T8Abot
Teleport
The Intraformant
Thumbor
TightTwatBot
Toata
Tracemyfile
Trendiction
Trendictionbot
Turnitin
Twice
UnisterBot
VCI
Vagabondo
VeriCiteCrawler
Virusdie
Voltron
WBSearchBot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Auto
Web Fuck
Web Sucker
WebAuto
WebBandit
WebCollage
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebSauger
Webalta
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
Xenu
Zermelo
ZumBot
archive.org_bot
autoemailspider
backlink-check
check1.exe
clark-crawler
crawler4j
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
isitwp.com
lwp-trivial
meanpathbot
muhstik-scan
page scorer
pcBrowser
probe-image-size
scalaj-http
scan.lol
seobility
seocompany.store
serpstatbot
sogouspider
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
zauba.io