nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-18 10:09:26 +00:00

250 lines
2.7 KiB
Text

360Spider
ADmantX
ASPSeek
Acunetix
Aipbot
Anthill
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bitacle
Black Hole
BlackWidow
BotALot
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CODE87
Calculon
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Cogentbot
Copier
CopyRightCheck
Copyscape
Cosmos
Crescent
CrunchBot
Custo
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Evil
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
Fimap
Flunky
Foobot
Fuzz
Fyrebot
GalaxyBot
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
IlseBot
Indy Library
InfoNaviRobot
Internet Ninja
Iria
IstellaBot
JOC Web Spider
JikeSpider
Joomla
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LWP::Simple
Larbin
Leap
LeechGet
LibWeb
Lightspeedsystems
Linkbot
LinkpadBot
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mozlila
Msrabot
NPbot
NearSite
Nessus
Net Vampire
NetMechanic
Nettrack
Netvibes
Niki-bot
Nmap
Not
Offline Navigator
OpenLinkProfiler
OutclicksBot
OutfoxBot
Page Analyzer
Pandalytics
PeoplePal
Petalbot
Picscout
Picsearch
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
ReGet
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks
SEOstats
ScanAlert
ScrepyBot
SearchmetricsBot
Semrush
Seomoz
Siphon
SiteExplorer
SiteSnagger
SiteSucker
SlySearch
Sogou web spider
Spammen
SpankBot
Sqlmap
Sqworm
SuperBot
SurveyBot
T8Abot
Telesphoreo
True_Robot
Turnitin
TwengaBot
Twice
URLy.Warning
UnisterBot
Upflow
VB Project
VeriCiteCrawler
VidibleScraper
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
Web Pix
WebBandit
WebCopier
WebEnhancer
WebFetch
WebPix
WebSauger
WebStripper
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Whack
Who.is Bot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zeus
ZoominfoBot
arquivo-web-crawler
clark-crawler
com.plumanalytics
dataforseo.com
isitwp.com
iubenda-radar
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
polaris version
ripz
scalaj-http
scan.lol
seobility
seocompany.store
seostar
serpstatbot
sogouspider
trendiction.com
webmeup-crawler
webpros.com
zauba.io
zgrab