nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-21 08:39:58 +00:00

250 lines
2.6 KiB
Text

ASPSeek
Abonti
AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anthill
Aspiegel
Atomseobot
Attach
BBBike
BLEXBot
BackWeb
Badass
Bandit
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
Bolt
BotALot
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
CazoodleBot
CensysInspect
ChinaClaw
Cliqzbot
Cocolyzebot
Cogentbot
Collector
Cosmos
Craftbot
Curious
Custo
CyotekWebCopy
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
DittoSpyder
Drip
EMail Wolf
EirGrabber
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FemtosearchBot
FlashGet
Flunky
Foobot
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Gigabot
Gotit
HTMLparser
Hloader
HybridBot
IDBot
Id-search
IlseBot
InfoNaviRobot
Internet Ninja
Iskanie
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
Joomla
JustView
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
Lipperhey
Litemage_walker
Lmspider
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
Mb2345Browser
Meanpathbot
Metauri
MicroMessenger
Minefield
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Nameprotect
Navroad
Net Vampire
NetSpider
Netvibes
Nibbler
Nikto
Ninja
Openfind
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Panscient
Pavuk
Petalbot
Picscout
PictureFinder
Piepmatz
PleaseCrawl
ProWebWalker
Probethenet
Pu_iN
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
Reaper
RebelMouse
RocketCrawler
Rogerbot
SEOkicks-Robot
SMTBot
Scanbot
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
Siphon
SiteLockSpider
Siteimprove
SmartDownload
Snake
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
Sqworm
Stripper
Swiftbot
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
Thumbor
TwengaBot
URLy Warning
URLy.Warning
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WeSEE
Web Fetch
Web Pix
Web Sauger
WebAuto
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebWhacker
Webalta
Webshag
Website Quester
WebsiteQuester
Whacker
Whatweb
Woobot
Wotbox
Xenu
Zauba
Zeus
Zitebot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
coccocbot-web
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
instabid
ips-agent
iubenda-radar
lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
sysscan
tAkeOut
voyagerx.com
webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe