nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-09 22:07:15 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
ADmantX
AIBOT
ALittle Client
ASPSeek
AllSubmitter
Alligator
AlphaBot
Anthill
Apexoo
Aspiegel
Asterias
AwarioSmartBot
BDCbot
BackStreet
BackWeb
BacklinkCrawler
Bandit
Battleztar Bazinga
Black Hole
BlackWidow
Boardreader
BotALot
CATExplorador
CCBot
CazoodleBot
CheeseBot
Claritybot
Cogentbot
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
CyotekWebCopy
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
DigitalPebble
Discobot
DnBCrawler-Analytics
DomainAppender
DomainCrawler
Domains Project
Dragonfly
ECCP/1.0
Ecxi
EirGrabber
EroCrawler
Evil
ExtLinksBot
ExtractorPro
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
Flunky
Fuzz
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Gotit
Grabber
HMView
HTTP::Lite
HTTrack
HonoluluBot
IDBot
Image Sucker
Intelliseek
Internet Ninja
JamesBOT
JennyBot
Jetty
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
Larbin
Leap
LeechGet
Lftp
LibWeb
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey
Litemage_walker
Lmspider
MIIxpc
MQQBrowser
MTRobot
Magnet
Majestic SEO
Mass Downloader
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Mojeek
MolokaiBot
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO
Nameprotect
NearSite
Nessus
Net Vampire
NetLyzer
Nibbler
Nikto
Nimbostratus
Ninja
Not
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeBot
PageThing.com
Pandalytics
Panscient
PeoplePal
Picscout
Picsearch
PictureFinder
Pockey
ProPowerBot
Probethenet
PxBroker
PyCurl
Rankivabot
Re-re
SEOkicks
SEOkicks-Robot
SISTRIX
ScanAlert
ScoutJet
Scrapy
Screaming
ScrepyBot
Semrush
SentiBot
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Siteimprove
SlySearch
Snake
Sociscraper
Sogou web spider
SpankBot
Spanner
Spbot
SputnikBot
Sqlmap
Stripper
Surfbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
TurnitinBot
TwengaBot
Twice
URLy Warning
UnisterBot
Upflow
V-BOT
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW-Mechanize
WallpapersHD
WeSEE
Web Enhancer
Web Fuck
WebCollage
WebCopier
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebPix
WebSauger
WebSucker
WebsiteQuester
Webster
Whack
Whatweb
Widow
Wotbox
Xaldon WebSpider
Zade
Zermelo
Zeus
ZumBot
adscanner
archive.org_bot
arquivo.pt
clark-crawler
crawler.feedback
demandbase-bot
gopher
instabid
ips-agent
iubenda-radar
linkdexbot
lwp-trivial
muhstik-scan
page scorer
polaris version
satoristudio.net
scalaj-http
seocompany.store
seostar
sexsearcher
sogouspider
sp_auditbot
tAkeOut
webpros.com
webprosbot
x22Mozilla