nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-30 22:07:10 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ADmantX
ASPSeek
Aboundexbot
Acunetix
Alexibot
Anarchie
Anarchy
Ankit
Anthill
Aspiegel
Atomseobot
Attach
AwarioSmartBot
BBBike
BLEXBot
BackStreet
Backlink-Ceck
Badass
BatchFTP
Battleztar Bazinga
Bigfoot
BlowFish
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CCBot
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Chlooe
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Cosmos
Craftbot
Crescent
CrunchBot
DSearch
DataCha0s
Deusu
Digincore
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
EMail Wolf
EasyDL
Ecxi
EirGrabber
Exabot
EyeNetIE
FHscan
Fimap
FlashGet
Foobot
FrontPage
Fyrebot
G-i-g-a-b-o-t
Getintent
Gotit
Grafula
GridBot
HMView
Haansoft
Harvest
Havij
Heritrix
HonoluluBot
Humanlinks
IndeedBot
InfoNaviRobot
InterGET
InternetSeer
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Jorgee
Jyxobot
Keybot Translation-Search-Machine
LNSpiderguy
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIIxpc
MSIECrawler
MTRobot
Mail.RU_Bot
MarkMonitor
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Mojolicious
Mr.4x3
Navroad
NearSite
NetAnts
NetLyzer
NetMechanic
Nettrack
Nibbler
Nimbostratus
Nmap
Not
Nuclei
Octopus
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
PageThing.com
Pandalytics
Pavuk
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Probethenet
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankFlex
RankingBot2
RankurBot
ReGet
Reaper
RebelMouse
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SalesIntelligent
Scrapy
Screaming
Seekport
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
Siteimprove
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
SpaceBison
Spammen
Sqlmap
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
Suzuran
T0PHackTeam
TheNomad
Titan
Tracemyfile
True_Robot
Turnitin
TwengaBot
Typhoeus
VB Project
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Collector-E
Wallpapers
WeSEE
Web Fetch
Web Sucker
WebFetch
WebImageCollector
WebLeacher
WebStripper
Webshag
WebsiteQuester
Widow
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
ZmEu
ZoomBot
ZumBot
check1.exe
coccocbot
crawler.feedback
dataforseo.com
domainsproject.org
facebookscraper
gopher
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-trivial
magpie-crawler
muhstik-scan
oBot
plumanalytics
seobility
seostar
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sp_auditbot
spyfu
voyagerx.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla