nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-15 22:07:09 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
Aboundexbot
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy99
Anthill
Atomseobot
Attach
AwarioSmartBot
BDCbot
BLEXBot
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Blow
BotALot
Brandprotect
Brandwatch
Buck
Buddy
Bullseye
CATExplorador
Cegbfeieh
CherryPicker
ChinaClaw
Citoid
Claritybot
Cloud mapping
Cocolyzebot
Copier
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
Demon
Deusu
Discoverybot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Drip
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
Evil
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Flunky
Freeuploader
GalaxyBot
GermCrawler
Getintent
GrabNet
Grabber
GridBot
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Humanlinks
IRLbot
Iblog
Intelliseek
Internet Ninja
Iskanie
IstellaBot
JamesBOT
JikeSpider
Jorgee
Kenjin Spider
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LibWeb
Libwhisker
Lightspeedsystems
LinksManager
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Majestic SEO
Majestic12
Masscan
MeanPath Bot
Meanpathbot
Metauri
Microsoft URL Control
Mozlila
Msrabot
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Nessus
Net Vampire
NetAnts
NetMechanic
NetZIP
Netcraft
Niki-bot
NimbleCrawler
Nimbostratus
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Pavuk
PeoplePal
Petalbot
PictureFinder
Piepmatz
Pixray
Probethenet
PyCurl
QueryN Metasearch
RSSingBot
Rankivabot
Re-re
RebelMouse
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
Scrapy
Screaming
ScreenerBot
Searchestate
Siphon
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
Sucker
SuperHTTP
TeleportPro
Telesphoreo
Trendiction
TwengaBot
URLy.Warning
V-BOT
VelenPublicWebCrawler
Virusdie
VoidEYE
Voltron
WEBDAV
WPScan
WWWOFFLE
Wallpapers
WeSEE
Web Enhancer
Web Fuck
WebAuto
WebCollage
WebEnhancer
WebLeacher
WebPix
WebReaper
WebStripper
Webalta
Webshag
Webster
WiseGuys Robot
Woobot
Wotbox
Xenu
Zade
Zauba
ZmEu
arquivo-web-crawler
autoemailspider
check1.exe
coccocbot
crawler.feedback
dataforseo.com
demandbase-bot
gopher
instabid
ips-agent
isitwp.com
iubenda-radar
linkdexbot
magpie-crawler
mediawords
muhstik-scan
plumanalytics
probe-image-size
s1z.ru
scalaj-http
seobility
sexsearcher
sitechecker.pro
spyfu
ubermetrics-technologies.com
webpros.com
x22Mozilla
xpymep1.exe
zauba.io