nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-23 10:17:50 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
AIBOT
ASPSeek
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
Anarchy
Anarchy99
Anthill
Apexoo
Attach
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BatchFTP
Bigfoot
Bitacle
Black Hole
BlackWidow
Bolt
BotALot
Brandwatch
Calculon
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Cliqzbot
Collector
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Deusu
Digincore
DigitalPebble
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Drip
Evil
ExtLinksBot
Ezooms
FemtosearchBot
Freeuploader
FrontPage
GalaxyBot
Genieo
GetRight
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
Grafula
HTTP::Lite
HaosouSpider
Harvest
Heritrix
HybridBot
IDBot
IRLbot
Indy Library
InfoNaviRobot
Iskanie
JOC Web Spider
JamesBOT
Jetty
Joomla
JustView
Kenjin Spider
Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP
LexiBot
Lftp
Libwhisker
Lightspeedsystems
LinkWalker
Linkdexbot
LinkextractorPro
LinksManager
Lipperhey
Lmspider
MFC_Tear_Sample
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Masscan
Meanpathbot
Mediatoolkitbot
Metauri
Mister PiX
Moblie Safari
Mojolicious
Mozlila
Msrabot
NearSite
Nessus
NetLyzer
NetSpider
Netcraft
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Nmap
Nuclei
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
Pixray
PleaseCrawl
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
Re-re
Reaper
RebelMouse
SEOkicks
SISTRIX
ScanAlert
Scanbot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
Sitebeam
Siteimprove
Sitevigil
Snake
Snapbot
Snoopy
Sogou web spider
SpaceBison
Spanner
Sqlworm
Stripper
Sucker
SuperHTTP
Suzuran
TeleportPro
Telesoft
TheNomad
Toata
Toweyabot
Trendiction
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WEBDAV
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers
Web Collage
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebBandit
WebFetch
WebGo IS
WebImageCollector
WebLeacher
Webalta
WebmasterWorldForumBot
Webster
Who.is Bot
Widow
WinHTTrack
Xaldon_WebSpider
Zeus
ZoomBot
arquivo.pt
backlink-check
cah.io.community
check1.exe
cognitiveseo
crawler.feedback
demandbase-bot
facebookscraper
gopher
isitwp.com
lwp-trivial
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
ripz
satoristudio.net
scan.lol
seobility
seoscanners
serpstatbot
siteripz
sogouspider
spyfu
sysscan
trendiction.com
trendiction.de
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io