nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-28 22:07:20 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ADmantX
AIBOT
Abonti
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Apexoo
Atomseobot
Attach
AwarioRssBot
BBBike
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Bandit
Battleztar Bazinga
BetaBot
Black Hole
BlackWidow
Blow
BlowFish
Bolt
Brandwatch
BuiltWith
Bullseye
CATExplorador
CazoodleBot
CheTeam
CheeseBot
Cliqzbot
Cocolyzebot
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DIIbot
DSearch
DataCha0s
Demon
DigitalPebble
Disco
Discobot
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Download Wonder
Dragonfly
Drip
EirGrabber
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FHscan
FlashGet
FrontPage
Fuzz
G-i-g-a-b-o-t
GalaxyBot
Getintent
Gotit
Grabber
Grafula
GrapeFX
GridBot
HMView
HTMLparser
Haansoft
Havij
Heritrix
Hloader
IDBot
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InterGET
Internet Ninja
JOC Web Spider
JennyBot
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Lanshanbot
Larbin
Leap
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MIIxpc
MTRobot
Magnet
Mail.RU_Bot
Majestic12
Mass Downloader
Masscan
Mata Hari
Meanpathbot
Microsoft URL Control
MolokaiBot
Nessus
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nuclei
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pandalytics
Pavuk
Picsearch
PictureFinder
Piepmatz
Pimonster
Pockey
Probethenet
Pu_iN
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
RepoMonkey
Rogerbot
SEOkicks
SalesIntelligent
SemanticJuice
SemrushBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Snake
Sottopop
Spammen
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
SurveyBot
Szukacz
Telesphorep
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendiction
True_Robot
Turnitin
TwengaBot
V-BOT
VCI
Voltron
WASALive-Bot
WISENutbot
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
Webshag
Website Quester
WebsiteQuester
Whatweb
WiseGuys Robot
Xaldon_WebSpider
Xenu
Zermelo
Zeus
ZmEu
ZyBorg
adscanner
archive.org_bot
cah.io.community
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
facebookscraper
instabid
isitwp.com
iubenda-radar
lwp-request
lwp-trivial
meanpathbot
netEstate NE Crawler
page scorer
plumanalytics
seocompany.store
seostar
sitechecker.pro
siteripz
tAkeOut
trendiction.com
voyagerx.com
x22Mozilla
xpymep1.exe