nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-30 10:09:18 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ADmantX
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Ankit
Apexoo
BDFetch
BackWeb
Backlink-Ceck
BlackWidow
BotALot
Brandprotect
Buddy
BuiltBotTough
Bullseye
CODE87
CSHttp
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Craftbot
CrunchBot
Curious
Custo
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
DigitalPebble
Disco
Dispatch
DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Download Wonder
Drip
Ecxi
EroCrawler
Evil
Exabot
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
HEADMasterSEO
Haansoft
Havij
HonoluluBot
IDBot
IlseBot
Image Fetch
IndeedBot
Intelliseek
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
Leap
LeechGet
Lftp
LibWeb
Libwhisker
LinkWalker
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MJ12bot
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Masscan
MauiBot
Minefield
Mojeek
MolokaiBot
Msrabot
Name Intelligence
Navroad
NearSite
Net Vampire
NetLyzer
NetMechanic
Nikto
NimbleCrawler
Nuclei
Octopus
Offline Explorer
OnCrawl
OpenVAS
Openvas
POE-Component-Client-HTTP
PageScorer
Picsearch
Pimonster
Pixray
PleaseCrawl
Pockey
Probethenet
PyCurl
RankActive
RankActiveLinkBot
RankFlex
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
Screaming
Semrush
SemrushBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sosospider
SpankBot
Spanner
Spinn3r
Sqlmap
Sqlworm
Sucuri
SuperBot
Surfbot
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Tracemyfile
Trendiction
Turingos
Twice
URLy Warning
UnisterBot
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WWW::Mechanize
WWWOFFLE
Web Auto
Web Collage
Web Sauger
Web Sucker
WebCollage
WebFuck
WebImageCollector
WebPix
WebSauger
WebSucker
WebWhacker
WebZIP
WebsiteQuester
Who.is Bot
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Zeus
Zitebot
ZoomBot
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cognitiveseo
com.plumanalytics
crawler4j
dataforseo.com
demandbase-bot
eCatch
facebookscraper
instabid
internetVista monitor
isitwp.com
iubenda-radar
linkdexbot
meanpathbot
mediawords
muhstik-scan
probe-image-size
seobility
seoscanners
sitechecker.pro
sogouspider
sp_auditbot
spyfu
ubermetrics-technologies.com
webpros.com
webprosbot
xpymep1.exe