nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-12 22:07:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ADmantX
ALittle Client
Aboundex
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alexibot
Alligator
AlphaBot
Ankit
Apexoo
Aspiegel
Asterias
Atomseobot
BDFetch
BLEXBot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
Battleztar Bazinga
BlackWidow
Brandprotect
Buck
CATExplorador
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Cliqzbot
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CyotekWebCopy
DIIbot
Demon
Digincore
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
Ebingbong
Ecxi
EirGrabber
Ezooms
FemtosearchBot
Fuzz
GT::WWW
Genieo
GetWeb
Getintent
GoZilla
Gotit
Grabber
HEADMasterSEO
HTMLparser
Haansoft
Havij
IRLbot
Iblog
IlseBot
Image Fetch
IndeedBot
Iria
Iskanie
JamesBOT
Jbrofuzz
JennyBot
Jetty
JikeSpider
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
Larbin
Leap
LieBaoFast
LinkWalker
LinkextractorPro
LinksManager
Ltx71
MJ12bot
MSFrontPage
Mag-Net
Majestic-SEO
Majestic12
Masscan
MeanPath Bot
Microsoft URL Control
Minefield
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Name Intelligence
Nessus
Net Vampire
NetLyzer
Netcraft
Netvibes
NimbleCrawler
Nmap
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
Openvas
OrangeBot
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Pavuk
Petalbot
Pi-Monster
Piepmatz
Pimonster
PleaseCrawl
ProWebWalker
Probethenet
Pu_iN
QueryN Metasearch
RSSingBot
RankingBot2
Rankivabot
RealDownload
Reaper
RepoMonkey
Ripper
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Siteimprove
SlySearch
Snake
Sosospider
Spammen
Spanner
SputnikBot
Sqlmap
Sucuri
SurveyBot
Suzuran
TeleportPro
TightTwatBot
Toata
Toweyabot
Trendiction
True_Robot
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WPScan
WWW-Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebLeacher
WebPix
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whatweb
Who.is Bot
Wonderbot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZmEu
archive.org_bot
autoemailspider
backlink-check
cognitiveseo
dataforseo.com
demandbase-bot
facebookscraper
gopher
instabid
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
mediawords
muhstik-scan
oBot
page scorer
satoristudio.net
scalaj-http
seobility
seocompany.store
seoscanners
seostar
sogouspider
sysscan
trendiction.com
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla