nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-14 22:08:28 +00:00

100 lines
1.1 KiB
Text

ASPSeek
Aboundexbot
AwarioSmartBot
BackStreet
BacklinksExtendedBot
BunnySlippers
ClaudeBot
Crawling at Home Project
DTS Agent
Demon
Deusu
Dirbuster
Dispatch
DomainCrawler
EMail Wolf
Ecxi
Flunky
FrontPage
GalaxyBot
GetWeb
Gigabot
GrapeFX
GrapeshotCrawler
Image Sucker
ImagesiftBot
InterGET
Jbrofuzz
Jorgee
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
LieBaoFast
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
MFC_Tear_Sample
MJ12bot
MSIECrawler
Magnet
MarkMonitor
MegaIndex.ru
Minefield
Mr.4x3
Name Intelligence
Navroad
Needle
NextGenSearchBot
OnCrawl
OpenLinkProfiler
Openfind
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Papa Foto
Pi-Monster
RedesScrapy
SEOkicks
SEOprofiler
Searchestate
SemrushBot
SemrushBot-SI
Spinn3r
Sqlmap
Sqworm
Swiftbot
Toata
Twice
Vacuum
Voltron
WWWOFFLE
WallpapersHD
Web Fuck
WebImageCollector
WebLeacher
Webalta
Website Quester
Webster
Wonderbot
Woobot
Xaldon WebSpider
ZoominfoBot
ZumBot
backlink-check
crawl.sogou.com
crawler.feedback
eCatch
imagesift.com
ips-agent
lwp-trivial
mediawords
plumanalytics
scan.lol
seocompany.store
seostar
sp_auditbot
spyfu
ubermetrics-technologies.com
xpymep1.exe
zauba.io