nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-05 10:13:31 +00:00

100 lines
1 KiB
Text

01h4x.com
ADmantX
Anarchie
Anarchy99
Atomseobot
AwarioRssBot
AwarioSmartBot
BDFetch
Bitacle
Blow
Buddy
Bullseye
Calculon
CensysInspect
ChatGPT-User
Cosmos
Custo
DIIbot
DSearch
DTS Agent
Dirbuster
Discoverybot
DittoSpyder
EMail Wolf
EasyDL
EirGrabber
EyeNetIE
GermCrawler
Gotit
Harvest
Id-search
IndeedBot
InfoTekies
Iskanie
LWP::Simple
Larbin
LibWeb
Lightspeedsystems
LinqiaMetadataDownloaderBot
Litemage_walker
Mag-Net
Magnet
Masscan
MicroMessenger
Microsoft Data Access
Navroad
NetLyzer
Netcraft
Netvibes
Niki-bot
Nimbostratus
OutfoxBot
PleaseCrawl
Psbot
RankingBot2
ReGet
RedesScrapy
ScanAlert
Screaming
SearchmetricsBot
Semrush
SiteSnagger
Snoopy
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Sucuri
SuperHTTP
SurveyBot
Swiftbot
Toata
VCI
VidibleScraper
Wallpapers/3.0
Web Auto
Web Sauger
WebFetch
WebPix
WebWhacker
WebsiteExtractor
WinHTTrack
Xaldon_WebSpider
ZoominfoBot
arquivo.pt
coccocbot
cohere-ai
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
instabid
omgili
probe-image-size
seoscanners
tAkeOut
webmeup-crawler
webpros.com
x22Mozilla