nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-17 22:09:26 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Acunetix
Alligator
Anarchie
Anthill
Attach
AwarioRssBot
BackWeb
Battleztar Bazinga
BlackWidow
Brandwatch
Buck
CensysInspect
Cloud mapping
Crawling at Home Project
Custo
DSearch
DataCha0s
Dirbuster
Discobot
Evil
Exabot
ExtLinksBot
FemtosearchBot
Fyrebot
G-i-g-a-b-o-t
Go!Zilla
HTMLparser
Id-search
Iskanie
JikeSpider
Kenjin Spider
Leap
LeechGet
LibWeb
LieBaoFast
Lipperhey Spider
MFC_Tear_Sample
MSFrontPage
Mag-Net
Mass Downloader
Mozlila
Nimbostratus
OutfoxBot
Picsearch
ProPowerBot
Pump
Quick-Crawler
RankActive
RankingBot
RedesScrapy
Ripper
SEOprofiler
Semrush
Shodan
SiteAuditBot
SiteCheckerBotCrawler
Siteimprove
Snapbot
Sottopop
SpaceBison
SputnikBot
Steeler
Szukacz
Telesoft
VeriCiteCrawler
VoidEYE
Voltron
WISENutbot
WWW::Mechanize
WWWOFFLE
Web Collage
Web Sauger
WebCopier
WebFetch
WebGo IS
WebImageCollector
Wonderbot
Woobot
YoudaoBot
ZoomBot
adscanner
arquivo.pt
cah.io.community
check1.exe
com.plumanalytics
crawler.feedback
crawler4j
domainsproject.org
facebookscraper
lwp-request
lwp-trivial
meanpathbot
oBot
probe-image-size
scalaj-http
trendiction.com
webprosbot
xpymep1.exe
zauba.io