nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-29 22:05:00 +00:00

100 lines
1 KiB
Text

80legs
Abonti
AiHitBot
Alexibot
Anarchy99
Asterias
AwarioSmartBot
BDFetch
BLEXBot
Bitacle
BuzzSumo
CazoodleBot
Collector
Craftbot
Custo
DTS Agent
Devil
EasyDL
EirGrabber
EroCrawler
Extractor
FHscan
Flunky
Fyrebot
Gigabot
Go!Zilla
Google-Extended
HTTP::Lite
HaosouSpider
Image Sucker
Likse
LinqiaScrapeBot
MSFrontPage
Mag-Net
Majestic SEO
Majestic12
MarkWatch
Metauri
NetLyzer
NetSpider
Nibbler
Nuclei
Nutch
Octopus
OpenLinkProfiler
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pixray
RankFlex
RealDownload
RebelMouse
RedesScrapy
Rogerbot
SBIder
SEOkicks-Robot
ScanAlert
Seekport
SemanticJuice
Siphon
SiteSnagger
Spanner
Sqlmap
Sqworm
T0PHackTeam
Telesphoreo
TheNomad
Toata
Toweyabot
Trendictionbot
TurnitinBot
URLy.Warning
UnisterBot
Upflow
VB Project
WEBDAV
Web Sauger
WebCollage
WebCopier
WebSucker
Website Quester
WebsiteExtractor
Webster
Zade
Zitebot
arquivo-web-crawler
instabid
ips-agent
omgili
openai
probe-image-size
seobility
seocompany.store
seoscanners
sp_auditbot
trendiction.de
webprosbot
xpymep1.exe