nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2026-03-03 10:23:53 +00:00

100 lines
1.1 KiB
Text

404checker
80legs
Acunetix
Alligator
Anthill
Aspiegel
Asterias
BetaBot
Bigfoot
BuiltBotTough
CensysInspect
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Collector
Copyscape
CrazyWebCrawler
DTS Agent
DatabaseDriverMysqli
Deusu
EMail Wolf
Exabot
Fuzz
G-i-g-a-b-o-t
GPTBot
Genieo
HMView
HTTrack
Humanlinks
HybridBot
IDBot
Id-search
IlseBot
ImagesiftBot
Information Security Team InfraSec Scanner
Internet Ninja
InternetMeasurement
Iskanie
JOC Web Spider
JetCar
LeechGet
Lftp
LinqiaMetadataDownloaderBot
Majestic-SEO
Metauri
Microsoft Data Access
Moblie Safari
Navroad
Net Vampire
NetZIP
Netvibes
NimbleCrawler
POE-Component-Client-HTTP
Pavuk
ProPowerBot
PxBroker
Rainbot
RankingBot
RankingBot2
Reaper
RebelMouse
Rogerbot
Scanbot
Scrapy
ScreenerBot
ScrepyBot
SearchmetricsBot
Site Sucker
Siteimprove
SocialRankIOBot
Sqlworm
Sucuri
TeleportPro
The Intraformant
Thumbor
Toata
Trendictionbot
URLy.Warning
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
Wallpapers
WeSEE
Web Fuck
WebReaper
WebZIP
Website Quester
Widow
Woobot
crawler.feedback
eCatch
facebookscraper
openai.com
ripz
satoristudio.net
seocompany.store
spyfu
zgrab