nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-09 10:07:30 +00:00

100 lines
1.1 KiB
Text

01h4x.com
AdsTxtCrawlerTP
BackStreet
BacklinkCrawler
BacklinksExtendedBot
Bigfoot
Blackboard
BotALot
Buddy
CSHttp
CherryPicker
ClaudeBot
Collector
CrazyWebCrawler
Crescent
Curious
Custo
DSearch
DTS Agent
DigitalPebble
Dirbuster
Discoverybot
DnyzBot
Dotbot
ECCP/1.0
ExtractorPro
Fimap
Flunky
Fyrebot
GermCrawler
GetRight
Gotit
HEADMasterSEO
HaosouSpider
IlseBot
Jbrofuzz
Kenjin Spider
Kinza
MSFrontPage
Mediatoolkitbot
Minefield
Morfeus Fucking Scanner
Mozlila
NICErsPRO
Name Intelligence
Niki-bot
Ninja
Octopus
Offline Explorer
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Pockey
Proximic
Rainbot
RankFlex
SEOprofiler
SalesIntelligent
ScanAlert
SemanticJuice
Site Sucker
SiteSucker
Snapbot
Sottopop
Sucuri
TightTwatBot
Toweyabot
Turingos
VelenPublicWebCrawler
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Web Collage
Web Fetch
Web Sauger
WebGo IS
WebSucker
Website Quester
WebsiteExtractor
Whatweb
Xaldon_WebSpider
Xenu
Zauba
ZumBot
archive.org_bot
arquivo.pt
cohere-ai
crawler.feedback
domainsproject.org
ips-agent
isitwp.com
openai
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
ubermetrics-technologies.com