nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-07-02 22:08:12 +00:00

100 lines
1.1 KiB
Text

ADmantX
AfD-Verbotsverfahren
Ankit
AwarioBot
Blow
CSHttp
Calculon
CheTeam
Chlooe
ClaudeBot
Craftbot
DTS Agent
Demon
Discobot
DnBCrawler-Analytics
DomCopBot
DomainCrawler
EMail Wolf
EasyDL
Evil
FHscan
FemtosearchBot
FlashGet
Freeuploader
FrontPage
GPTBot
GermCrawler
Go!Zilla
GoZilla
Gotit
HEADMasterSEO
Havij
Id-search
Image Sucker
Internet Ninja
JOC Web Spider
Keyword Density
Kozmosbot
MSFrontPage
Mag-Net
Mediatoolkitbot
Metauri
Microsoft URL Control
Mr.4x3
Name Intelligence
NearSite
Nessus
Nikto
Nmap
OnCrawl
PageAnalyzer
PageScorer
PeoplePal
Pimonster
Pockey
Pump
PyCurl
QueryN Metasearch
Rankivabot
RebelMouse
SEOkicks
SMTBot
SeekportBot
SeoCherryBot
Seomoz
SiteCheckerBotCrawler
Snake
Spanner
Spinn3r
Steeler
Stripper
TeleportPro
TightTwatBot
URLy Warning
URLy.Warning
VidibleScraper
WASALive-Bot
WWW-Mechanize
WWW::Mechanize
WallpapersHD
WebBandit
WebReaper
Wotbox
Xaldon WebSpider
archive.org_bot
awario.com
check1.exe
crawler4j
dataforseo.com
linkfluence
lwp-trivial
meanpathbot
probe-image-size
seobility
seocompany.store
serpstatbot
sexsearcher
sogouspider
voyagerx.com
x22Mozilla