nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-29 22:08:07 +00:00

100 lines
1.1 KiB
Text

01h4x.com
360Spider
AfD-Verbotsverfahren
Alligator
Atomseobot
BBBike
BDCbot
BackStreet
Boardreader
Bolt
BuiltWith
Calculon
Cegbfeieh
CherryPicker
ChinaClaw
ClaudeBot
Cloud mapping
Crawling at Home Project
DSearch
Deusu
DnBCrawler-Analytics
ECCP/1.0
EMail Siphon
EasyDL
Express WebPictures
Flunky
GPTBot
GrapeFX
HEADMasterSEO
HTTP::Lite
Harvest
IDBTE4M
IndeedBot
JOC Web Spider
Kozmosbot
LNSpiderguy
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MSFrontPage
Metauri
NearSite
Needle
NetMechanic
NetSpider
Ninja
OpenLinkProfiler
PHPCrawl
PageGrabber
PageThing.com
Papa Foto
Pavuk
PleaseCrawl
Pockey
Proximic
Rainbot
Re-re
SEOkicks
SEOprofiler
SISTRIX
Screaming
ScrepyBot
Sosospider
Sqlmap
Steeler
Sucuri
Toata
Toweyabot
Tracemyfile
Turingos
UnisterBot
Voil
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Collage
Web Sauger
WebBandit
WebPix
WebSauger
Whatweb
Widow
Wonderbot
ZoominfoBot
autoemailspider
awario.com
backlink-check
cah.io.community
cohere-ai
internetVista monitor
ips-agent
isitwp.com
magpie-crawler
openai
ripz
seobility
seoscanners
xpymep1.exe