nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-14 10:07:32 +00:00

100 lines
1 KiB
Text

01h4x.com
Abonti
AlphaBot
Anarchy
Anarchy99
AwarioBot
BBBike
BackWeb
BacklinksExtendedBot
Badass
Battleztar Bazinga
BetaBot
Bitacle
Blackboard
BunnySlippers
ChatGPT-User
Curious
DatabaseDriverMysqli
Discoverybot
DomainSigmaCrawler
Dragonfly
ExtLinksBot
Extractor
EyeNetIE
FyberSpider
GetWeb
GrabNet
Grafula
HMView
HTMLparser
Haansoft
Heritrix
HybridBot
IRLbot
IndeedBot
InterGET
InternetMeasurement
JetCar
Jetty
Joomla
Keybot Translation-Search-Machine
Kozmosbot
Lftp
LinkWalker
MIDown tool
MarkMonitor
MarkWatch
MeanPath Bot
Mister PiX
PageScorer
Probethenet
PyCurl
QueryN Metasearch
RebelMouse
Recorder
RepoMonkey
SISTRIX
Scanbot
ScoutJet
ScrepyBot
SemrushBot
Siphon
SmartDownload
Snake
Sosospider
Sottopop
SputnikBot
Sqlworm
Surfbot
The Intraformant
TightTwatBot
Toweyabot
Vagabondo
WASALive-Bot
WEBDAV
Web Fetch
Web Sucker
WebCollage
WebCopier
WebSauger
Whatweb
WinHTTrack
Wonderbot
Wprecon
Xenu
ZoominfoBot
ZyBorg
autoemailspider
awario.com
crawler4j
eCatch
evc-batch
imagesift.com
meanpathbot
muhstik-scan
polaris version
seocompany.store
sysscan
webprosbot
zauba.io