nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-28 10:07:06 +00:00

100 lines
1 KiB
Text

404enemy
80legs
Alligator
AwarioBot
BBBike
Backlink-Ceck
BatchFTP
Blackboard
Bolt
BuiltBotTough
CheTeam
Cliqzbot
Cloud mapping
Cogentbot
CyotekWebCopy
DIIbot
DataCha0s
Devil
EirGrabber
Evil
Flunky
Freeuploader
GermCrawler
GetWeb
Grabber
HTTrack
Harvest
Hloader
IRLbot
InfraSec Scanner
Iria
IstellaBot
JOC Web Spider
JikeSpider
Lanshanbot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkWalker
Magnet
Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mozlila
Nameprotect
Nibbler
Nikto
NimbleCrawler
Nmap
OnCrawl
Pandalytics
PictureFinder
Piepmatz
Proximic
Pump
RankActive
RankActiveLinkBot
Ripper
SEOkicks
Scanbot
Screaming
Seekport
SemrushBot
SiteExplorer
Siteimprove
Snake
Snapbot
Spinn3r
SputnikBot
Sqlworm
Turingos
URLy.Warning
Web Fetch
Web Sauger
WebWhacker
Website Quester
ZoominfoBot
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
cohere-ai
crawler.feedback
gopher
internetVista monitor
linkfluence
oBot
page scorer
pcBrowser
ripz
s1z.ru
sitechecker.pro
tAkeOut
trendiction.de
voyagerx.com