nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-20 10:07:14 +00:00

100 lines
1 KiB
Text

01h4x.com
404checker
Bandit
Brandwatch
CheeseBot
Cosmos
Craftbot
DSearch
DTS Agent
Digincore
Discoverybot
Foobot
FrontPage
FyberSpider
Genieo
GetWeb
GrapeshotCrawler
HEADMasterSEO
IDBTE4M
IndeedBot
InfoNaviRobot
Intelliseek
JamesBOT
LNSpiderguy
Lanshanbot
Larbin
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Lipperhey Spider
MSFrontPage
Mail.RU_Bot
MarkMonitor
Mojeek
Musobot
Nameprotect
Nessus
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Openfind
Petalbot
Picsearch
PictureFinder
PleaseCrawl
Pockey
Probethenet
PyCurl
RSSingBot
Re-re
Ripper
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
ScoutJet
Screaming
SearchmetricsBot
SeekportBot
Shodan
Sitevigil
Snapbot
Spbot
Stripper
SuperHTTP
SurveyBot
Telesphorep
TheNomad
Turnitin
TurnitinBot
Twice
VB Project
Vacuum
VeriCiteCrawler
WEBDAV
Wallpapers
Web Enhancer
WebAuto
WebSauger
WebSucker
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
check1.exe
clark-crawler
facebookscraper
heritrix
ips-agent
iubenda-radar
netEstate NE Crawler
satoristudio.net
scan.lol
seobility
seoscanners
siteripz
sp_auditbot
trendiction.de