nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-08 22:07:47 +00:00

100 lines
1 KiB
Text

Aipbot
Alligator
Anarchy99
Aspiegel
Blackboard
BlowFish
Boardreader
Buddy
BuiltWith
CATExplorador
ChinaClaw
Cogentbot
Crawling at Home Project
Custo
Digincore
Disco
Discobot
Dispatch
DnyzBot
ExtractorPro
EyeNetIE
FrontPage
Genieo
GridBot
IDBTE4M
Jorgee
JustView
Lanshanbot
Libwhisker
Linkbot
Lipperhey Spider
MegaIndex.ru
Microsoft Data Access
Morfeus Fucking Scanner
Musobot
Nameprotect
NetLyzer
NetMechanic
Nettrack
NextGenSearchBot
NimbleCrawler
Nmap
Nutch
Offline Navigator
Openfind
Papa Foto
PictureFinder
PleaseCrawl
Pockey
PxBroker
Rainbot
ReGet
SBIder
SEOkicks-Robot
SEOlyt
SMTBot
Scanbot
SeekportBot
SemrushBot-SI
SeoCherryBot
Shodan
SiteExplorer
SiteLockSpider
Sitevigil
Spammen
SpankBot
Spider_Bot
Steeler
SurveyBot
Telesphorep
TheNomad
Thumbor
True_Robot
Twice
VCI
Vacuum
WBSearchBot
WEBDAV
WallpapersHD
WebBandit
WebCopier
WebSauger
WebmasterWorldForumBot
Webshag
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zeus
arquivo.pt
clark-crawler
domainsproject.org
facebookscraper
iubenda-radar
linkdexbot
lwp-request
openai.com
plumanalytics
seobility
sogouspider
zauba.io