nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-12 22:04:51 +00:00

100 lines
1.1 KiB
Text

404checker
404enemy
ADmantX
Aboundex
AfD-Verbotsverfahren
Aipbot
Atomseobot
AwarioBot
AwarioRssBot
BacklinkCrawler
Bandit
Bigfoot
Bytespider
ChatGPT-User
Cosmos
DatabaseDriverMysqli
Digincore
DnyzBot
Dotbot
EasyDL
Express WebPictures
FacebookBot
Fimap
FyberSpider
GetWeb
Getintent
Go-Ahead-Got-It
HMView
Humanlinks
Indy Library
Iria
JennyBot
Joomla
JustView
Jyxobot
Keybot Translation-Search-Machine
Lightspeedsystems
LinkextractorPro
Lipperhey Spider
Mail.RU_Bot
MarkMonitor
Mata Hari
Mb2345Browser
Metauri
NearSite
Nessus
NetAnts
NetSpider
QueryN Metasearch
RankActive
RankingBot2
RankurBot
Re-re
RealDownload
Recorder
SEOlyticsCrawler
Scrapy
SemrushBot
SiteLockSpider
SiteSnagger
SmartDownload
Snapbot
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
T8Abot
Teleport
Telesphoreo
Thumbor
TinyTestBot
Toweyabot
True_Robot
Virusdie
VoidEYE
WPScan
WebCopier
WebLeacher
WebPix
WebSauger
WebsiteExtractor
Xaldon WebSpider
YaK
ZmEu
ZoominfoBot
adscanner
crawl.sogou.com
crawler.feedback
evc-batch
facebookscraper
lwp-trivial
muhstik-scan
omgili
openai.com
page scorer
seostar
siteripz
webpros.com
zgrab