nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-20 10:06:50 +00:00

100 lines
1.1 KiB
Text

AfD-Verbotsverfahren
AhrefsBot
Anarchy99
AwarioSmartBot
BacklinkCrawler
Badass
Bolt
BotALot
Claritybot
CopyRightCheck
CrunchBot
Custo
Demon
Digincore
Discobot
Domains Project
Download Wonder
Dragonfly
Drip
EroCrawler
Extractor
EyeNetIE
FHscan
GetRight
Gotit
HTTP::Lite
Harvest
IDBTE4M
IlseBot
IndeedBot
Iria
Larbin
LeechGet
LexiBot
Likse
Linkbot
LinqiaRSSBot
Lmspider
MJ12bot
Mass Downloader
Microsoft Data Access
Microsoft URL Control
Mojolicious
NearSite
Needle
Nessus
Netcraft
Nettrack
Niki-bot
OpenLinkProfiler
OpenVAS
Openvas
POE-Component-Client-HTTP
Panscient
PictureFinder
Psbot
RankFlex
RankingBot2
Re-re
RealDownload
RepoMonkey
Ripper
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SiteLockSpider
SiteSnagger
Snake
Sociscraper
SuperHTTP
Telesoft
Toweyabot
Turnitin
TurnitinBot
Twice
VoidEYE
WISENutbot
WWW-Mechanize
Wallpapers/3.0
WebCollage
WebsiteExtractor
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
Zermelo
backlink-check
crawler.feedback
facebookscraper
iubenda-radar
linkdexbot
meanpathbot
plumanalytics
scan.lol
seobility
sexsearcher
sogouspider
ubermetrics-technologies.com
webprosbot