nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-09 10:07:25 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
Aboundex
Backlink-Ceck
Bitacle
Buck
CazoodleBot
Citoid
Cliqzbot
Cloud mapping
Cogentbot
Cosmos
DittoSpyder
DnyzBot
Domains Project
Download Wonder
EMail Siphon
Evil
FemtosearchBot
Fuzz
Getintent
GrapeshotCrawler
Image Fetch
IndeedBot
Information Security Team InfraSec Scanner
JOC Web Spider
Jbrofuzz
JikeSpider
LinksManager
LinqiaMetadataDownloaderBot
MSIECrawler
Mass Downloader
Masscan
MegaIndex.ru
Mister PiX
Moblie Safari
Mozlila
Ninja
OnCrawl
Openvas
PECL::HTTP
Papa Foto
Pavuk
Proximic
Psbot
QueryN Metasearch
RankingBot
RealDownload
Recorder
RepoMonkey
RocketCrawler
Rogerbot
ScreenerBot
ScrepyBot
Searchestate
SeekportBot
SemanticJuice
Semrush
SeobilityBot
Siphon
SiteSucker
Sitebeam
Snake
Sociscraper
Sogou web spider
Spanner
SurveyBot
Swiftbot
T8Abot
TeleportPro
TightTwatBot
Trendiction
Trendictionbot
True_Robot
Turnitin
V-BOT
Voil
WallpapersHD
WebCopier
WebEnhancer
WebReaper
WebStripper
WebmasterWorldForumBot
Webshag
Whack
WinHTTrack
check1.exe
demandbase-bot
domainsproject.org
linkdexbot
lwp-trivial
mediawords
omgili
pcBrowser
plumanalytics
polaris version
probe-image-size
satoristudio.net
sexsearcher
trendiction.de