nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-26 22:05:04 +00:00

100 lines
1 KiB
Text

360Spider
ADmantX
Aipbot
BBBike
BacklinkCrawler
Bitacle
BotALot
BuzzSumo
CensysInspect
Citoid
Claritybot
Cliqzbot
CopyRightCheck
DSearch
DataCha0s
Demon
Devil
DnyzBot
Evil
Express WebPictures
Fimap
GetRight
Gotit
GridBot
Haansoft
Humanlinks
Id-search
Image Sucker
Indy Library
Intelliseek
Internet Ninja
IstellaBot
JamesBOT
Jetty
JikeSpider
Jorgee
Keyword Density
LinkpadBot
LinqiaMetadataDownloaderBot
Lmspider
MIDown tool
MSIECrawler
MTRobot
Mata Hari
MauiBot
Moblie Safari
Net Vampire
Nibbler
Ninja
Nmap
Offline Navigator
Page Analyzer
Piepmatz
ProPowerBot
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
ReGet
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Seekport
Semrush
SentiBot
SenutoBot
Seomoz
Sitebeam
Sitevigil
SlySearch
SpankBot
Spanner
Spbot
Stripper
Sucker
Telesoft
Telesphorep
The Intraformant
UnisterBot
Vacuum
WBSearchBot
WPScan
WallpapersHD
WebAuto
WinHTTrack
Wotbox
Xaldon WebSpider
Zauba
arquivo-web-crawler
arquivo.pt
domainsproject.org
instabid
mediawords
seobility
seoscanners
voyagerx.com
webmeup-crawler
x22Mozilla
zauba.io