nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-13 10:07:25 +00:00

100 lines
1 KiB
Text

360Spider
AhrefsBot
Apexoo
BLEXBot
BackDoorBot
Backlink-Ceck
BatchFTP
BetaBot
Blackboard
Boardreader
CCBot
CSHttp
CheTeam
CherryPicker
Citoid
CrunchBot
DTS Agent
Dispatch
DomainCrawler
Drip
Extractor
EyeNetIE
Fimap
FlashGet
GoZilla
HTMLparser
HTTrack
Haansoft
Harvest
Havij
Indy Library
JetCar
Keybot Translation-Search-Machine
LWP::Simple
Lanshanbot
Libwhisker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
MFC_Tear_Sample
MIDown tool
MTRobot
Magnet
MegaIndex.ru
MicroMessenger
Morfeus Fucking Scanner
Nessus
Nettrack
NextGenSearchBot
NimbleCrawler
Not
Nutch
Openfind
Openvas
PECL::HTTP
PageGrabber
Panscient
Petalbot
Picsearch
Psbot
PyCurl
RankurBot
RepoMonkey
Ripper
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
ScrepyBot
SentiBot
Siphon
Sosospider
Spbot
Spinn3r
The Intraformant
Toata
Turingos
Twice
Typhoeus
UnisterBot
VelenPublicWebCrawler
Web Fuck
Web Sucker
WebCollage
WebZIP
Webalta
Webshag
Widow
Xaldon_WebSpider
ZoominfoBot
ZumBot
crawler.feedback
demandbase-bot
ips-agent
isitwp.com
muhstik-scan
scan.lol
sexsearcher
sp_auditbot
webprosbot