nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-19 10:11:06 +00:00

100 lines
1.1 KiB
Text

Anarchy
Aspiegel
BDFetch
BLEXBot
BackDoorBot
BackStreet
Blackboard
Buddy
BuzzSumo
CODE87
Calculon
Cegbfeieh
Crescent
Devil
DomainAppender
Ecxi
HTTrack
Haansoft
Havij
IDBTE4M
Image Fetch
Indy Library
InternetMeasurement
InternetSeer
JOC Web Spider
Jetty
Keybot Translation-Search-Machine
LieBaoFast
Likse
LinqiaMetadataDownloaderBot
Lipperhey Spider
Ltx71
MQQBrowser
MTRobot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mozlila
NPbot
Name Intelligence
Needle
NextGenSearchBot
Nuclei
Octopus
Offline Navigator
OpenVAS
PageScorer
Panscient
QueryN Metasearch
Re-re
ReGet
RedesScrapy
SEOkicks
SEOstats
Scanbot
Screaming
ScreenerBot
Seekport
SiteSnagger
SmartDownload
Sqworm
Sucker
Toata
Trendictionbot
Turnitin
TurnitinBot
URLy.Warning
Upflow
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WBSearchBot
WWW-Collector-E
WebCollage
WebCopier
WebWhacker
WebmasterWorldForumBot
WinHTTrack
Wonderbot
Wprecon
YaK
ZumBot
crawl.sogou.com
dataforseo.com
domainsproject.org
instabid
ips-agent
netEstate NE Crawler
openai
polaris version
probe-image-size
seostar
sitechecker.pro
sogouspider
voyagerx.com
webprosbot
zgrab