nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-29 10:09:19 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ADmantX
Aboundexbot
AfD-Verbotsverfahren
Aipbot
Alexibot
Anarchie
Anarchy
Ankit
Attach
BDFetch
BLEXBot
BackDoorBot
BackWeb
Barkrowler
BatchFTP
Bigfoot
Bitacle
Bolt
Brandwatch
Buck
BuiltWith
Bullseye
BunnySlippers
CCBot
CODE87
Calculon
Cegbfeieh
ChinaClaw
Claritybot
Cogentbot
Copier
Copyscape
Curious
CyotekWebCopy
DBLBot
DSearch
Deusu
Digincore
DigitalPebble
Disco
Discoverybot
DomainCrawler
DomainSigmaCrawler
Download Wonder
ECCP/1.0
EasyDL
Ecxi
Evil
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Foobot
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Havij
HonoluluBot
Humanlinks
HybridBot
IDBot
Id-search
Image Sucker
Indy Library
InfoTekies
InternetSeer
Iria
Iskanie
JOC Web Spider
JamesBOT
Jetty
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
Lftp
Linkbot
LinkpadBot
LinksManager
LinqiaScrapeBot
MFC_Tear_Sample
Mag-Net
Mb2345Browser
MegaIndex.ru
Mojeek
Msrabot
Name Intelligence
Nessus
Net Vampire
NetAnts
NetZIP
Netvibes
Niki-bot
Nikto
Nimbostratus
Ninja
Nuclei
Offline Navigator
OpenVAS
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Papa Foto
Picscout
Picsearch
Pimonster
ProPowerBot
Probethenet
Pu_iN
PxBroker
QueryN Metasearch
RankFlex
RankingBot
RankurBot
ReGet
Reaper
Recorder
RepoMonkey
Ripper
RocketCrawler
SMTBot
ScanAlert
Scrapy
Screaming
ScrepyBot
Searchestate
Seekport
Semrush
SeobilityBot
Shodan
Siphon
SiteSnagger
Siteimprove
SmartDownload
Sosospider
Sottopop
Spammen
SpankBot
Spanner
Spinn3r
Sqworm
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Toata
Toweyabot
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
WEBDAV
WWW-Collector-E
WWW::Mechanize
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Pix
Web Sucker
WebEnhancer
WebFetch
WebReaper
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Whacker
Wonderbot
YoudaoBot
Zauba
Zermelo
Zeus
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
cah.io.community
clark-crawler
coccocbot
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
eCatch
heritrix
internetVista monitor
isitwp.com
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
probe-image-size
ripz
s1z.ru
scalaj-http
scan.lol
seocompany.store
seostar
sogouspider
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x22Mozilla