nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-02 22:07:15 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ALittle Client
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchie
Anthill
Apexoo
AwarioRssBot
BBBike
BDCbot
BDFetch
BackDoorBot
BackStreet
BackWeb
Barkrowler
BetaBot
Black Hole
BlackWidow
BuiltBotTough
BuiltWith
CCBot
CODE87
CSHttp
CazoodleBot
CensysInspect
CheTeam
CheeseBot
CherryPicker
Cocolyzebot
Cogentbot
Collector
Copyscape
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Devil
Discobot
Discoverybot
DnyzBot
DomCopBot
Dotbot
Dragonfly
Drip
EasyDL
Ebingbong
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
FHscan
FemtosearchBot
FyberSpider
Fyrebot
Genieo
GetRight
GrabNet
GrapeFX
GridBot
HTMLparser
HaosouSpider
Harvest
Hloader
Humanlinks
IDBTE4M
IDBot
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iskanie
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
JustView
Kenjin Spider
Larbin
Lftp
Libwhisker
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
MIIxpc
MSFrontPage
Magnet
Majestic SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot
Net Vampire
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Nmap
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Panscient
Papa Foto
Pavuk
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Probethenet
PyCurl
QueryN Metasearch
RankFlex
Rankivabot
RankurBot
Re-re
RebelMouse
Recorder
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SISTRIX
SMTBot
SalesIntelligent
Scanbot
ScoutJet
ScrepyBot
Seekport
SentiBot
Seomoz
Site Sucker
SiteExplorer
Sitebeam
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
Sqlmap
Sqworm
Sucker
SuperBot
SuperHTTP
Surfbot
Szukacz
Teleport
The Intraformant
TheNomad
Toata
Trendiction
Turingos
Twice
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WBSearchBot
WEBDAV
WWW::Mechanize
Web Fetch
Web Fuck
Web Pix
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebGo IS
WebLeacher
WebStripper
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Whack
Whacker
WinHTTrack
Woobot
Wprecon
Zermelo
Zeus
ZoomBot
autoemailspider
coccocbot
crawl.sogou.com
crawler.feedback
dataforseo.com
evc-batch
facebookscraper
gopher
heritrix
isitwp.com
iubenda-radar
probe-image-size
satoristudio.net
scan.lol
seocompany.store
seostar
sexsearcher
sogouspider
spyfu
trendiction.com
webpros.com
zauba.io