nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-02 10:09:34 +00:00

250 lines
2.6 KiB
Text

ADmantX
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchie
Ankit
Aspiegel
Atomseobot
BackWeb
Battleztar Bazinga
Bigfoot
Black Hole
Blow
BlowFish
Boardreader
BotALot
Brandwatch
Buddy
BuiltBotTough
BuzzSumo
CATExplorador
CCBot
CODE87
Calculon
CazoodleBot
Cegbfeieh
ChinaClaw
Chlooe
Citoid
Cloud mapping
Cocolyzebot
Cosmos
Crawling at Home Project
CrunchBot
DataCha0s
Deusu
Digincore
Dirbuster
Discobot
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
EasyDL
Ecxi
EirGrabber
Exabot
ExtLinksBot
EyeNetIE
FemtosearchBot
Flunky
Foobot
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
GridBot
Havij
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IDBot
InfoNaviRobot
Intelliseek
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
JikeSpider
Jorgee
Keybot Translation-Search-Machine
Keyword Density
LWP::Simple
LeechFTP
LeechGet
Lftp
Lightspeedsystems
LinkWalker
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Lmspider
MSIECrawler
Mag-Net
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Msrabot
Needle
NetMechanic
NetSpider
Netcraft
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nmap
Not
Offline Explorer
Offline Navigator
Openfind
PageScorer
Panscient
Papa Foto
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Probethenet
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
ScanAlert
ScoutJet
ScreenerBot
ScrepyBot
SemanticJuice
SemrushBot
Seomoz
SiteSucker
SlySearch
Sogou web spider
Spammen
SputnikBot
Sqlmap
Steeler
Sucuri
SuperBot
Swiftbot
Szukacz
Telesoft
Titan
Toata
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turnitin
Twice
URLy.Warning
UnisterBot
Upflow
V-BOT
VB Project
Virusdie
VoidEYE
Voltron
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Collage
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebEnhancer
WebLeacher
WebPix
WebStripper
WebWhacker
WebsiteQuester
Whacker
Whatweb
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
cah.io.community
crawler.feedback
crawler4j
facebookscraper
gopher
ips-agent
linkdexbot
lwp-trivial
magpie-crawler
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
polaris version
satoristudio.net
scalaj-http
seobility
seostar
tAkeOut
trendiction.de
voyagerx.com
webprosbot
zauba.io
zgrab