nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-09 10:09:32 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ALittle Client
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
Anarchie
Anthill
Aspiegel
Asterias
AwarioRssBot
BBBike
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BetaBot
Black Hole
BlowFish
Boardreader
Brandwatch
BuiltWith
CATExplorador
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Collector
Copier
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
DIIbot
DTS Agent
DataCha0s
Deusu
Devil
Disco
Dispatch
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
EMail Wolf
EirGrabber
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Ezooms
Fimap
Flunky
Foobot
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Gigabot
Go!Zilla
Gotit
Grabber
Grafula
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
Havij
Iblog
IndeedBot
Indy Library
InfoTekies
InterGET
InternetSeer
Iskanie
Jbrofuzz
JennyBot
Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
LNSpiderguy
Leap
LeechGet
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MFC_Tear_Sample
MJ12bot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Metauri
Minefield
Moblie Safari
Mojolicious
Mr.4x3
Msrabot
NPbot
Name Intelligence
NearSite
Needle
Nessus
NetMechanic
NetZIP
Netcraft
Nettrack
Nibbler
Nmap
Not
Nutch
Octopus
Offline Explorer
OpenLinkProfiler
Openfind
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
Panscient
Picsearch
Piepmatz
Probethenet
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
Re-re
RebelMouse
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
Scanbot
Scrapy
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
Semrush
Shodan
Siphon
Site Sucker
SiteLockSpider
Sitebeam
Siteimprove
Snapbot
Sogou web spider
Spammen
SpankBot
Sucker
SuperBot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
The Intraformant
Toata
Trendictionbot
Typhoeus
URLy Warning
UnisterBot
Upflow
VCI
Virusdie
Voil
WISENutbot
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Sauger
WebAuto
WebCollage
WebCopier
WebLeacher
WebSucker
Webalta
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Who.is Bot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zeus
ZoomBot
adscanner
archive.org_bot
autoemailspider
clark-crawler
crawl.sogou.com
crawler.feedback
crawler4j
eCatch
instabid
magpie-crawler
mediawords
oBot
probe-image-size
ripz
s1z.ru
satoristudio.net
serpstatbot
sexsearcher
sogouspider
sp_auditbot
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
xpymep1.exe