nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-06 22:06:57 +00:00

250 lines
2.6 KiB
Text

01h4x.com
AfD-Verbotsverfahren
Alligator
Ankit
Apexoo
Asterias
AwarioSmartBot
BLEXBot
BackStreet
BacklinkCrawler
Badass
BetaBot
Bigfoot
Bitacle
Black Hole
Blow
BlowFish
Boardreader
Buck
Buddy
BuiltWith
BunnySlippers
Cegbfeieh
CherryPicker
Citoid
Cliqzbot
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DSearch
DataCha0s
Demon
Deusu
DigitalPebble
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
Fimap
Firefox/7.0
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
GoZilla
Grafula
GrapeFX
GridBot
HMView
Haansoft
HaosouSpider
Harvest
Heritrix
IDBTE4M
IDBot
IRLbot
Id-search
IlseBot
InternetSeer
Iskanie
JikeSpider
Jyxobot
Keyword Density
LWP::Simple
Libwhisker
Likse
Linkdexbot
LinkpadBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Minefield
Mister PiX
Moblie Safari
Mr.4x3
NICErsPRO
NPbot
Name Intelligence
Navroad
Nessus
Net Vampire
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Nmap
Nuclei
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
PeoplePal
Petalbot
Pi-Monster
Piepmatz
Pockey
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActive
Re-re
RealDownload
Recorder
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
Scrapy
SemanticJuice
SemrushBot
SeobilityBot
Seomoz
Site Sucker
Siteimprove
SlySearch
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spbot
Spinn3r
SputnikBot
Sqlworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
TightTwatBot
Titan
Tracemyfile
True_Robot
Turingos
TwengaBot
V-BOT
Vagabondo
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Fuck
Web Pix
WebBandit
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
facebookscraper
ripz
satoristudio.net
scalaj-http
scan.lol
sitechecker.pro
siteripz
spyfu
tAkeOut
trendiction.de
webpros.com
webprosbot
zgrab