nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-04 10:09:29 +00:00

250 lines
2.7 KiB
Text

ADmantX
ASPSeek
Abonti
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Anarchie
Ankit
Atomseobot
Attach
AwarioRssBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Bigfoot
Bitacle
BlackWidow
Blackboard
Blow
Boardreader
Bullseye
BunnySlippers
CSHttp
Cegbfeieh
CheeseBot
CherryPicker
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Crawling at Home Project
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
Demon
DigitalPebble
Dirbuster
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainStatsBot
Dotbot
ECCP/1.0
EMail Wolf
EirGrabber
Evil
ExtractorPro
Extreme Picture Finder
FDM
Fuzz
Genieo
GermCrawler
GoZilla
GrabNet
GrapeFX
GridBot
HMView
HTMLparser
HTTP::Lite
Harvest
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jorgee
Jyxobot
Keyword Density
Kinza
Kozmosbot
LeechFTP
LeechGet
Lftp
LieBaoFast
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
MarkMonitor
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mozlila
Musobot
Name Intelligence
Net Vampire
NetSpider
NetZIP
Netcraft
Nettrack
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nmap
OnCrawl
Openfind
Openvas
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Petalbot
Pi-Monster
PictureFinder
Pockey
ProPowerBot
Probethenet
Psbot
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Reaper
RebelMouse
Recorder
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
Scrapy
ScreenerBot
ScrepyBot
Semrush
SemrushBot
Seomoz
Sitebeam
Siteimprove
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot
Spbot
Spinn3r
Sqlworm
Suzuran
Szukacz
T8Abot
Telesoft
Telesphorep
Toata
Tracemyfile
Trendictionbot
Turingos
TurnitinBot
TwengaBot
Typhoeus
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WPScan
WWW-Collector-E
WWW-Mechanize
WallpapersHD
Web Auto
Web Enhancer
Web Pix
Web Sauger
Web Sucker
WebCopier
WebEnhancer
Webalta
Website Quester
WebsiteExtractor
Whack
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Zade
Zeus
ZmEu
ZumBot
adscanner
arquivo-web-crawler
backlink-check
check1.exe
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
polaris version
probe-image-size
satoristudio.net
seobility
sogouspider
voyagerx.com
webgains-bot
webprosbot
x22Mozilla
zauba.io