nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-04 10:09:14 +00:00

250 lines
2.6 KiB
Text

404checker
Abonti
Aboundex
Acunetix
AiHitBot
Aipbot
Alligator
AlphaBot
Anarchy99
Apexoo
Atomseobot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
Bigfoot
Bitacle
Bolt
Brandprotect
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Claritybot
Cloud mapping
CopyRightCheck
Copyscape
Craftbot
DBLBot
DTS Agent
Demon
Deusu
Devil
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL
Ebingbong
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
Firefox/7.0
FlashGet
Foobot
FrontPage
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigabot
Grabber
Grafula
GridBot
HEADMasterSEO
HaosouSpider
Harvest
Havij
Hloader
Humanlinks
HybridBot
IRLbot
Id-search
Iskanie
JamesBOT
JennyBot
Jetty
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MJ12bot
Magnet
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Mojeek
MolokaiBot
Mozlila
Name Intelligence
NetLyzer
NetZIP
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Nmap
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
OutfoxBot
PHPCrawl
PageThing.com
Panscient
Petalbot
Pi-Monster
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
Pump
PxBroker
PyCurl
RSSingBot
RankingBot
RankingBot2
RocketCrawler
SEOkicks
SalesIntelligent
Scrapy
ScrepyBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
Shodan
SiteLockSpider
SiteSnagger
Sitebeam
Sitevigil
SlySearch
Snake
Snapbot
Snoopy
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
Sqlworm
Sqworm
Stripper
Sucuri
SuperBot
SurveyBot
Suzuran
T0PHackTeam
Teleport
Telesphorep
TheNomad
Thumbor
Titan
Toweyabot
Turnitin
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
WallpapersHD
WeSEE
Web Collage
Web Fuck
Web Pix
Web Sauger
WebBandit
WebFetch
WebReaper
WebWhacker
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt
check1.exe
com.plumanalytics
crawl.sogou.com
dataforseo.com
eCatch
evc-batch
gopher
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-trivial
meanpathbot
mediawords
oBot
page scorer
plumanalytics
polaris version
probe-image-size
s1z.ru
scan.lol
seobility
seocompany.store
seostar
sexsearcher
sogouspider
tAkeOut
trendiction.com
webpros.com
x09Mozilla