nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-03 22:07:17 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
ALittle Client
Aboundex
Acunetix
Anarchy
Anarchy99
Ankit
AwarioSmartBot
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Black Hole
BlackWidow
Boardreader
Brandprotect
Brandwatch
Buck
BuiltBotTough
Bullseye
Cegbfeieh
CheeseBot
Chlooe
Citoid
Claritybot
Cloud mapping
Collector
Copier
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
CrunchBot
DIIbot
DSearch
DatabaseDriverMysqli
Devil
Digincore
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
EirGrabber
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
Fuzz
FyberSpider
G-i-g-a-b-o-t
Getintent
Grabber
HMView
Havij
Hloader
Iblog
InfoNaviRobot
InterGET
Iskanie
JOC Web Spider
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MSFrontPage
MSIECrawler
MTRobot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Minefield
Moblie Safari
Msrabot
Musobot
Name Intelligence
Netcraft
Nutch
OpenLinkProfiler
Openvas
OrangeBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
Pi-Monster
PictureFinder
Pockey
ProPowerBot
QueryN Metasearch
Quick-Crawler
RankingBot2
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
SalesIntelligent
ScanAlert
Scanbot
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
SeobilityBot
Siphon
Site Sucker
SiteExplorer
SiteSucker
Siteimprove
SlySearch
Snapbot
Sociscraper
Sogou web spider
Spanner
Sqworm
Stripper
SurveyBot
Szukacz
T0PHackTeam
The Intraformant
TheNomad
Thumbor
Titan
Trendiction
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
URLy.Warning
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Fuck
Web Pix
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebReaper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whatweb
Woobot
Wprecon
YoudaoBot
ZoomBot
ZumBot
arquivo.pt
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
evc-batch
instabid
isitwp.com
lwp-request
lwp-trivial
meanpathbot
netEstate NE Crawler
page scorer
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
siteripz
sogouspider
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
xpymep1.exe
zauba.io