nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-20 10:37:43 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ADmantX
ALittle Client
AiHitBot
Aipbot
Alligator
Anarchie
Anarchy
Anthill
Apexoo
Atomseobot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bandit
Black Hole
BlackWidow
Blow
BlowFish
BotALot
Buck
Buddy
CODE87
Calculon
CazoodleBot
CensysInspect
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DataCha0s
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
Domains Project
Dotbot
Drip
EMail Wolf
EirGrabber
EroCrawler
Evil
Extractor
EyeNetIE
FHscan
FlashGet
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetWeb
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
Grafula
GridBot
HEADMasterSEO
HTTP::Lite
Heritrix
Humanlinks
IDBTE4M
IDBot
Iblog
IndeedBot
InfoNaviRobot
InfoTekies
Iskanie
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Majestic-SEO
MarkWatch
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Minefield
Mojolicious
Musobot
NICErsPRO
Nameprotect
Navroad
NearSite
Needle
Nessus
Netcraft
Nettrack
NimbleCrawler
Not
Offline Explorer
Offline Navigator
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
Pandalytics
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RealDownload
RedesScrapy
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
Scanbot
Scrapy
SearchmetricsBot
Seekport
SentiBot
Seomoz
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Siteimprove
SmartDownload
Snapbot
SpaceBison
SpankBot
Spinn3r
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
TeleportPro
The Intraformant
Titan
Trendiction
Trendictionbot
Turingos
Twice
UnisterBot
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Pix
WebAuto
WebCollage
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebReaper
WebWhacker
Website Quester
Whack
Who.is Bot
Widow
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zauba
ZmEu
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
check1.exe
clark-crawler
coccocbot
dataforseo.com
demandbase-bot
eCatch
instabid
isitwp.com
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
oBot
page scorer
polaris version
ripz
s1z.ru
satoristudio.net
scan.lol
seocompany.store
seoscanners
seostar
serpstatbot
sogouspider
sp_auditbot
sysscan
tAkeOut
webgains-bot
webmeup-crawler
xpymep1.exe
zauba.io