nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-16 22:07:17 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
AIBOT
ASPSeek
Abonti
Acunetix
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchie
Anarchy
Ankit
Apexoo
Atomseobot
Attach
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
BlowFish
Boardreader
BotALot
Brandwatch
BuiltBotTough
BuzzSumo
CATExplorador
CCBot
Calculon
CheeseBot
Cliqzbot
Cloud mapping
CopyRightCheck
Craftbot
CrazyWebCrawler
CyotekWebCopy
DIIbot
DTS Agent
DataCha0s
Deusu
Digincore
Dirbuster
Disco
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Dotbot
Download Wonder
Drip
Ebingbong
Ecxi
ExtLinksBot
Ezooms
FDM
FlashGet
Foobot
FyberSpider
Fyrebot
GT::WWW
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
HMView
HTTP::Lite
HTTrack
HaosouSpider
Havij
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
Id-search
Indy Library
InfoNaviRobot
Internet Ninja
Iria
Iskanie
IstellaBot
JikeSpider
Jorgee
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
Lftp
Lightspeedsystems
Likse
LinkWalker
LinkextractorPro
LinqiaRSSBot
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Majestic12
Masscan
Mata Hari
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Mojeek
MolokaiBot
Mozlila
Msrabot
NPbot
Name Intelligence
Nameprotect
NearSite
Needle
NetAnts
NetLyzer
NetSpider
NetZIP
Nikto
Ninja
Nmap
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OutclicksBot
PHPCrawl
Page Analyzer
PageScorer
Pandalytics
Pi-Monster
PictureFinder
Piepmatz
ProPowerBot
ProWebWalker
Pu_iN
PyCurl
RSSingBot
Rankivabot
Re-re
ReGet
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
Scanbot
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
Sitevigil
Snake
Snoopy
SocialRankIOBot
SputnikBot
Sqlworm
Sqworm
Steeler
TeleportPro
TightTwatBot
Toata
Trendictionbot
True_Robot
Turnitin
Twice
VB Project
Vagabondo
VoidEYE
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
WeSEE
Web Sucker
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebReaper
WebSauger
WebStripper
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteQuester
Webster
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Zeus
Zitebot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
autoemailspider
clark-crawler
cognitiveseo
crawler.feedback
domainsproject.org
facebookscraper
instabid
ips-agent
isitwp.com
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
probe-image-size
ripz
s1z.ru
scalaj-http
seoscanners
sitechecker.pro
siteripz
sp_auditbot
spyfu
trendiction.com
webpros.com