nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-31 22:07:31 +00:00

250 lines
2.5 KiB
Text

404checker
80legs
ADmantX
Abonti
Aboundex
Acunetix
AiHitBot
Alexibot
AlphaBot
Ankit
Attach
AwarioRssBot
BDCbot
BLEXBot
BackDoorBot
BackStreet
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
Black Hole
Bolt
Brandprotect
Bullseye
BunnySlippers
CODE87
Claritybot
Cocolyzebot
Copyscape
Craftbot
CrazyWebCrawler
CrunchBot
Curious
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Dirbuster
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
EMail Wolf
EasyDL
Ecxi
Evil
Exabot
Extractor
ExtractorPro
Ezooms
FHscan
FemtosearchBot
Fimap
Foobot
FrontPage
G-i-g-a-b-o-t
Genieo
GermCrawler
Getintent
Gigabot
Go!Zilla
Gotit
Grafula
GridBot
HEADMasterSEO
Harvest
Havij
Humanlinks
HybridBot
IDBTE4M
IndeedBot
Indy Library
Intelliseek
Internet Ninja
InternetSeer
Iria
Jetty
JikeSpider
Jorgee
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LeechGet
LibWeb
LieBaoFast
LinkScan
LinkWalker
LinkextractorPro
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic12
Masscan
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mr.4x3
NPbot
Nessus
Net Vampire
NetSpider
NetZIP
Netvibes
Niki-bot
Nimbostratus
Ninja
Nmap
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
ProPowerBot
ProWebWalker
Probethenet
PyCurl
RankingBot2
Re-re
ReGet
RealDownload
RebelMouse
RepoMonkey
SBIder
SEOprofiler
SEOstats
SISTRIX
ScoutJet
Scrapy
ScreenerBot
SearchmetricsBot
Seekport
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Siteimprove
Sitevigil
Snake
Snoopy
SocialRankIOBot
Sosospider
SpaceBison
Spammen
Spbot
Sqworm
Stripper
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
T0PHackTeam
Teleport
Telesoft
Toata
Toweyabot
Trendiction
Trendictionbot
Turnitin
URLy Warning
URLy.Warning
UnisterBot
VCI
VelenPublicWebCrawler
Voil
WASALive-Bot
WPScan
Wallpapers/3.0
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher
WebReaper
Webalta
WebmasterWorldForumBot
Whack
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xenu
Zermelo
adscanner
arquivo.pt
autoemailspider
backlink-check
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
eCatch
evc-batch
heritrix
ips-agent
isitwp.com
lwp-request
magpie-crawler
mediawords
page scorer
plumanalytics
satoristudio.net
scalaj-http
scan.lol
seocompany.store
sexsearcher
sogouspider
sp_auditbot
spyfu
trendiction.com
webgains-bot
webpros.com
x22Mozilla