nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-24 10:09:21 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
ASPSeek
Aboundex
Aipbot
Alexibot
AllSubmitter
Anarchy99
Ankit
Asterias
AwarioRssBot
BBBike
BDFetch
BackStreet
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
Blow
BlowFish
Boardreader
Brandprotect
Buck
BuiltBotTough
BunnySlippers
CCBot
CODE87
CazoodleBot
CheeseBot
ChinaClaw
Cosmos
Custo
DTS Agent
Demon
Deusu
Digincore
DigitalPebble
Disco
Discobot
DittoSpyder
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Express WebPictures
ExtractorPro
EyeNetIE
FDM
Fuzz
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetWeb
Gigabot
Go-Ahead-Got-It
GrabNet
GrapeFX
GridBot
Haansoft
Hloader
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Sucker
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
JamesBOT
Jbrofuzz
JennyBot
JetCar
Larbin
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Linkbot
LinkpadBot
LinksManager
Litemage_walker
MFC_Tear_Sample
MIIxpc
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mata Hari
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Mozlila
Msrabot
Musobot
Name Intelligence
NearSite
Net Vampire
NetAnts
NetMechanic
NetZIP
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Ninja
Nmap
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
POE-Component-Client-HTTP
PageThing.com
Panscient
Pavuk
PeoplePal
Picscout
Picsearch
Pimonster
Pixray
Pockey
Probethenet
Pump
PxBroker
RSSingBot
RankFlex
RankingBot
RankingBot2
Re-re
ReGet
RealDownload
Recorder
Ripper
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
Scrapy
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spanner
Spbot
Sqlmap
Sucker
SuperBot
Surfbot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
The Intraformant
Titan
Toweyabot
Tracemyfile
TwengaBot
URLy Warning
V-BOT
VB Project
VeriCiteCrawler
Voil
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Enhancer
Web Sauger
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebLeacher
WebPix
WebsiteExtractor
Widow
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zermelo
ZyBorg
adscanner
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
clark-crawler
com.plumanalytics
domainsproject.org
evc-batch
facebookscraper
heritrix
internetVista monitor
ips-agent
lwp-request
meanpathbot
netEstate NE Crawler
page scorer
polaris version
ripz
s1z.ru
seoscanners
serpstatbot
sysscan
ubermetrics-technologies.com
webpros.com
zauba.io