nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-25 14:22:42 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
AIBOT
Abonti
Aboundex
Alexibot
AllSubmitter
Anarchy
Anarchy99
Anthill
Aspiegel
Asterias
AwarioRssBot
BBBike
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
Bigfoot
Bitacle
Blackboard
Blow
Boardreader
Brandwatch
Buck
Buddy
BuiltBotTough
Bullseye
CATExplorador
CODE87
Chlooe
Cocolyzebot
Cogentbot
Copyscape
Cosmos
CrunchBot
Custo
DIIbot
DatabaseDriverMysqli
Deusu
DigitalPebble
Discoverybot
Domains Project
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
Ecxi
EirGrabber
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
Fimap
Firefox/7.0
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
HTTrack
Heritrix
HybridBot
IDBot
IRLbot
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JikeSpider
Jorgee
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Lftp
Libwhisker
LieBaoFast
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Moblie Safari
Musobot
NPbot
Name Intelligence
Needle
Nessus
NetSpider
Netcraft
Nettrack
Netvibes
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Octopus
Offline Navigator
Openfind
OrangeSpider
PECL::HTTP
Page Analyzer
Petalbot
Pi-Monster
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Psbot
Pu_iN
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOkicks
SMTBot
SalesIntelligent
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
Seomoz
Shodan
SiteLockSpider
SiteSucker
Sitevigil
Snake
Snapbot
Snoopy
SocialRankIOBot
Spammen
Spanner
Spbot
Spinn3r
Sqlworm
Sqworm
Stripper
SurveyBot
Swiftbot
TeleportPro
Telesoft
Thumbor
Titan
URLy Warning
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WEBDAV
WISENutbot
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebFuck
WebGo IS
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webster
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zeus
Zitebot
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
crawler.feedback
domainsproject.org
eCatch
evc-batch
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
netEstate NE Crawler
page scorer
ripz
scalaj-http
scan.lol
seostar
sexsearcher
spyfu
x22Mozilla
xpymep1.exe