nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-03-20 22:07:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
ADmantX
ASPSeek
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anarchy99
Aspiegel
BDCbot
BLEXBot
Backlink-Ceck
Badass
Bandit
Battleztar Bazinga
Blow
BlowFish
Boardreader
BotALot
BuiltBotTough
BunnySlippers
CCBot
CheTeam
CherryPicker
ChinaClaw
Chlooe
Collector
Craftbot
Crawling at Home Project
CrunchBot
Curious
Custo
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Discobot
DomainCrawler
DomainSigmaCrawler
Ebingbong
EroCrawler
Evil
Exabot
ExtractorPro
EyeNetIE
FDM
FHscan
GT::WWW
GoZilla
GrabNet
Grabber
GrapeFX
GridBot
HMView
HTMLparser
Heritrix
HonoluluBot
HybridBot
IDBot
IRLbot
Iblog
Id-search
Image Fetch
Image Sucker
InterGET
Internet Ninja
InternetSeer
IstellaBot
JennyBot
Joomla
Jorgee
JustView
Keyword Density
Kinza
LNSpiderguy
Leap
LeechFTP
LeechGet
LexiBot
LieBaoFast
Likse
LinkScan
LinkextractorPro
LinksManager
Lipperhey
Litemage_walker
Lmspider
MSFrontPage
MSIECrawler
Mass Downloader
Mb2345Browser
Moblie Safari
Mojeek
Mr.4x3
Msrabot
Nameprotect
Needle
Net Vampire
NetAnts
NetMechanic
NetSpider
Netcraft
Netvibes
Nibbler
Nikto
Nmap
Nuclei
Offline Explorer
Offline Navigator
Openfind
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
PeoplePal
Pi-Monster
Picscout
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Probethenet
PxBroker
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Reaper
Recorder
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOstats
SMTBot
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
ScrepyBot
Seekport
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SocialRankIOBot
Spammen
SpankBot
Spanner
SputnikBot
Stripper
Sucuri
SuperHTTP
Szukacz
T0PHackTeam
Teleport
TeleportPro
TheNomad
Thumbor
TightTwatBot
Titan
Trendiction
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Auto
Web Sauger
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebSauger
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Webster
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZmEu
ZumBot
arquivo.pt
autoemailspider
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler4j
evc-batch
heritrix
instabid
internetVista monitor
isitwp.com
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
oBot
pcBrowser
s1z.ru
scalaj-http
seocompany.store
trendiction.com
x22Mozilla