nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-02-24 10:09:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
AIBOT
ALittle Client
ASPSeek
Acunetix
Aipbot
Alexibot
Alligator
Apexoo
Asterias
Atomseobot
Attach
BBBike
Badass
BatchFTP
BlackWidow
BotALot
Brandprotect
BuiltBotTough
Bullseye
CCBot
CSHttp
Calculon
CazoodleBot
CensysInspect
CheTeam
Citoid
Cliqzbot
Cloud mapping
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DSearch
Digincore
DigitalPebble
Discoverybot
DittoSpyder
DomCopBot
DomainAppender
Domains Project
Download Wonder
Drip
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Evil
ExtLinksBot
ExtractorPro
FDM
FHscan
FemtosearchBot
FlashGet
Flunky
Foobot
Freeuploader
Genieo
GermCrawler
Go!Zilla
Gotit
Grafula
HTMLparser
HTTP::Lite
HTTrack
Heritrix
Hloader
HybridBot
IDBTE4M
IRLbot
Iblog
InfoTekies
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Jyxobot
Kenjin Spider
Kozmosbot
Larbin
Leap
LexiBot
LieBaoFast
Likse
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIIxpc
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
Metauri
Microsoft Data Access
Microsoft URL Control
Morfeus Fucking Scanner
Musobot
NPbot
Name Intelligence
NearSite
Needle
Net Vampire
NetMechanic
Netcraft
Nettrack
Nibbler
Ninja
Nmap
Not
Nutch
Page Analyzer
PageAnalyzer
PageScorer
Petalbot
Pi-Monster
Picscout
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
Pu_iN
Pump
Quick-Crawler
RSSingBot
RankActive
RankFlex
Rankivabot
Re-re
RealDownload
Recorder
RedesScrapy
SBIder
SEOprofiler
SEOstats
SISTRIX
ScanAlert
ScoutJet
Screaming
ScreenerBot
Searchestate
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
SmartDownload
Snoopy
SpaceBison
SpankBot
Spanner
Sqlworm
Surfbot
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Titan
Toweyabot
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WEBDAV
WWW-Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Fuck
WebFetch
WebImageCollector
WebLeacher
WebReaper
WebSucker
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Webster
Whack
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zauba
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
com.plumanalytics
dataforseo.com
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
polaris version
probe-image-size
s1z.ru
scalaj-http
seocompany.store
seoscanners
sitechecker.pro
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io