nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-12-21 22:07:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ALittle Client
ASPSeek
AfD-Verbotsverfahren
AiHitBot
Anarchy
Anarchy99
Ankit
Anthill
Apexoo
AwarioRssBot
BDCbot
BDFetch
BackDoorBot
BackStreet
BatchFTP
Bigfoot
Blackboard
Blow
BotALot
Brandwatch
BunnySlippers
CCBot
CSHttp
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cogentbot
CopyRightCheck
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
DataCha0s
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Discoverybot
Dispatch
DnyzBot
DomainAppender
Domains Project
Dragonfly
Drip
ECCP/1.0
Ebingbong
Ecxi
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
FHscan
Fimap
Firefox/7.0
Flunky
FrontPage
FyberSpider
GT::WWW
Getintent
Gigabot
Go!Zilla
Grabber
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
Harvest
Humanlinks
IDBTE4M
Image Sucker
Indy Library
InterGET
InternetSeer
JOC Web Spider
JamesBOT
JennyBot
JetCar
Jetty
LNSpiderguy
Lanshanbot
Leap
LexiBot
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
Lipperhey
Lipperhey Spider
Lmspider
MQQBrowser
MSFrontPage
Magnet
Majestic12
Masscan
Mediatoolkitbot
Metauri
MicroMessenger
Minefield
Moblie Safari
Mojolicious
Mozlila
Musobot
Nameprotect
Navroad
Needle
NetZIP
Nettrack
Nibbler
Ninja
Not
Nutch
OpenLinkProfiler
OutclicksBot
PECL::HTTP
PageScorer
PageThing.com
Pandalytics
Panscient
Piepmatz
Pimonster
Pixray
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RebelMouse
RedesScrapy
RepoMonkey
Ripper
SEOstats
SISTRIX
ScanAlert
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteSnagger
Sitevigil
Snapbot
Snoopy
Sociscraper
Sogou web spider
SputnikBot
Sqworm
Steeler
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
T8Abot
Telesoft
Telesphorep
The Intraformant
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT
VCI
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WWW::Mechanize
Web Fuck
Web Pix
WebAuto
WebEnhancer
WebImageCollector
WebLeacher
WebReaper
WebSucker
Webalta
Website Quester
WebsiteExtractor
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
Xaldon WebSpider
YoudaoBot
Zade
Zermelo
Zitebot
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler4j
domainsproject.org
eCatch
facebookscraper
gopher
heritrix
instabid
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
oBot
page scorer
plumanalytics
ripz
scalaj-http
seobility
seostar
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla