nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-09-26 10:09:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Alexibot
AllSubmitter
AlphaBot
Ankit
Apexoo
Aspiegel
BLEXBot
BackWeb
BacklinkCrawler
Badass
BatchFTP
Battleztar Bazinga
BlowFish
Boardreader
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
ChinaClaw
Cloud mapping
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
Demon
Deusu
DigitalPebble
Discobot
Dispatch
DittoSpyder
DomainCrawler
Domains Project
Download Wonder
EMail Wolf
Ecxi
EirGrabber
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
FHscan
Fimap
FlashGet
Flunky
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
Go!Zilla
GoZilla
Gotit
GrapeFX
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Hloader
IDBTE4M
IDBot
IRLbot
Iblog
Image Sucker
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
Joomla
JustView
Kenjin Spider
Kinza
LWP::Simple
LeechFTP
LibWeb
Libwhisker
Linkbot
LinkpadBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mozlila
Mr.4x3
Msrabot
Nameprotect
Navroad
NearSite
NetLyzer
Nettrack
Niki-bot
Nimbostratus
Ninja
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
PeoplePal
Pi-Monster
PleaseCrawl
Pockey
Probethenet
Psbot
Pu_iN
Pump
PxBroker
RankActive
RankingBot2
Rankivabot
RankurBot
ReGet
Reaper
Recorder
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
ScoutJet
Scrapy
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSucker
Sitevigil
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpankBot
SputnikBot
Sqlworm
Steeler
Sucuri
SuperHTTP
Teleport
Telesoft
The Intraformant
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
Turingos
TwengaBot
Twice
Typhoeus
URLy Warning
UnisterBot
VB Project
VCI
VeriCiteCrawler
VidibleScraper
VoidEYE
WASALive-Bot
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Fetch
Web Pix
WebCopier
WebFuck
WebPix
WebSauger
WebZIP
Website Quester
WebsiteQuester
Wonderbot
Woobot
Wprecon
YoudaoBot
Zade
Zauba
Zeus
ZoomBot
ZumBot
arquivo.pt
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
domainsproject.org
evc-batch
facebookscraper
heritrix
internetVista monitor
lwp-trivial
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
probe-image-size
ripz
scan.lol
seoscanners
seostar
sexsearcher
sogouspider
tAkeOut
webmeup-crawler