nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-03-20 10:09:40 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ALittle Client
Abonti
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anthill
Apexoo
Atomseobot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow
BlowFish
BotALot
BuiltBotTough
CODE87
Calculon
CherryPicker
Chlooe
Citoid
Cliqzbot
Copier
Cosmos
CrazyWebCrawler
Crescent
DSearch
DataCha0s
Demon
Disco
Discoverybot
DomCopBot
DomainAppender
DomainCrawler
Dotbot
Evil
Exabot
Express WebPictures
ExtractorPro
EyeNetIE
Ezooms
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GalaxyBot
GermCrawler
GetRight
Getintent
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HTTP::Lite
HaosouSpider
Havij
Heritrix
Hloader
HybridBot
Iblog
Id-search
IlseBot
IndeedBot
InternetSeer
Iria
Jbrofuzz
JetCar
Joomla
Jorgee
JustView
Jyxobot
Kinza
Leap
Lftp
LibWeb
Likse
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Masscan
Meanpathbot
Metauri
Minefield
Moblie Safari
MolokaiBot
NPbot
Name Intelligence
Navroad
NearSite
Needle
Net Vampire
NetAnts
NetLyzer
Netvibes
NextGenSearchBot
Nimbostratus
Octopus
Offline Explorer
Openfind
OrangeBot
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Panscient
Papa Foto
Petalbot
Pi-Monster
Piepmatz
Pixray
Probethenet
Pu_iN
Pump
PyCurl
RankFlex
Rankivabot
RankurBot
RealDownload
RebelMouse
Recorder
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOstats
SISTRIX
ScanAlert
Scanbot
Screaming
Semrush
SeoSiteCheckup
SeobilityBot
Shodan
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
SlySearch
Snake
SpankBot
SputnikBot
Sqworm
Sucker
SuperBot
Surfbot
Suzuran
Swiftbot
Szukacz
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Turingos
Turnitin
TurnitinBot
URLy.Warning
UnisterBot
V-BOT
VB Project
Virusdie
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Pix
WebAuto
WebBandit
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
crawl.sogou.com
crawler4j
dataforseo.com
evc-batch
facebookscraper
isitwp.com
iubenda-radar
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
page scorer
pcBrowser
probe-image-size
scalaj-http
seocompany.store
seoscanners
sitechecker.pro
siteripz
sp_auditbot
sysscan
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla