nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-07-18 22:06:56 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
ALittle Client
Aboundex
Aboundexbot
Acunetix
Aipbot
AllSubmitter
AlphaBot
Anarchy
Ankit
Asterias
Atomseobot
Attach
BBBike
BDCbot
Badass
Battleztar Bazinga
Bitacle
Blow
Bolt
Brandwatch
Buck
BuiltWith
CODE87
CSHttp
CheTeam
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copyscape
Craftbot
Crescent
CrunchBot
Curious
Custo
DTS Agent
DataCha0s
Deusu
Dirbuster
Dispatch
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Drip
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FHscan
Flunky
FrontPage
FyberSpider
Getintent
Go!Zilla
Go-Ahead-Got-It
GrapeFX
HMView
HTMLparser
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HonoluluBot
IDBot
IRLbot
Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoTekies
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
Lightspeedsystems
Litemage_walker
Ltx71
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mediatoolkitbot
Microsoft URL Control
Minefield
Mojeek
Mojolicious
MolokaiBot
Mozlila
Msrabot
Musobot
NICErsPRO
NPbot
Navroad
Needle
Nessus
Net Vampire
Nettrack
NextGenSearchBot
Nimbostratus
Nmap
Nutch
OutfoxBot
PageAnalyzer
PeoplePal
Petalbot
Picscout
Pimonster
Pockey
Psbot
QueryN Metasearch
RSSingBot
RankingBot
RealDownload
Reaper
Recorder
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SMTBot
ScanAlert
Scrapy
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SeoSiteCheckup
Shodan
Site Sucker
SiteExplorer
SiteSnagger
Siteimprove
SmartDownload
Snake
Snoopy
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpankBot
Spbot
Sqlworm
SuperBot
Teleport
Telesoft
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
URLy.Warning
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WISENutbot
WPScan
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Fuck
Web Pix
Web Sauger
WebBandit
WebEnhancer
WebFuck
WebGo IS
WebStripper
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
Webster
Whack
Whatweb
Widow
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zermelo
ZmEu
ZoomBot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
check1.exe
clark-crawler
coccocbot
crawler.feedback
dataforseo.com
domainsproject.org
eCatch
facebookscraper
heritrix
ips-agent
muhstik-scan
polaris version
s1z.ru
scan.lol
seostar
sitechecker.pro
sp_auditbot
sysscan
ubermetrics-technologies.com
webmeup-crawler
webprosbot
xpymep1.exe
zauba.io