nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-12-14 10:09:19 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
80legs
AIBOT
ASPSeek
Abonti
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AlphaBot
Anthill
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BetaBot
BlackWidow
Boardreader
Bolt
BuiltWith
Bullseye
BuzzSumo
CODE87
CazoodleBot
CheTeam
ChinaClaw
Claritybot
Cogentbot
Copier
Craftbot
Crescent
Curious
Custo
DSearch
DatabaseDriverMysqli
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Discobot
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainSigmaCrawler
Domains Project
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Evil
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
FHscan
Fimap
Firefox/7.0
FlashGet
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
GT::WWW
GermCrawler
GetRight
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
Haansoft
Heritrix
HybridBot
IDBot
Iblog
Intelliseek
InternetSeer
Iria
Iskanie
IstellaBot
JOC Web Spider
JetCar
Jetty
JikeSpider
Joomla
Jorgee
JustView
Kenjin Spider
Lanshanbot
LexiBot
Lftp
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MIIxpc
Majestic12
MarkMonitor
Mass Downloader
MegaIndex.ru
Metauri
Microsoft Data Access
Mister PiX
Moblie Safari
Mozlila
Mr.4x3
NICErsPRO
Navroad
Needle
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Ninja
Not
Nutch
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
PHPCrawl
POE-Component-Client-HTTP
Pi-Monster
Picsearch
PictureFinder
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pump
RankActive
RankActiveLinkBot
RankFlex
RankurBot
Re-re
ReGet
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SMTBot
SalesIntelligent
Scrapy
SeoSiteCheckup
Seomoz
SiteCheckerBotCrawler
SiteExplorer
Sitebeam
Snake
Snoopy
SocialRankIOBot
Spammen
SputnikBot
Sqlmap
SuperHTTP
Surfbot
Suzuran
T0PHackTeam
Teleport
Telesphoreo
Telesphorep
TheNomad
Thumbor
TightTwatBot
Tracemyfile
TurnitinBot
UnisterBot
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Auto
Web Sauger
Web Sucker
WebCollage
WebEnhancer
WebReaper
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Widow
WinHTTrack
Zade
Zeus
Zitebot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
facebookscraper
heritrix
internetVista monitor
isitwp.com
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
plumanalytics
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
sysscan
trendiction.com
voyagerx.com
webpros.com
zauba.io