nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-07-30 10:09:18 +00:00

250 lines
2.6 KiB
Text

AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anthill
Asterias
AwarioSmartBot
BDCbot
Backlink-Ceck
BacklinkCrawler
Bandit
Battleztar Bazinga
Bigfoot
Blow
BlowFish
BotALot
Buddy
BuiltBotTough
BuiltWith
CCBot
CODE87
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Citoid
Claritybot
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DIIbot
DSearch
Devil
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Domains Project
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FDM
Fimap
GetRight
Go!Zilla
Gotit
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Hloader
HonoluluBot
Humanlinks
IlseBot
Image Fetch
Image Sucker
IndeedBot
Internet Ninja
InternetSeer
Iria
Iskanie
JikeSpider
JustView
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
LexiBot
Lftp
Libwhisker
LinksManager
Litemage_walker
Ltx71
MIDown tool
MQQBrowser
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Musobot
NICErsPRO
Nameprotect
Nessus
NetAnts
NetSpider
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nmap
Not
Nutch
Offline Explorer
OnCrawl
OrangeBot
OrangeSpider
OutclicksBot
PageAnalyzer
PageThing.com
Petalbot
Pixray
PleaseCrawl
Pockey
Probethenet
Pu_iN
Pump
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RealDownload
Reaper
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
Scanbot
ScreenerBot
ScrepyBot
Semrush
SemrushBot
SeoSiteCheckup
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
Sociscraper
SpaceBison
SpankBot
Spinn3r
SputnikBot
Sqlworm
Stripper
Sucker
Swiftbot
Szukacz
Teleport
TheNomad
Thumbor
Titan
Toata
Turingos
TwengaBot
Typhoeus
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WWW-Mechanize
Wallpapers
Web Auto
Web Collage
Web Pix
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebPix
WebReaper
WebSauger
WebWhacker
Website Quester
Webster
Whatweb
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
ZoominfoBot
ZumBot
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
crawl.sogou.com
crawler.feedback
domainsproject.org
eCatch
facebookscraper
gopher
instabid
ips-agent
isitwp.com
magpie-crawler
meanpathbot
pcBrowser
polaris version
probe-image-size
satoristudio.net
scalaj-http
seobility
serpstatbot
sitechecker.pro
sogouspider
spyfu
sysscan
webgains-bot
webmeup-crawler
webpros.com
webprosbot
zauba.io
zgrab