nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-17 22:04:48 +00:00

100 lines
1.1 KiB
Text

AfD-Verbotsverfahren
Alexibot
AllSubmitter
AwarioRssBot
BBBike
Badass
Bandit
Bitacle
Bolt
CherryPicker
Collector
CrazyWebCrawler
DBLBot
DIIbot
Deusu
Dirbuster
DomainSigmaCrawler
Drip
Ebingbong
Ecxi
G-i-g-a-b-o-t
Genieo
GetRight
GoZilla
Grafula
HTMLparser
Harvest
Hloader
Humanlinks
Image Fetch
Image Sucker
JOC Web Spider
Jbrofuzz
JikeSpider
Jorgee
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
Leap
Libwhisker
LieBaoFast
Linkbot
Litemage_walker
MauiBot
Mb2345Browser
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Navroad
Nessus
NetMechanic
NetSpider
NextGenSearchBot
NimbleCrawler
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
Pandalytics
PictureFinder
Proximic
PxBroker
QueryN Metasearch
RebelMouse
SEOlyticsCrawler
Scrapy
SearchmetricsBot
SemanticJuice
Site Sucker
Snapbot
Sociscraper
Spinn3r
SuperBot
Surfbot
Teleport
Telesoft
TightTwatBot
Vagabondo
Web Auto
WebReaper
WebSauger
Widow
Wprecon
ZmEu
arquivo.pt
coccocbot
crawl.sogou.com
crawler.feedback
domainsproject.org
eCatch
ips-agent
lwp-trivial
meanpathbot
probe-image-size
s1z.ru
scan.lol
seostar
sexsearcher
ubermetrics-technologies.com
zgrab