nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-22 22:04:46 +00:00

100 lines
1.1 KiB
Text

404checker
404enemy
ASPSeek
Aipbot
Anarchy99
Atomseobot
BetaBot
Bitacle
BunnySlippers
CODE87
ChinaClaw
Cloud mapping
Cocolyzebot
Crawling at Home Project
CrazyWebCrawler
DSearch
Discobot
DomainStatsBot
Download Wonder
Ebingbong
Exabot
FlashGet
FyberSpider
Gigabot
GoZilla
Hloader
IRLbot
Image Fetch
Indy Library
Iskanie
JOC Web Spider
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
LexiBot
LibWeb
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MJ12bot
Mag-Net
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
MegaIndex.ru
Metauri
Moblie Safari
Nessus
NetAnts
NetLyzer
NimbleCrawler
OpenLinkProfiler
Openfind
OutfoxBot
Pavuk
Petalbot
Piepmatz
Pu_iN
QueryN Metasearch
RedesScrapy
Screaming
Searchestate
SeobilityBot
Sitebeam
Spammen
Sqworm
Turnitin
TwengaBot
VB Project
VelenPublicWebCrawler
Virusdie
Voil
WPScan
WallpapersHD
Web Fuck
WebFetch
WebSucker
WebWhacker
Webshag
WebsiteExtractor
Whack
Whatweb
Who.is Bot
Wotbox
Wprecon
Zeus
cohere-ai
crawler.feedback
crawler4j
dataforseobot
linkdexbot
magpie-crawler
meanpathbot
plumanalytics
seocompany.store
seoscanners
sitechecker.pro
webprosbot
zauba.io
zgrab