nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-07 22:05:32 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
Abonti
Alligator
Atomseobot
AwarioRssBot
BDFetch
Battleztar Bazinga
Bitacle
BlackWidow
Brandprotect
Brandwatch
Buck
CheTeam
ChinaClaw
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
Dirbuster
Domains Project
EMail Siphon
EMail Wolf
ExtractorPro
FemtosearchBot
FlashGet
FyberSpider
GT::WWW
Getintent
Gotit
HTTP::Lite
HTTrack
IDBTE4M
Iblog
Image Fetch
Indy Library
Iskanie
JOC Web Spider
Joomla
JustView
Keybot Translation-Search-Machine
LNSpiderguy
Leap
LinqiaScrapeBot
Litemage_walker
Ltx71
MSFrontPage
Mag-Net
Magnet
MarkMonitor
MolokaiBot
Offline Explorer
OpenLinkProfiler
Openvas
Petalbot
Pi-Monster
PictureFinder
Pockey
RSSingBot
Reaper
Rogerbot
ScanAlert
Scrapy
Site Sucker
SiteExplorer
Snake
Sqlworm
SuperBot
Teleport
The Intraformant
Titan
Turnitin
VeriCiteCrawler
WASALive-Bot
WeSEE
Web Sauger
WebAuto
WebCopier
WebLeacher
WebReaper
Webshag
WebsiteExtractor
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Zauba
ZumBot
arquivo-web-crawler
cah.io.community
crawler.feedback
demandbase-bot
domainsproject.org
instabid
isitwp.com
voyagerx.com