nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-12 22:06:59 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
ADmantX
AIBOT
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Alexibot
AlphaBot
Anarchie
Anarchy99
Ankit
Attach
AwarioRssBot
Backlink-Ceck
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
Bolt
Brandprotect
Buck
Bullseye
CODE87
CazoodleBot
CensysInspect
CheTeam
CherryPicker
Cloud mapping
Cocolyzebot
Copier
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
DBLBot
DataCha0s
Devil
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
Exabot
Extreme Picture Finder
FHscan
Fimap
Freeuploader
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetWeb
Getintent
Gotit
Grabber
GrapeFX
HEADMasterSEO
HMView
HTTP::Lite
Humanlinks
HybridBot
IDBTE4M
IRLbot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jyxobot
LNSpiderguy
LWP::Simple
Leap
LeechGet
LexiBot
LibWeb
Likse
Linkdexbot
LinkextractorPro
LinqiaRSSBot
Litemage_walker
MIDown tool
MIIxpc
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Masscan
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Minefield
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Name Intelligence
Nameprotect
Navroad
Needle
NetAnts
NetMechanic
NetSpider
NetZIP
Nimbostratus
Ninja
Not
Nutch
OnCrawl
OpenVAS
Openvas
Pavuk
PeoplePal
Picscout
Piepmatz
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankurBot
RealDownload
RebelMouse
Ripper
Rogerbot
SEOprofiler
SEOstats
SISTRIX
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
Semrush
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
Sitevigil
Snake
Snoopy
Sosospider
SpaceBison
Spbot
Sqworm
Stripper
SuperBot
Surfbot
Suzuran
Swiftbot
Szukacz
Telesphoreo
Telesphorep
TheNomad
Titan
Tracemyfile
Trendictionbot
True_Robot
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
Vagabondo
Virusdie
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Pix
WebGo IS
WebLeacher
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Webster
WinHTTrack
Wprecon
Xaldon WebSpider
Zitebot
ZoomBot
ZumBot
arquivo.pt
cah.io.community
crawler.feedback
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
heritrix
ips-agent
isitwp.com
magpie-crawler
oBot
page scorer
ripz
satoristudio.net
scalaj-http
scan.lol
seobility
seocompany.store
seoscanners
seostar
siteripz
sp_auditbot
tAkeOut
webgains-bot
x22Mozilla
xpymep1.exe
zgrab