nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-12 22:07:04 +00:00

250 lines
2.6 KiB
Text

ADmantX
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Alexibot
Alligator
Anarchy
Apexoo
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BackStreet
BatchFTP
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
Boardreader
Buck
Buddy
BuiltWith
CODE87
Cegbfeieh
ChinaClaw
Chlooe
Citoid
Claritybot
Cliqzbot
Cogentbot
Cosmos
Craftbot
CrazyWebCrawler
Custo
DSearch
DTS Agent
Deusu
DigitalPebble
Disco
Discobot
DnBCrawler-Analytics
DnyzBot
Domains Project
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
EroCrawler
Exabot
Express WebPictures
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
Flunky
Freeuploader
FrontPage
G-i-g-a-b-o-t
Genieo
GetRight
GetWeb
Getintent
Go!Zilla
Gotit
GrapeFX
GrapeshotCrawler
HTTrack
HaosouSpider
Harvest
Heritrix
IDBot
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Internet Ninja
JennyBot
JetCar
JikeSpider
JustView
Kinza
LNSpiderguy
Lanshanbot
LeechFTP
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
Mag-Net
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
MolokaiBot
NPbot
Nessus
NetLyzer
NetSpider
NetZIP
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Not
Offline Navigator
OnCrawl
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Pi-Monster
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
PxBroker
PyCurl
Quick-Crawler
RankingBot
RankingBot2
Re-re
Reaper
RedesScrapy
RocketCrawler
SEOkicks
SEOprofiler
SMTBot
Scanbot
Scrapy
Screaming
SearchmetricsBot
SemanticJuice
SemrushBot
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Snake
Sogou web spider
Sottopop
SputnikBot
Sqlworm
Sqworm
T8Abot
TeleportPro
Telesoft
Telesphorep
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Twice
URLy Warning
UnisterBot
Upflow
Vacuum
VeriCiteCrawler
Voil
Voltron
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
Web Auto
Web Collage
Web Sauger
Web Sucker
WebAuto
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebZIP
Webalta
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
WinHTTrack
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zermelo
adscanner
check1.exe
coccocbot
dataforseo.com
domainsproject.org
facebookscraper
instabid
isitwp.com
lwp-request
muhstik-scan
s1z.ru
satoristudio.net
seobility
seostar
sexsearcher
sitechecker.pro
spyfu
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
xpymep1.exe
zauba.io
zgrab