nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-20 10:11:25 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Ankit
Apexoo
Asterias
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
BatchFTP
BlackWidow
Blow
Bolt
Buck
Buddy
CheTeam
ChinaClaw
Citoid
Claritybot
Copier
Copyscape
Crescent
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
Deusu
Devil
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
ECCP/1.0
Ebingbong
Ecxi
EirGrabber
EroCrawler
Express WebPictures
Extreme Picture Finder
EyeNetIE
Ezooms
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Havij
Heritrix
Hloader
HybridBot
IDBTE4M
IDBot
Id-search
Image Sucker
Indy Library
Intelliseek
InterGET
InternetSeer
Iskanie
JamesBOT
Jyxobot
LNSpiderguy
Larbin
Leap
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkWalker
Linkdexbot
LinkpadBot
LinksManager
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MSIECrawler
MTRobot
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Mister PiX
Moblie Safari
MolokaiBot
Name Intelligence
NetLyzer
NetSpider
NetZIP
Netvibes
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PHPCrawl
PageGrabber
PageThing.com
Pavuk
Picscout
PictureFinder
Pimonster
ProWebWalker
Psbot
PyCurl
RankFlex
ReGet
Reaper
RebelMouse
RedesScrapy
RepoMonkey
SEOkicks
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScanAlert
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Seomoz
Shodan
SiteCheckerBotCrawler
SiteSucker
Sitebeam
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sosospider
SpaceBison
Spanner
Spbot
Steeler
Sucker
SuperHTTP
Surfbot
SurveyBot
Szukacz
T8Abot
Teleport
Telesphoreo
The Intraformant
Toweyabot
Trendiction
Turnitin
TurnitinBot
Twice
URLy Warning
URLy.Warning
UnisterBot
VB Project
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
Voltron
WASALive-Bot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
WebCollage
WebCopier
WebFuck
WebPix
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
WebsiteExtractor
Whack
Woobot
Wotbox
Wprecon
Zade
Zeus
ZmEu
adscanner
archive.org_bot
arquivo.pt
autoemailspider
coccocbot-web
crawler.feedback
crawler4j
domainsproject.org
instabid
ips-agent
isitwp.com
iubenda-radar
meanpathbot
mediawords
s1z.ru
satoristudio.net
scalaj-http
seoscanners
sogouspider
sp_auditbot
spyfu
ubermetrics-technologies.com
zauba.io