nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-18 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
AIBOT
ASPSeek
Abonti
AllSubmitter
Alligator
Anarchy
Anthill
Atomseobot
Attach
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bitacle
Blackboard
Blow
Brandprotect
Brandwatch
Buck
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Calculon
CensysInspect
CheTeam
Chlooe
Cliqzbot
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DIIbot
DatabaseDriverMysqli
Deusu
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Drip
ECCP/1.0
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
ExtractorPro
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
Gigabot
Go-Ahead-Got-It
Gotit
GrapeFX
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
Harvest
Hloader
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
JamesBOT
Jbrofuzz
JetCar
Jorgee
Kinza
Larbin
LeechFTP
Libwhisker
Linkbot
Linkdexbot
LinksManager
LinqiaRSSBot
Lmspider
Ltx71
MIDown tool
MIIxpc
MTRobot
Magnet
Mail.RU_Bot
Majestic-SEO
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Minefield
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
NPbot
Needle
NetAnts
NetLyzer
Nettrack
NimbleCrawler
Nimbostratus
Nmap
Nutch
Offline Explorer
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
PHPCrawl
Page Analyzer
Pavuk
PeoplePal
Pi-Monster
Picscout
Pimonster
Pixray
Pockey
Probethenet
Quick-Crawler
RankActive
RankFlex
RankingBot2
RankurBot
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOstats
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SentiBot
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitebeam
SlySearch
Sosospider
Spinn3r
Stripper
Sucuri
SuperBot
SuperHTTP
Suzuran
T8Abot
Teleport
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TurnitinBot
URLy.Warning
UnisterBot
V-BOT
VB Project
VidibleScraper
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWWOFFLE
Wallpapers
Web Auto
Web Pix
Web Sauger
Web Sucker
WebAuto
WebCollage
WebStripper
WebSucker
WebWhacker
WebZIP
Website Quester
WebsiteQuester
Wonderbot
Wprecon
Xaldon WebSpider
YoudaoBot
Zermelo
Zeus
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
cognitiveseo
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
heritrix
isitwp.com
iubenda-radar
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
probe-image-size
scalaj-http
seostar
serpstatbot
sexsearcher
sogouspider
sp_auditbot
spyfu
sysscan
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
zauba.io