nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-06 22:07:28 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
ADmantX
AIBOT
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
AlphaBot
Anarchy
Anarchy99
Anthill
Apexoo
Aspiegel
Asterias
AwarioRssBot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
CATExplorador
CSHttp
CensysInspect
CheTeam
Cliqzbot
Crawling at Home Project
Crescent
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
ECCP/1.0
Ecxi
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FDM
FHscan
FemtosearchBot
Firefox/7.0
Flunky
FrontPage
Fuzz
GT::WWW
Genieo
Gotit
GrapeshotCrawler
GridBot
HMView
HaosouSpider
Harvest
Heritrix
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iskanie
Jbrofuzz
JikeSpider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
Lanshanbot
Leap
LexiBot
LibWeb
LieBaoFast
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MIDown tool
MIIxpc
MSIECrawler
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MeanPath Bot
Microsoft Data Access
Minefield
Mister PiX
Mojolicious
NICErsPRO
Nameprotect
Needle
NetAnts
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nibbler
NimbleCrawler
Octopus
OnCrawl
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageAnalyzer
PeoplePal
Picscout
PictureFinder
Pimonster
Pixray
ProPowerBot
Psbot
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot
Rankivabot
ReGet
RebelMouse
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOprofiler
SEOstats
ScanAlert
Scanbot
ScoutJet
Scrapy
ScreenerBot
Seekport
Semrush
Site Sucker
SiteExplorer
Sitebeam
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Spanner
Spinn3r
SputnikBot
Steeler
SuperHTTP
Surfbot
Suzuran
Teleport
Telesoft
Telesphorep
TightTwatBot
Titan
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
URLy.Warning
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
Web Collage
Web Pix
Web Sauger
WebBandit
WebCollage
WebEnhancer
WebGo IS
WebImageCollector
WebPix
WebSucker
WebWhacker
WebZIP
WebsiteQuester
Whacker
Widow
Wonderbot
Wprecon
Zade
Zauba
ZoomBot
ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
cah.io.community
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
domainsproject.org
iubenda-radar
linkdexbot
lwp-request
meanpathbot
muhstik-scan
oBot
polaris version
satoristudio.net
scalaj-http
scan.lol
seocompany.store
serpstatbot
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.de
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zgrab