nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-22 22:07:00 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
ADmantX
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
AlphaBot
Anarchy99
Apexoo
Asterias
AwarioRssBot
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
BatchFTP
Blackboard
Blow
Boardreader
Bolt
BotALot
Buck
Buddy
BuiltWith
BuzzSumo
CCBot
CODE87
Calculon
Cegbfeieh
CheTeam
CheeseBot
Claritybot
Cloud mapping
CopyRightCheck
Copyscape
Craftbot
CrunchBot
Curious
CyotekWebCopy
DIIbot
Digincore
DigitalPebble
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
Download Wonder
Drip
EirGrabber
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
Genieo
GetWeb
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Haansoft
HaosouSpider
Havij
Heritrix
Hloader
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
Iria
JOC Web Spider
Jbrofuzz
JetCar
Jorgee
JustView
Jyxobot
LNSpiderguy
Lanshanbot
LieBaoFast
LinkpadBot
LinksManager
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mozlila
Musobot
NPbot
NearSite
Needle
Net Vampire
NetLyzer
NetSpider
NetZIP
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Nuclei
Nutch
Octopus
OpenLinkProfiler
Openfind
Openvas
Page Analyzer
PageGrabber
Papa Foto
Pavuk
Pi-Monster
Picscout
Picsearch
Piepmatz
Pixray
Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot
Re-re
RepoMonkey
Ripper
SEOkicks-Robot
SEOstats
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Siphon
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Sitevigil
SlySearch
SmartDownload
Sociscraper
Sottopop
SpaceBison
Spanner
Spinn3r
SputnikBot
Sucker
SuperHTTP
SurveyBot
Telesoft
The Intraformant
Thumbor
TightTwatBot
Toata
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turingos
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT
VB Project
Vagabondo
VeriCiteCrawler
Voil
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebCopier
WebFetch
WebFuck
WebSauger
WebStripper
WebSucker
Webshag
Website Quester
Whack
Who.is Bot
Widow
Wonderbot
Woobot
Zermelo
Zeus
ZmEu
archive.org_bot
backlink-check
cah.io.community
coccocbot-web
cognitiveseo
crawler.feedback
dataforseo.com
eCatch
evc-batch
facebookscraper
heritrix
instabid
ips-agent
magpie-crawler
meanpathbot
oBot
page scorer
plumanalytics
probe-image-size
s1z.ru
scalaj-http
seobility
seostar
sexsearcher
spyfu
sysscan
trendiction.com
trendiction.de
voyagerx.com
xpymep1.exe