nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-08 22:07:13 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alligator
Asterias
Atomseobot
Attach
AwarioSmartBot
BDFetch
BackWeb
Backlink-Ceck
Badass
Bigfoot
Bitacle
Black Hole
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CSHttp
Calculon
CazoodleBot
Chlooe
Citoid
Cosmos
CrazyWebCrawler
CrunchBot
Custo
CyotekWebCopy
DataCha0s
Demon
Devil
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
Drip
EMail Wolf
Ecxi
EirGrabber
EyeNetIE
FDM
FemtosearchBot
Fimap
Flunky
Foobot
Freeuploader
Fyrebot
GalaxyBot
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
HTTrack
Harvest
Heritrix
HybridBot
Iblog
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
IstellaBot
JOC Web Spider
Joomla
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
Leap
LeechFTP
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MFC_Tear_Sample
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
Metauri
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Musobot
NPbot
Name Intelligence
Nameprotect
Navroad
NetLyzer
NetMechanic
Netvibes
Nikto
Nimbostratus
Not
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pandalytics
Petalbot
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
ProPowerBot
Psbot
PyCurl
QueryN Metasearch
RSSingBot
RankFlex
RankingBot
RankingBot2
Re-re
RealDownload
RebelMouse
RepoMonkey
Ripper
SEOkicks-Robot
SEOprofiler
SMTBot
ScrepyBot
Semrush
SentiBot
SeobilityBot
Seomoz
Siphon
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Sqlmap
Steeler
Stripper
Sucker
Surfbot
TeleportPro
Telesoft
Telesphorep
Thumbor
Titan
Toata
Trendictionbot
Typhoeus
Vacuum
VelenPublicWebCrawler
VidibleScraper
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFuck
WebPix
WebSauger
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
Xenu
Zade
Zauba
Zeus
ZmEu
arquivo.pt
backlink-check
coccocbot
com.plumanalytics
crawler4j
dataforseo.com
facebookscraper
internetVista monitor
ips-agent
isitwp.com
linkdexbot
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
oBot
plumanalytics
scan.lol
seobility
sexsearcher
sitechecker.pro
sp_auditbot
tAkeOut
trendiction.de
webmeup-crawler
x09Mozilla