nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-29 10:09:06 +00:00

250 lines
2.6 KiB
Text

80legs
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Anarchy
Anthill
Aspiegel
Attach
AwarioRssBot
BackStreet
Bandit
Blow
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CCBot
CODE87
ChinaClaw
Cocolyzebot
Cogentbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Digincore
DigitalPebble
Disco
Discobot
Discoverybot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
EirGrabber
Express WebPictures
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Flunky
FyberSpider
GT::WWW
GermCrawler
Getintent
Go!Zilla
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Havij
Heritrix
Hloader
IRLbot
Iblog
Id-search
Image Sucker
IndeedBot
InfoTekies
InterGET
JOC Web Spider
Jbrofuzz
JetCar
Joomla
Jorgee
Kinza
Kozmosbot
LWP::Simple
Lanshanbot
LexiBot
LibWeb
Libwhisker
Linkbot
LinkextractorPro
Ltx71
MFC_Tear_Sample
MTRobot
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Minefield
Mister PiX
Mojeek
NICErsPRO
NPbot
Nameprotect
Navroad
Needle
Net Vampire
NetZIP
Nettrack
NextGenSearchBot
Nimbostratus
Ninja
Not
Nuclei
OpenVAS
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Panscient
Petalbot
ProPowerBot
ProWebWalker
Pump
RankActive
RankFlex
RankingBot2
RankurBot
RealDownload
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOprofiler
SMTBot
Screaming
ScreenerBot
ScrepyBot
Seekport
Semrush
SemrushBot
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpankBot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Stripper
Sucuri
SuperBot
SurveyBot
Suzuran
T8Abot
Teleport
Telesphoreo
Telesphorep
TheNomad
Thumbor
Tracemyfile
Trendictionbot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Fetch
WebCollage
WebFuck
WebGo IS
WebLeacher
WebPix
WebReaper
WebSauger
WebZIP
Webalta
Who.is Bot
WiseGuys Robot
Wprecon
Xaldon WebSpider
YoudaoBot
Zitebot
ZmEu
ZumBot
ZyBorg
adscanner
arquivo.pt
cognitiveseo
crawler.feedback
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
gopher
internetVista monitor
isitwp.com
iubenda-radar
magpie-crawler
mediawords
oBot
pcBrowser
polaris version
serpstatbot
siteripz
sogouspider
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
zauba.io