nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-22 10:07:21 +00:00

100 lines
1.1 KiB
Text

80legs
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
Anarchie
Atomseobot
Backlink-Ceck
Badass
Bigfoot
Brandwatch
CCBot
Cegbfeieh
CheeseBot
Chlooe
Craftbot
Crawling at Home Project
CyotekWebCopy
DigitalPebble
DomainSigmaCrawler
Domains Project
EyeNetIE
Freeuploader
GrapeshotCrawler
HTMLparser
Heritrix
IDBTE4M
IDBot
IndeedBot
Indy Library
InfoNaviRobot
JennyBot
Jorgee
JustView
LinkpadBot
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MTRobot
Magnet
Majestic-SEO
MarkMonitor
Microsoft Data Access
Minefield
Ninja
Offline Navigator
OpenLinkProfiler
POE-Component-Client-HTTP
Pavuk
Pixray
QueryN Metasearch
RankingBot
Re-re
ReGet
Reaper
Rogerbot
SISTRIX
Seekport
SentiBot
SeoSiteCheckup
Shodan
Siphon
Sqlworm
Sqworm
Steeler
Stripper
Suzuran
Szukacz
Teleport
Telesphorep
Toweyabot
True_Robot
Typhoeus
Vacuum
WeSEE
Web Auto
Web Enhancer
Web Fetch
WebFetch
Webalta
Webshag
Webster
Who.is Bot
Wprecon
Zade
clark-crawler
domainsproject.org
evc-batch
linkdexbot
mediawords
satoristudio.net
seobility
seoscanners
serpstatbot
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe