nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-29 10:09:15 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
AIBOT
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
Anarchie
Anarchy99
Ankit
Apexoo
Asterias
Atomseobot
BackStreet
Backlink-Ceck
BatchFTP
Bitacle
Blow
Boardreader
BotALot
Brandprotect
Buck
Buddy
CATExplorador
CODE87
CazoodleBot
CensysInspect
ChinaClaw
Cogentbot
Copier
Copyscape
CrazyWebCrawler
Custo
CyotekWebCopy
DSearch
Demon
Deusu
Devil
DigitalPebble
Disco
DnyzBot
DomainCrawler
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Ezooms
FHscan
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Getintent
Go!Zilla
GoZilla
Gotit
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Heritrix
HonoluluBot
IDBTE4M
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
Iskanie
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
Lftp
Lightspeedsystems
Likse
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MIIxpc
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MeanPath Bot
Mediatoolkitbot
Microsoft Data Access
Moblie Safari
Nameprotect
NearSite
Needle
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nibbler
NimbleCrawler
Not
Octopus
OpenVAS
Openfind
OrangeSpider
OutclicksBot
PHPCrawl
PageGrabber
PageScorer
PageThing.com
Pandalytics
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
ProWebWalker
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
Re-re
ReGet
Recorder
RepoMonkey
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
SMTBot
ScanAlert
Scanbot
Scrapy
SemanticJuice
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Snake
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen
Spbot
Spinn3r
SputnikBot
Steeler
Sucker
Sucuri
Surfbot
Suzuran
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Trendiction
Turingos
TurnitinBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
WASALive-Bot
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Sauger
WebBandit
WebFetch
WebImageCollector
WebLeacher
WebSauger
WebSucker
WebWhacker
WebZIP
WebsiteQuester
Whacker
Xaldon WebSpider
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
backlink-check
crawler.feedback
demandbase-bot
domainsproject.org
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
page scorer
polaris version
scan.lol
seocompany.store
seostar
serpstatbot
sp_auditbot
spyfu
tAkeOut
trendiction.de
webmeup-crawler
xpymep1.exe