nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-28 10:09:13 +00:00

250 lines
2.6 KiB
Text

404checker
ADmantX
AIBOT
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
AlphaBot
Anarchie
Anthill
Atomseobot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Bandit
Bigfoot
Bitacle
Black Hole
Boardreader
Bolt
BotALot
CCBot
CSHttp
CensysInspect
CheTeam
Citoid
Claritybot
Copier
CopyRightCheck
Cosmos
CrunchBot
Curious
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
DigitalPebble
Dirbuster
Disco
Discoverybot
DomCopBot
DomainSigmaCrawler
Dotbot
EMail Wolf
EasyDL
EirGrabber
EroCrawler
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
Fimap
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
GoZilla
Gotit
GrabNet
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
Harvest
Havij
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot
Iblog
Image Fetch
Image Sucker
IndeedBot
InfoTekies
Jbrofuzz
Joomla
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
Lftp
Lightspeedsystems
LinkScan
LinkpadBot
LinqiaRSSBot
Litemage_walker
Lmspider
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
Mb2345Browser
MegaIndex.ru
Metauri
Microsoft Data Access
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
Nameprotect
Needle
Net Vampire
NetAnts
NetSpider
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Nuclei
Octopus
OnCrawl
OpenVAS
Openvas
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
Panscient
Pi-Monster
Picscout
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
Re-re
Rogerbot
SEOlyticsCrawler
SISTRIX
SalesIntelligent
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteExplorer
Siteimprove
Sitevigil
SmartDownload
Snake
Sociscraper
Sosospider
SputnikBot
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
Suzuran
Swiftbot
TeleportPro
Telesphoreo
Telesphorep
TightTwatBot
Titan
Tracemyfile
Trendictionbot
TurnitinBot
Typhoeus
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WBSearchBot
WEBDAV
WPScan
WWW::Mechanize
Wallpapers
WeSEE
Web Sucker
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFuck
WebSucker
WebWhacker
Webalta
WebsiteQuester
Whack
Whatweb
WinHTTrack
Wprecon
Xenu
Zade
Zermelo
Zeus
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
autoemailspider
backlink-check
check1.exe
clark-crawler
coccocbot
crawl.sogou.com
crawler4j
dataforseo.com
eCatch
evc-batch
facebookscraper
heritrix
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
polaris version
s1z.ru
satoristudio.net
seocompany.store
serpstatbot
sp_auditbot
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot
x22Mozilla
zauba.io