nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-11 10:09:29 +00:00

250 lines
2.5 KiB
Text

Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
AllSubmitter
Anthill
Apexoo
Aspiegel
Atomseobot
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackDoorBot
Bitacle
Blackboard
BlowFish
Bolt
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
CheTeam
Cliqzbot
Cogentbot
Copier
Copyscape
Crescent
Curious
Custo
CyotekWebCopy
DIIbot
DSearch
DTS Agent
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
Dotbot
Drip
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
Extractor
Extreme Picture Finder
Ezooms
FDM
FHscan
Flunky
Foobot
Freeuploader
FyberSpider
Fyrebot
GalaxyBot
Genieo
Gigabot
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Humanlinks
IDBTE4M
Image Sucker
Indy Library
InterGET
InternetSeer
Iskanie
IstellaBot
Kozmosbot
Lanshanbot
LeechGet
LibWeb
Libwhisker
LinkWalker
Linkbot
LinkextractorPro
LinksManager
Lipperhey
Litemage_walker
Ltx71
MIDown tool
MIIxpc
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mojeek
MolokaiBot
Mr.4x3
Msrabot
Musobot
NPbot
Nameprotect
NearSite
Needle
NetAnts
NetLyzer
Nettrack
Nibbler
Nimbostratus
Ninja
Not
Nuclei
Octopus
Offline Navigator
OpenVAS
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
Piepmatz
ProPowerBot
Psbot
Pu_iN
PxBroker
QueryN Metasearch
Quick-Crawler
RankFlex
Rankivabot
Re-re
ReGet
SEOkicks
SEOlyticsCrawler
SMTBot
ScanAlert
ScoutJet
ScreenerBot
SearchmetricsBot
Seekport
SemrushBot
SentiBot
Seomoz
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spanner
Spbot
Sqworm
Stripper
SuperBot
SuperHTTP
Surfbot
Suzuran
Szukacz
TeleportPro
TheNomad
Thumbor
Titan
Tracemyfile
Trendiction
True_Robot
Turnitin
URLy Warning
Upflow
VB Project
Vacuum
VeriCiteCrawler
Virusdie
Voltron
WWWOFFLE
Wallpapers
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebAuto
WebCollage
WebCopier
WebReaper
WebStripper
WebSucker
WebmasterWorldForumBot
Webster
WiseGuys Robot
Woobot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zeus
Zitebot
ZoomBot
ZumBot
ZyBorg
arquivo-web-crawler
autoemailspider
backlink-check
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
domainsproject.org
facebookscraper
gopher
instabid
ips-agent
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
oBot
page scorer
ripz
satoristudio.net
seocompany.store
seostar
sogouspider
sp_auditbot
sysscan
trendiction.com
voyagerx.com
webmeup-crawler
webprosbot