nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-16 10:09:16 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchy99
Ankit
Apexoo
Aspiegel
Atomseobot
BBBike
BDFetch
BLEXBot
BacklinkCrawler
Badass
Bitacle
BlackWidow
BlowFish
Bolt
BotALot
Buddy
BuiltBotTough
BuiltWith
Bullseye
CCBot
CSHttp
Cegbfeieh
CheTeam
CherryPicker
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
Copyscape
Custo
DSearch
DTS Agent
DatabaseDriverMysqli
Devil
Discobot
DomCopBot
DomainCrawler
Domains Project
Dotbot
Download Wonder
Drip
EMail Siphon
EirGrabber
EroCrawler
Evil
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Gotit
GrabNet
GrapeshotCrawler
HaosouSpider
Harvest
Hloader
HybridBot
IDBTE4M
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
Jbrofuzz
JennyBot
Joomla
JustView
LWP::Simple
Larbin
LeechFTP
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MSIECrawler
Mag-Net
Majestic-SEO
MarkMonitor
MarkWatch
MeanPath Bot
Microsoft Data Access
Mojeek
NICErsPRO
NPbot
Nameprotect
NearSite
Net Vampire
NetAnts
NetMechanic
NetSpider
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Ninja
Nmap
Not
OpenLinkProfiler
Openvas
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Papa Foto
PeoplePal
PictureFinder
Piepmatz
Pixray
Pump
RankActive
RankActiveLinkBot
Re-re
Reaper
Ripper
SEOkicks
SEOstats
SMTBot
SalesIntelligent
Scanbot
ScrepyBot
Searchestate
SemanticJuice
SemrushBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sottopop
Spammen
SpankBot
Spanner
Spinn3r
Sqlworm
SurveyBot
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
The Intraformant
Toata
Tracemyfile
Trendiction
Turingos
Turnitin
URLy.Warning
UnisterBot
Upflow
VCI
VidibleScraper
Voil
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Pix
Web Sauger
WebAuto
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebStripper
WebZIP
Webalta
Webshag
Website Quester
WebsiteQuester
Whack
Whatweb
Widow
WinHTTrack
Wonderbot
Xenu
Zauba
ZoominfoBot
adscanner
arquivo-web-crawler
arquivo.pt
cah.io.community
coccocbot
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper
instabid
ips-agent
isitwp.com
magpie-crawler
meanpathbot
muhstik-scan
oBot
plumanalytics
probe-image-size
ripz
satoristudio.net
scan.lol
seobility
serpstatbot
sitechecker.pro
siteripz
tAkeOut
voyagerx.com
webpros.com
xpymep1.exe
zgrab