nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-25 22:05:07 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
ASPSeek
Aboundex
AdsTxtCrawlerTP
AfD-Verbotsverfahren
AiHitBot
Anarchy
Anthill
BlowFish
Brandwatch
CODE87
Calculon
Cliqzbot
Cloud mapping
Cogentbot
Copyscape
Curious
CyotekWebCopy
DSearch
Disco
Discoverybot
Dragonfly
Drip
Express WebPictures
ExtractorPro
Flunky
GPTBot
GetRight
GridBot
HTTP::Lite
Haansoft
Harvest
HybridBot
ImagesiftBot
Intelliseek
Iria
JustView
Keyword Density
Larbin
LinkScan
LinqiaMetadataDownloaderBot
MFC_Tear_Sample
Mass Downloader
MauiBot
Microsoft Data Access
Microsoft URL Control
MolokaiBot
NetZIP
Openvas
PeoplePal
Picscout
Picsearch
Pimonster
PleaseCrawl
PxBroker
RankActiveLinkBot
RankingBot
Rankivabot
RankurBot
Rogerbot
SEOlyticsCrawler
SMTBot
SeekportBot
SemrushBot
Shodan
SputnikBot
Sqlmap
Sqworm
SurveyBot
T8Abot
TeleportPro
Thumbor
TinyTestBot
Turingos
TwengaBot
WASALive-Bot
WISENutbot
WPScan
Web Sucker
WebFuck
WebStripper
WebZIP
WebsiteQuester
Whack
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
clark-crawler
domainsproject.org
instabid
lwp-trivial
s1z.ru
seoscanners
serpstatbot
voyagerx.com
zauba.io