nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-21 10:07:23 +00:00

100 lines
1.1 KiB
Text

360Spider
ASPSeek
AfD-Verbotsverfahren
AiHitBot
Aipbot
Anarchy99
Aspiegel
BackWeb
Black Hole
Blackboard
Bolt
Brandwatch
Buck
Buddy
CATExplorador
Citoid
Craftbot
Crawling at Home Project
Custo
DBLBot
Discobot
Exabot
Express WebPictures
ExtractorPro
Freeuploader
FyberSpider
Fyrebot
GetWeb
Go!Zilla
GrabNet
Id-search
Indy Library
Internet Ninja
Jetty
Jorgee
Lanshanbot
Larbin
LinqiaMetadataDownloaderBot
Litemage_walker
MTRobot
Mag-Net
Majestic-SEO
Mass Downloader
Mb2345Browser
MegaIndex.ru
MicroMessenger
Msrabot
NetAnts
Nmap
Openfind
PECL::HTTP
PHPCrawl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
Rankivabot
Re-re
RepoMonkey
SEOstats
Searchestate
Seekport
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SmartDownload
Sosospider
Spammen
SputnikBot
Sucuri
Szukacz
T0PHackTeam
Trendiction
Trendictionbot
URLy Warning
WebPix
WebSauger
WebWhacker
WebZIP
Webshag
Wonderbot
Woobot
ZoomBot
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
cognitiveseo
linkdexbot
lwp-request
meanpathbot
netEstate NE Crawler
scan.lol
sp_auditbot
sysscan
ubermetrics-technologies.com
webpros.com
webprosbot