nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-12 22:04:55 +00:00

100 lines
1.1 KiB
Text

80legs
AIBOT
ASPSeek
Aboundexbot
Apexoo
BDCbot
BLEXBot
Backlink-Ceck
Blackboard
BlowFish
Bolt
BotALot
Bullseye
BuzzSumo
Bytespider
Citoid
Cocolyzebot
CrunchBot
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Disco
DomainSigmaCrawler
Drip
EMail Wolf
Express WebPictures
FDM
FHscan
FacebookBot
Fyrebot
Humanlinks
IDBTE4M
IDBot
InfoNaviRobot
InfoTekies
InfraSec Scanner
InterGET
Internet Ninja
JennyBot
LinksManager
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
Majestic SEO
Metauri
Microsoft Data Access
NetSpider
Nettrack
Nmap
Openfind
Page Analyzer
Papa Foto
PeoplePal
Petalbot
ProWebWalker
Probethenet
RankActiveLinkBot
RankFlex
RankingBot
Reaper
RepoMonkey
Rogerbot
SEOkicks-Robot
SMTBot
Seekport
SemanticJuice
SeoSiteCheckup
SiteExplorer
SmartDownload
SputnikBot
Swiftbot
Tracemyfile
TwengaBot
VidibleScraper
WISENutbot
WebFetch
WebReaper
WebSauger
WebWhacker
Whack
WinHTTrack
WiseGuys Robot
Zauba
Zeus
ZoomBot
anthropic-ai
cah.io.community
clark-crawler
crawler4j
demandbase-bot
facebookscraper
gopher
omgili
polaris version
seobility
sexsearcher
sitechecker.pro
webprosbot