nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-10 10:07:55 +00:00

100 lines
1.1 KiB
Text

404enemy
Aipbot
Alligator
AlphaBot
Anthill
Bigfoot
Blackboard
Brandwatch
Cegbfeieh
CheTeam
Cliqzbot
CrazyWebCrawler
CrunchBot
Curious
Custo
Digincore
DigitalPebble
Drip
EyeNetIE
FHscan
Firefox/7.0
FlashGet
Foobot
GPTBot
GetRight
GetWeb
Getintent
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HTTP::Lite
Heritrix
Humanlinks
HybridBot
IlseBot
JustView
Keybot Translation-Search-Machine
LexiBot
Libwhisker
MQQBrowser
Mass Downloader
Mb2345Browser
Meanpathbot
Moblie Safari
Mr.4x3
Name Intelligence
NetAnts
Nibbler
Nmap
PECL::HTTP
PHPCrawl
PageThing.com
Pavuk
PeoplePal
PictureFinder
ProPowerBot
Quick-Crawler
RankurBot
RedesScrapy
RepoMonkey
SEOkicks-Robot
SMTBot
ScoutJet
SemrushBot
Seomoz
Site Sucker
Siteimprove
SlySearch
Sqlmap
Sucker
Szukacz
The Intraformant
TheNomad
Thumbor
Trendiction
Turnitin
URLy.Warning
Vacuum
VidibleScraper
VoidEYE
WWW-Collector-E
Web Fetch
Web Sucker
WebCopier
WebmasterWorldForumBot
Whack
Wonderbot
adscanner
backlink-check
crawl.sogou.com
eCatch
evc-batch
internetVista monitor
ripz
scalaj-http
seobility
ubermetrics-technologies.com
webgains-bot