vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.09.2590 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-09-14 10:09:13 +00:00
parent 5269b9ce3c
commit a399532046
47 changed files with 83037 additions and 83044 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.09.2589 #### Version: V4.2021.09.2590
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.09.2589 #### Version: V4.2021.09.2590
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.09.2589 #### Version: V4.2021.09.2590
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10236
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.09.2589 #### Version: V4.2021.09.2590
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10240
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10240
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10240
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10240
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2589 2590

10240
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10240
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.149.11.241 0; 20.190.34.169 0;

10240
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

10240
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.149.11.241 0; 20.190.34.169 0;

10240
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.149.11.241 0; 20.190.34.169 0;

10240
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 1; 10.1.0.181 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Curious 404enemy
Discobot BacklinkCrawler
GermCrawler Barkrowler
Mister PiX JetCar
Nmap Picsearch
PleaseCrawl SemrushBot
Rankivabot SiteSnagger
Web Sucker Spbot
WebsiteQuester Zeus
coccocbot-web backlink-check

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
ADmantX 404checker
AIBOT 404enemy
ALittle Client 80legs
ASPSeek
Abonti
AfD-Verbotsverfahren AfD-Verbotsverfahren
Aipbot AhrefsBot
AiHitBot
Alexibot Alexibot
Alligator Alligator
Apexoo AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel Aspiegel
Asterias
AwarioRssBot AwarioRssBot
AwarioSmartBot BBBike
BDFetch BDFetch
BLEXBot
BackDoorBot
BackStreet BackStreet
Badass BackWeb
BacklinkCrawler
Barkrowler Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bitacle
Black Hole Black Hole
BlackWidow Blackboard
Blow Blow
Bolt
BotALot BotALot
Brandprotect Brandwatch
Buck Buddy
BuiltWith CATExplorador
BunnySlippers
CSHttp
Calculon Calculon
CazoodleBot CensysInspect
Cegbfeieh
CheeseBot CheeseBot
Claritybot CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cocolyzebot
Cogentbot Cogentbot
Copier Collector
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
CrunchBot Curious
Custo DIIbot
CyotekWebCopy DatabaseDriverMysqli
DSearch Deusu
DigitalPebble Devil
Discobot
DittoSpyder DittoSpyder
DnyzBot
DomCopBot DomCopBot
DomainAppender DomainAppender
DomainCrawler DomainSigmaCrawler
Ebingbong Dotbot
Evil Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
ExtractorPro ExtractorPro
Extreme Picture Finder
EyeNetIE
Fimap Fimap
Firefox/7.0 FlashGet
Freeuploader Flunky
Fyrebot Fuzz
GT::WWW FyberSpider
GermCrawler
GetRight GetRight
GetWeb Getintent
Gigabot Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit GoZilla
GrabNet
Grabber Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HaosouSpider HMView
Havij HTTP::Lite
Heritrix HTTrack
Hloader Haansoft
IRLbot Id-search
Iblog
IlseBot
Image Fetch
Indy Library Indy Library
InfoNaviRobot InfoNaviRobot
Intelliseek
InterGET InterGET
Iria
Jbrofuzz
JetCar JetCar
JikeSpider Jorgee
JustView
Kenjin Spider Kenjin Spider
Keyword Density Keyword Density
Kinza Kinza
Lanshanbot Leap
LeechFTP LeechGet
LexiBot
LieBaoFast LieBaoFast
Linkdexbot LinkScan
Linkbot
LinkpadBot
LinksManager LinksManager
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider Ltx71
MIDown tool MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler MSIECrawler
Mag-Net Magnet
Majestic SEO Mail.RU_Bot
Majestic-SEO Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
Meanpathbot Meanpathbot
Mediatoolkitbot Metauri
Microsoft Data Access Microsoft Data Access
Mister PiX Mister PiX
Mojeek
Morfeus Fucking Scanner
Musobot
NICErsPRO
Navroad Navroad
NearSite
Nessus
Net Vampire Net Vampire
NetAnts
NetLyzer NetLyzer
NetMechanic
NetSpider NetSpider
NetZIP NetZIP
Nettrack Nettrack
Nibbler Ninja
Niki-bot Nutch
Nikto Offline Explorer
Nmap OpenLinkProfiler
Octopus
Offline Navigator
Openfind Openfind
Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer PageAnalyzer
PageThing.com PageScorer
Panscient Pandalytics
Pavuk Papa Foto
Picscout Picscout
Picsearch
PictureFinder
Piepmatz Piepmatz
Pixray Pixray
PxBroker ProPowerBot
PyCurl Pump
RankurBot RSSingBot
Re-re RankActiveLinkBot
RealDownload RankFlex
Recorder RankingBot
Rogerbot Rankivabot
SEOkicks Reaper
SEOstats RebelMouse
SMTBot SBIder
SalesIntelligent SEOkicks-Robot
SISTRIX
Scrapy
Searchestate Searchestate
Semrush SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteExplorer
SiteSucker
Sitebeam Sitebeam
Siteimprove
Sitevigil Sitevigil
SlySearch Snake
SocialRankIOBot SocialRankIOBot
Sottopop Sottopop
SpankBot Spbot
Spinn3r Spinn3r
SputnikBot SputnikBot
Stripper
Sucker Sucker
SurveyBot Sucuri
SuperBot
SuperHTTP
Suzuran Suzuran
Swiftbot Swiftbot
TeleportPro Szukacz
Telesphoreo T8Abot
Telesphorep
TheNomad TheNomad
Toweyabot
Trendictionbot
Turingos
TurnitinBot TurnitinBot
TwengaBot
Twice
Typhoeus Typhoeus
URLy Warning
URLy.Warning
UnisterBot UnisterBot
V-BOT V-BOT
Vacuum VCI
VelenPublicWebCrawler Vagabondo
VoidEYE
Voil Voil
WBSearchBot WEBDAV
WISENutbot WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE WWW::Mechanize
Wallpapers/3.0 Wallpapers
WallpapersHD WallpapersHD
Web Fuck Web Auto
WebAuto Web Collage
Web Fetch
Web Pix
WebBandit WebBandit
WebFetch WebCopier
WebEnhancer
WebFuck WebFuck
WebGo IS WebLeacher
WebPix WebPix
WebSauger WebSauger
WebSucker
WebWhacker WebWhacker
Webalta WebZIP
Webshag WebmasterWorldForumBot
Whatweb Webster
WinHTTrack Whack
Widow
WiseGuys Robot WiseGuys Robot
Woobot Woobot
Wprecon
Xaldon_WebSpider
Xenu Xenu
YoudaoBot YoudaoBot
Zitebot Zauba
Zermelo
ZmEu ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
ZyBorg
arquivo-web-crawler arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
clark-crawler clark-crawler
coccocbot-web coccocbot-web
crawl.sogou.com cognitiveseo
dataforseo.com com.plumanalytics
demandbase-bot
domainsproject.org
eCatch eCatch
evc-batch evc-batch
gopher facebookscraper
heritrix
instabid instabid
internetVista monitor
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
meanpathbot page scorer
mediawords plumanalytics
pcBrowser polaris version
probe-image-size
ripz
s1z.ru s1z.ru
satoristudio.net scalaj-http
seostar
serpstatbot serpstatbot
sysscan siteripz
spyfu
trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com voyagerx.com
webmeup-crawler webpros.com
zgrab x22Mozilla
xpymep1.exe
zauba.io

296
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider 404enemy
80legs 80legs
ALittle Client
ASPSeek ASPSeek
Aboundex AhrefsBot
Acunetix AlphaBot
AiHitBot
Alexibot
Alligator
Anarchie Anarchie
Asterias Anarchy99
Attach Apexoo
BDCbot Aspiegel
BDFetch AwarioSmartBot
BLEXBot BackDoorBot
BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga Battleztar Bazinga
BlackWidow BlowFish
Blow BotALot
Boardreader Buddy
Brandprotect BuiltBotTough
Buck
BuiltWith
BunnySlippers BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot
CODE87
Cegbfeieh Cegbfeieh
CheTeam CensysInspect
ChinaClaw
Chlooe Chlooe
Claritybot
Cliqzbot Cliqzbot
Cloud mapping
Cocolyzebot Cocolyzebot
Collector Cogentbot
Copier Copier
CrazyWebCrawler Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
Curious Curious
CyotekWebCopy Custo
DBLBot DIIbot
Demon DTS Agent
DatabaseDriverMysqli
Deusu Deusu
Digincore
DigitalPebble
Dirbuster
Discobot Discobot
DomainAppender Discoverybot
DomainCrawler
Domains Project Domains Project
Dotbot Dragonfly
Drip
ECCP/1.0
EasyDL EasyDL
EirGrabber
EroCrawler EroCrawler
ExtLinksBot ExtLinksBot
Extreme Picture Finder ExtractorPro
FDM FHscan
FemtosearchBot
Fimap Fimap
Firefox/7.0
FlashGet
Flunky Flunky
Foobot
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo Genieo
GermCrawler Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX GrapeFX
GrapeshotCrawler GridBot
HEADMasterSEO HEADMasterSEO
HMView HMView
HTMLparser HTMLparser
HTTP::Lite Havij
HaosouSpider Humanlinks
Hloader IDBot
HybridBot Iblog
IRLbot IlseBot
Id-search Image Fetch
Image Sucker Internet Ninja
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iria Iria
Iskanie
IstellaBot IstellaBot
JOC Web Spider Jbrofuzz
JennyBot JetCar
Joomla JikeSpider
Jorgee Jorgee
Keyword Density Kinza
Kozmosbot LWP::Simple
LeechFTP Larbin
LeechGet LeechGet
LexiBot LexiBot
Lftp
LibWeb LibWeb
Likse LieBaoFast
LinkWalker LinkScan
LinkextractorPro LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
Lipperhey Spider LinqiaScrapeBot
MIDown tool Litemage_walker
MFC_Tear_Sample
MIIxpc MIIxpc
MTRobot MJ12bot
Mag-Net
Mail.RU_Bot
Majestic SEO Majestic SEO
Majestic-SEO Majestic-SEO
MarkMonitor Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari Mata Hari
MeanPath Bot Mb2345Browser
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access Microsoft Data Access
Mister PiX Morfeus Fucking Scanner
Moblie Safari Mr.4x3
Mojolicious
Mozlila
Msrabot Msrabot
Musobot
NICErsPRO NICErsPRO
NPbot
Name Intelligence Name Intelligence
Nameprotect Nameprotect
Navroad Navroad
NearSite Net Vampire
Nessus
NetAnts
NetLyzer NetLyzer
NetSpider NetMechanic
Netcraft
Nettrack Nettrack
Netvibes NextGenSearchBot
Nibbler Nibbler
Nimbostratus Niki-bot
Nmap Ninja
Nuclei Nuclei
Offline Explorer Offline Navigator
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl PHPCrawl
POE-Component-Client-HTTP Page Analyzer
PageGrabber Papa Foto
PageScorer Petalbot
PageThing.com Pi-Monster
Pandalytics
Panscient
Pavuk
Picsearch Picsearch
PictureFinder
Piepmatz Piepmatz
Pimonster
Pixray Pixray
PleaseCrawl PleaseCrawl
ProWebWalker ProWebWalker
Pu_iN RankActiveLinkBot
Pump RankingBot2
QueryN Metasearch RankurBot
Quick-Crawler Re-re
RankFlex
RealDownload RealDownload
RebelMouse Reaper
Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper
RocketCrawler RocketCrawler
Rogerbot
SISTRIX
SMTBot SMTBot
Scanbot ScanAlert
ScoutJet Scrapy
ScreenerBot SearchmetricsBot
Semrush SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan Shodan
Siphon Siphon
SmartDownload Site Sucker
SocialRankIOBot SiteExplorer
Snapbot
Snoopy
Sociscraper Sociscraper
Sosospider SpankBot
Sottopop Spbot
Spammen
SputnikBot SputnikBot
Sqworm
Steeler
Stripper Stripper
Sucuri Sucuri
T0PHackTeam SuperHTTP
T8Abot SurveyBot
Suzuran
Teleport Teleport
Telesphoreo
Telesphorep Telesphorep
Tracemyfile The Intraformant
TheNomad
Thumbor
Toata
Trendiction Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot TwengaBot
Twice
Typhoeus Typhoeus
URLy Warning
URLy.Warning
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VoidEYE VidibleScraper
WPScan Voltron
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE
Web Auto Web Auto
Web Collage Web Sauger
Web Enhancer Web Sucker
Web Fuck
WebAuto
WebBandit
WebCollage
WebEnhancer WebEnhancer
WebGo IS WebFetch
WebImageCollector WebImageCollector
WebPix WebLeacher
WebSauger
WebStripper WebStripper
WebSucker WebSucker
WebZIP WebZIP
Webalta Webalta
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester WebsiteQuester
Whack
Widow Widow
WinHTTrack WinHTTrack
Wonderbot Wonderbot
Woobot
Wotbox
Zauba
Zeus Zeus
ZoomBot
ZyBorg ZyBorg
archive.org_bot archive.org_bot
arquivo-web-crawler cah.io.community
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com crawl.sogou.com
ips-agent crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
gopher
heritrix
internetVista monitor
isitwp.com isitwp.com
lwp-trivial magpie-crawler
meanpathbot
mediawords mediawords
netEstate NE Crawler
oBot oBot
scalaj-http page scorer
pcBrowser
satoristudio.net
scan.lol
seobility seobility
seostar seostar
serpstatbot sexsearcher
sitechecker.pro
sp_auditbot sp_auditbot
sysscan sysscan
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
computernetworksonline.com blog.f00kclan.de
electricwheelchairsarea.com callawaygolfstore.online
keenoutlet.online feorina.ru
klikbonus.com moncleroutletonline.pw
mhi-systems.ru ozas.net
nevansk.ru remont-fridge-tv.ru
nootrino.com savefrom.com
pornhive.org sbt-aqua.ru
thegioixekhach.com xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--c1acygb.xn--p1ai zvezdagedon.ru

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1001desert.com 18ps.ru
1008.su 214jaluwobapef.cf
2x2fan.ru 24x7-server-support.site
2drittel.de
2rich4bitches.com
4ur.click 4ur.click
5kstore.com 4webmasters.com
51unlim.ru
5forex.ru
5u.com 5u.com
7fon.ru 72-news.com
7makemoneyonline.com 8xv8.com
7xc4n.com abbanreddy.com
8558l.jobs.net abcdefh.xyz
883zy.com actices.com
above.com adanih.com
absolutelyanalog.com adrunnr.com
abwa.tk adservme.com
adclickthru.net adult3dgames.com
adktrailmap.com adultwebhosting.info
adsloads.com airlandsea.info
adultnet.in aktivator-windows10.blogspot.com
adventureparkcostarica.com akuhni.by
aerogo.com alarmobninsk.ru
afora.ru alert.scansafe.net
ageofclones.com
aihelen.net
akusherok.ru
alienwheels.de
allcredits.su allcredits.su
alldownload.pw
alloysteel.ru
amyfoxfitness.com
anatomiy.com anatomiy.com
andpolice.com android-style.com
angkortours.vn anonymous-redirect.com
animalia-life.club api.stathat.com
anticrawler.org apparel-offer.com
apiappenableinfo-a.akamaihd.net apple.com-cleaner.systems
apiholdingmypage-a.akamaihd.net apple.com-webbrowsing-security.review
apishops.ru arate.ru
apispringsmartne-a.akamaihd.net arcadepages.com
arabseyes.com arquapetrarca.info
arendovalka.xyz ausergrubhof.info
atovh.local-finders.com automatic-seo.com
auto.rusvile.lt autoseo-traffic.com
autochoixspinelli.com aversis.net
automobile-spec.com avtointeres.ru
autotrends.today awaybird.ru
availit.weebly.com ayakino.net
awency.com ayerbo.xhost.ro
azbuka-mo.ru azartmix.com
backgroundpictures.net bag77.ru
balans.shahterworld.org baoxaydung.com.vn
balook.com berdasovivan.ru
bank.uz berrymall.ru
bankiem.pl best-seo-offer.com
beauty-things.com bestdooz.com
best-deals-products.com
bestcalovebracelet.cn
bestdraws.com
bestimagecoollibrary.com
bestofupload.info
betterscooter.com betterscooter.com
beztuberkuleza.ru bezlimitko.xyz
bibys.com big-boards.info
bidbuy.co.kr biglistofwebsites.com
bildsuche.ru binomo.com
biocn.dx.am bitcoinremote.com
bioscorp.ru biznesluxe.ru
bocoarchives.org blackbabesporn.com
blog.remote-computer.de
bloggedporn.com
bloggerads.net
bodybuilding-shop.biz bodybuilding-shop.biz
bonzybuddy.com boeuklad.com
boostmyppc.com bolegapakistan.com
brainboosting.club bongiornos.info
braintobe.win bookhome.info
brg8.com bradleylive.xyz
brimstonehillfortress.org brewdom.ru
business-suggested.tk brianhenry.co
businescoop.men
butstrap.space butstrap.space
buyessaynow.biz buy-forum.ru
bytimedance.ru buyfriend.ru
candypeople.se buyscabiescream.com
cartierlovestore.com buyviagraa.blogspot.com
cartierreplica.pw bvlgariwallet.xyz
casinopinup-wins.com calvet.altervista.org
cbox.ws camdolls.com
centraletermice.us canacopegdl.com
cerev.info candcstuccoandstone.com
chatroulette.si candiceloves.us
cheapestjerseysonwholesale.com cars-modification.net
cheapmoncler.pw casite-513049.cloudaccess.net
cheapmoncler.win cayado.snn.gr
cheapmoncler.xyz ccjp.eu
check-this-out-now.online cdnanalytics.xyz
chee-by.biz cenoval.ru
cherubinimobili.it censys.io
chuckguilford.com centrdebut.ru
cialiswithoutadoctor.net chatroulette.life
ciceros.co checkhit.com
cjs.com.ru chinacheapelitejerseys.com
cleanpcnow.com cntravelre.com
clickzzs.nl cocyq.inwtrade.com
compliance-donald.xyz collegeessay19.blogspot.ru
compliance-irvin.xyz colobit.biz
compliance-julia.top com-cleaner.systems
compliance-julianna.top compliance-elena.xyz
compliance-nelson.top compliance-mary.top
conboy.us compliance-olga.top
cookie-law-enforcement-aa.xyz consorzioilmosaico.org
coprofam.org constantaservice.net
countercrazy.com continent-e.tv
coolgramgoods.com
copenergo.ru
coslab.club
cosmetic.donna7753191.ru
counter.yadro.ru
covadhosting.biz
creditmoney.com.ua
crest3d.ru crest3d.ru
cs-passion.pl cs-passion.pl
cubook.supernew.org cscwtalkto.site
customboxes4less.com customchocolate.business-for-home.com
dangphoto.trade customcollegeessays.net
darkages.info customsua.com.ua
datract.com cypernhuset.se
datsun-do.com dalavia.ru
davidovic.info daooda.com
dengi-pod-zalog-nedvizhimosti.ru darkbooks.org
descargar-musica-gratis.net data-mining.tk
design-ideas.info date-withme.com
detalizaciya-tut.biz dear-diary.ru
detsky-nabytek.info depositfiles-porn.ga
dev33.dioniqlabb.se digital-video-processing.com
dfiles.me dikqlyremy.info
dieswaene.com
diffbot.com
disruptingdinnerparties.com disruptingdinnerparties.com
dlya-android.org div.as
documentsite.net domain.webkeyit.com
dojki365.online domain2008.com
dostavimvdom.ru donna7753191.ru
downloader12.ru doublepimp.com
droidlook.net drillsaw.ru
dverimegapolis.ru e-buyeasy.com
e2click.com
e705.net
eas-seo.com eas-seo.com
ecxtracking.com eduinfosite.com
edge.sharethis.com ekn-art.se
egvar.net
ekspresihati.info
electrik-avenue.com
elektrischezi.canalblog.com elektrischezi.canalblog.com
elektrischeziga.livejournal.com elektronischezigarette2.mex.tl
elektrischezigarette2.onsugar.com elektronischezigarettekaufen2.tumblr.com
elektronischezi.livejournal.com elektrozigarette1.dreamwidth.org
elitepcgames.com embedle.com
epngo.bz envaseslotusama.com
eralph.tk
erotag.com erotag.com
erotik-kostenlos.net erotikstories.ru
esfchat.tk excaliburfilms.com
esopini.com exchanges-bet.com
european-torches.ru exct.net
everypony.ru ezigaretteshop2.mywapblog.com
evidencecleanergold.com familyholiday.ml
excitacao.com fanoboi.com
exonline.info farmingworm.com
extremez.net fashion-stickers.ru
ezigaretteshop.webs.com fashion.stellaconstance.co
factorynightclub.com favornews.com
failingmarriege.blogspot.com fetlifeblog.com
family1st.ca fighrofacciufreesig.ga
fandlr.com fil.ru
fantasticpixcool.com filesdatabase.net
farmprofi.net financetip.eu
fastcrawl.com find1friend.com
fearcrow.com firstsiteguide.com
femdom.twiclub.in fiverr.com
finemanteam.com florida-tourism.net
firstdrugmall.ru footbalive.org
fishingwholesale.us fordsonmajbor.cf
fiuxy.com forpostlock.ru
flashbannernow.com forum.tvmir.org
flavors.me freshdz.com
floridamobilebillboards.com ftns.ru
forex21.ru fz139.ttk.ru
forexgb.ru gabeshop.ru
forminecrafters.ru gardene.ru
forum69.info gazobeton-p.com.ua
forums.toucharcade.com girlgamerdaily.com
fotosfotos.eu girlsatgames.ru
fr-bearings.ru gktt.ru
frameimage.org
free-video-tool.com
freelinkbuilding.website.tk
freewhatsappload.com
fxund.us
g33.org
gamedayhouse.com
gamesprite.me
gay.adultgalls.com
gazporno.com
gdebestkupit.ru
ge0ip.com
gearsadspromo.club
getlaid-xxxhookupdirect.com
getpopunder.com
given2.com
glogow.pl glogow.pl
gogalleryawesome.com gomusix.com
goodwinmetals.co goodwriterssales.com
googlemare.com gosreg.amchs.ru
goosefishpost.bid graphid.com
gopro-online.info green-tea.tv
gosarhivrt.ru greenshop.su
gratuitxblcodes.com gtopstats.com
greatidea.marketing guigyverpo.cf
grupografico-pilar.com.ar hard-porn.mobi
gsasearchengineranker.site hatedriveapart.com
hdimagegallery.net hauleddes.com
hdxnxxtube.mobi hayate.biz
hidemyass.com headpharmacy.com
himazin.info healgastro.com
histats.com heartofpayne.xyz
hobild.net hjaoopoa.top
hop.clickbank.net homedecorpicture.us
homemature.net
hostingclub.lk hostingclub.lk
hotel-mkad.ru hostnow.men
hoverboard360.se housediz.com
huhn.altervista.org hubbble.com
ibb.com.ua humbmosquina.tk
ie.57883.net i-service.kz
incanto.in.ua images-free.net
infektsii.com iminent.com
infogame.name immigrational.info
iopeninghours.co.uk indiakino.net
isitpaleo.info inome.com.ua
iwantedmoney.com interior-stickers.ru
iwanttodeliver.com internetproviderstucson.com
jackwolfskinoutlet.online iphantom.com
jerseysbizwholesalecheap.com iqs.biz.ua
jerseywholesalechinabiz.com irunfar.com
islandminingsupply.wordpress.com
istizanidineanarcoticdrug.blogspot.com
iweblist.info
iyasimasennka.com
japan-bearings.ru
je7.us
jikoman.info jikoman.info
jobgirl24.ru jrcigars.com
jobmarket.com.ua jurajskie.info
jongose.ninja kalb.ru
kambasoft.com kamagragelusa.net
karaganda.xkaz.org karting196.ru
karusel-market.ru keywordhouse.com
kashubadesign.ru keywordsuggest.org
kaz.kz kfon.eu
kazan.xrus.org kidd.reunionwatch.com
kazan.zrus.org kinosed.net
kchaxton.com
kellyonline.xyz
khadastoafarde.tk
kinozapas.com
kit-opt.ru
kiwe-analytics.com
kiwi237au.tk kiwi237au.tk
kliksaya.com kometars.xyz
komp-pomosch.ru komputernaya-pomosh-moscow.ru
kosova.de kreativperlen.ch
kraljeva-sutjeska.com larchik.net
krasnodar.xrus.org layola.biz.tc
kredit-blog.ru ledpolice.ru
kskjco.club libertybilisim.com
kvartiry-remont.ucoz.ru lider-zhaluzi.kiev.ua
lacasamorett.com linerdrilling.com
ladsblue.com lion.misba.us
lankarns.com livesex-amateure.info
lapolis.it liveu.infoteka.hu
lennatin.info locationdesaison.com
lifebyleese.com
likesdesign.com
liky.co.ua
linkredirect.biz
lion.bolegapakistan.com
littlesexdolls.com
liveinternet.ro
livetsomudvekslingstudent.bloggersdelight.dk
locimge.pw
loftdigital.eu loftdigital.eu
lomb.co longgreen.info
lombardfinder.ru lookingglassemb.com
lomza.info lottospring.com
losangeles-ads.com
lovi-moment.com.ua
lrac.info
mackeeper-center.club
madot.onlinewebshop.net
magiadinamibia.blogspot.com magiadinamibia.blogspot.com
marcoislandvacations.net makedo.ru
masserect.com mall.uk
medmajor.ru manipulyator-peterburg.ru
medtherapy.ru marinetraffic.com
meget.co.za marketland.ml
microsoftportal.net masthopehomes.com
mikrobiologies.ru medanestesia.ru
minecraft-rus.org medispainstitute.com.au
mixx.com mega-bony2017.pl
mmog-play.ru megaindex.ru
megakino.net
meltwater.com
migente.com
missclub.info
mixed-wrestling.ru
mobile-appster.ru mobile-appster.ru
moivestiy.biz mobilemedia.md
moje-recenze.cz monarhs.info
monetizationking.net moneytop.ru
mrbitsandbytes.com montazhnic.ru
musicas.baixar-musicas-gratis.com more-letom.ru
mustat.com moroccosurfadventures.com
muz-tracker.net movpod.in
naphukete.ru mrwhite.biz
narco24.me musicdaddy.net
nash-krym.info muzaporn.com
naval.jislaaik.com muznachas-service.ru
nero-us.com myanyone.net
newfilmsonline.ru mydirtyhobby.com
myfreemp3.eu
myperiod.club
mypornfree.ru
nailsimg.com
nastydollars.com
nationalbreakdown.com
netfacet.net
new-post.tk
nfljerseysforsalewholesaler.com nfljerseysforsalewholesaler.com
nofreezingmac.click nhl17coinsforps3.gratisblog.biz
nuup.info nikitsyringedrivelg.pen.io
obiavo.in nonameread45.live
northfacestore.online
nottyu.xyz
npoet.ru
obiavo.ru
obsessionphrases.com obsessionphrases.com
online-templatestore.com oddamzadarmo.eu
oops-cinema.ru of-ireland.info
openfrost.com officedocuments.net
openfrost.net okel.co
optikremont.ru oklogistic.ru
orion-code-access.net okout.ru
ororodnik.goodbb.ru okroshki.ru
osagonline.ru onemactrckr.com
outrageousdeal-a.akamaihd.net onlainbesplatno.ru
partner-stop.men online-zaymy.ru
pcads.ru ontargetseo.us
pdamods.ru openlibrary.org
oxotl.com
pacificair.com
partner-print.men
pechikamini.ru pechikamini.ru
pepperstyle.ru perfectplanned.com
percin.biz.ly piccdata.com
perosan.com pillscheap24h.com
petitions.whitehouse.gov pixshark.com
picswe.com pkr1hand.com
picturesmania.com plugingeorgia.com
pinstake.com pod-muzyku.club
piski.top poffet.net
play-movie.pl popcash.net
pobeiranie.pl poppen-nw.net
poligon.com porno-video-chati.ru
popmarker.com pornolook.net
popup-hgd.xyz pornoted.com
popup.matchmaker.com pornpost.in
porno.simple-image.com.ua portal-eu.ru
pornoreino.com pourvous.info
pornzone.tv predominant-invent.tk
porto.abuilder.net pregnant.guru
portside.xyz preparevideosafesystem4unow.site
potoideas.us proftests.net
powitania.pl prostitutki-tolyatti.org
preconnubial.usuby.site prpops.com
printingpeach.com
pst2017.onlinewebshop.net
pufip.com
pulse33.ru pulse33.ru
puserving.com qexyfu.bugs3.com
puzzleweb.ru quickbuck.com
qor360.com quickchange.cc
qpypcx.com rankscanner.com
quick-offer.com rcpmda.ikan1080.xyz
qwesa.ru reelheroes.net
rating-bestcasino.com reining.lovasszovetseg.hu
real-time-analytics.com
redirlock.com
refudiatethissarah.info
remontvsamare.su remontvsamare.su
retailwith.com renewablewealth.com
reyel1985.webnode.fr rep-am.com
rialp.getenjoyment.net ringporno.com
robertefuller.com rockprogblog.com
rogervivierforsale.com rogervivierforsale.com
roma-kukareku.livejournal.com runtnc.net
romhacking.ru russintv.fr
rospromtest.ru saneyes.com
royal-betting.net saratov.xrus.org
ruf777.com
rukino.org
ruscopybook.com
rusenvironmental.net
russkoe-zdorovie.ru
rvzr-a.akamaihd.net
samara.rosfirm.ru
sammyweaver.com
sampleletters.net
sardinie.us sardinie.us
saveindex.xyz sashagreyblog.ga
savetubevideo.com scanner-alexa.top
sax-sex.com scanner-julianna.top
sc-specialhost.com scanner-mary.top
scanner-elena.top scottbywater.com
scanner-ivan.top sdelatmebel.ru
scoopquest.com sdi-pme.com
scrapy.org search-goo.com
scrnet.biz.ua searchencrypt.com
searchinterneat-a.akamaihd.net secretscook.ru
seasaltwithfood.com seeresultshub-a.akamaihd.net
seolab.top senger.atspace.co.uk
seorankinglinks.xyz seocheki.net
sexphoto.site seoholding.com
sheerseo.com serpstat.com
shoppytoolmac.com sevendays.com.ua
signal03.ru sharebutton.net
simple-share-buttons.com sherlock.se
simpoed.ufop.br shisha-swag.de
site-speed-check.site shoesonlinebuy.cn
siteonomy.com shoplvlv.us
siteripz.net simplesite.com
sitevalued.com sitevaluation.org
skutecznetabletkinaporostwlosow.pl skyway24.ru
smartadserver.com smartadserver.com
smartbalanceworld.com soblaznu.net
sms2x2.ru social-buttons.xyz
snip.tw social-fun.ru
sockshare.net socialmonkee.com
sohoindia.net softomix.com
sophang8.com sovetogorod.ru
sosdepotdebilan.com spaceshipad.com
souvenirua.com spbchampionat.ru
sports-supplements.us spl63.fr
stpicks.com ssconstruction.co
streamin.to star61.de
stretchingabuckblog.com start.myplaycity.com
strfls.com stats-public.grammarly.io
sugvant.ru steame.ru
sunflowerdrawingpaintings.blogspot.com sterva.cc
supers.com.ua strana-solnca.ru
support.nopeas.sk strongsignal-a.akamaihd.net
surffoundation.nl studiofaca.com
susanholtphotography.com styro.ru
swinger-mobil.net supermesta.ru
tabakur77.com suralink.com
tagil.zrus.org surcentro.com
teenfuck.tv surgut.zrus.org
theplacetoupdating.pw svtrd.com
titelhelden.eu symphonyintegratedhealthcare.com
tizanidinecapsules.blogspot.com teesdaleflyballclub.co.uk
tizanidinedosage.blogspot.com tehngr.ru
tizanidinehcl4mgtabinfo.blogspot.com templates.radiodigital.co
thaismartloan.com
the-trader.net
thebestphotos.eu
thenews-today.info
thruport.com
timdreby.com
timecrimea.ru
titan-ads.life
titan-cloud.life
titangel-vietnam.com
tizanidine4mguses.blogspot.com
tizanidinedruginteractions.blogspot.com
tizanidinehcl4mgtablet.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidineinfo.blogspot.com tizanidinehclsideeffects.blogspot.com
tnctrx.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
token-lab.org tizanidinenarcotic.blogspot.com
toloka.hurtom.com tizanidinestreetprice.blogspot.com
topappspro.com toolsky.com
topclickguru.com trafficfactory.biz
torrentred.games trafficmania.com
torrnada.ru traffictrade.life
trackzapper.com tri-slona.org
trafficstars.com trustedmaccleaner.com
triumf-realty.ru
turizm.bz turizm.bz
tversvet.ru turkeyreport.tk
typimga.pw tvoystartup.ru
ucsol.ru tx41tclega.ru
ukrtvir.com.ua ua-company.ru
ultimateclassicrock.com udsgame.online
umityangin.net ukkelberg.no
unacittaconte.org ukrobstep.com
upstore.me unionmarkt.de
unrealcommander.com
uogonline.com
urdoot.win
usiad.net
ussearche.cf ussearche.cf
ustion.ru vacuumcleanerguru.com
vabasa.inwtrade.com varbergsvind.se
vacances-voyages.info vegascosmetics.ru
validccseller.com vgoloveboli.net
vchulkah.net viagra-soft.ru
video-chat.love video-camer.com
videokrik.net video-chat.in
vipromoffers.com videos-for-your-business.com
visionwell.com.cn videosbox.ru
vk-mus.ru villakohlanta.nu
voltrknc1.com vinsit.ru
waysbetter.cn vitoriacabos.com
webshoppermac.com vkonche.com
webtherapy.ru vkontaktemusic.ru
wedding-salon.net vozbujdenie.com
wemarketing.se vse-pesni.com
whatsappdownload10.com vtcdns.com
whereverdesperate.gq vut.com.ru
wholesalejerseychinashop.com watch-movies.ru
wiosenny-bon-1500.pl we-are-gamers.com
wjgony.com webcamtalk.net
wovis.site webinstantservice.com
www.arenda-yeisk.ru webix.biz
www.kabbalah-red-bracelets.com webkeyit.com
x-rates.ru wejdz-tu.pl
xblognetwork.com westvilletowingservices.co.za
xboxster.ru whatsupinfoley.com
xcc24.pl witherrom55.eklablog.fr
xmnb.net wnhjavlhezp.gq
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai womama.ru
xolodremont.ru woman-orgasm.ru
xtrafficplus.com writersgroup580.web.fc2.com
xtubeporno.net wstroika.ru
xxx-cam.webcam www.event-tracking.com
youjizz.vc wygraj-teraz.com
yoursearch.me xgames-04.com
yugk.net xingzi-vision.com
zarabiaj-dzis.pl xvideosporn.biz
zdesformula.ru xxxasianporn.net
zeroredirect.com yaaknaa.info
zigarettenonlinekaufen1.blox.pl yaoguangdj.com
zigarettenonlinekaufen2.bloog.pl yougotanewdomain.com
zixizop.net.ru yourothersite.com
zone-kev717.info yuweng.info
zooggames.com zaloadi.ru
zootoplist.com zarepta.com
zrizvtrnpale.tk zazagames.org
zhongwenlink.com
zigarettenonlinekaufen2.drupalgardens.com
znakomstva-moskva77.ru
znakomstva-piter78.ru
zona-aqua.ru
zoogdisany.com
zoomovies.org
zscalerone.net

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00author.com 123cha.com
101billion.com 1bet.com
1314dh.com 23kw.ru
3dracergames.com 2rich4bitches.com
4replicawatch.net 2x2fan.ru
aa8b68101d388c446389283820863176e7.com 9icmzvn6.website
abcdeg.xyz aa9d046aab36af4ff182f097f840430d51.com
actionnooz.com actulite.com
adminshop.com adman.gr
adservme.com adviceforum.info
adultnet.in agecheckadult.com
aibolita.com alert-hgd.xyz
alert-jdh.xyz alkoravto.ru
algerianembassy.co.in amehdaily.com
alienwheel.es analytics-ads.xyz
all4invest.ru andpolice.com
allnews.md apiappenableinfo-a.akamaihd.net
anonymizeme.pro appfastplay.com
apartmentbay.ru
appiq.mobi appiq.mobi
apple.com-cleaner.systems
arate.ru arate.ru
atmovs.com arenda-avtoprokat-krasnodar.ru
audiofree.ru atlasvkusov.ru
auto.rusvile.lt avon-novosib.ru
avtolombard-krasnodar.com babosas.com
awency.com bala.getenjoyment.net
azarttoto.com battlecarnival.su
babs.com.ua best-mam.ru
beachdriveblog.com bestcalovebracelet.cn
bestimagecoollibrary.com bestcoin.cc
bestmobilityscooterstoday.com betterscooter.com
betteroffers.review bigcareer.info
bio-optomarket.ru birzha-truda.eu
biznesluxe.ru boobsimge.com
biznesrealnost.ru bravegirlsclub.com
blog.yam.com brewdom.ru
boc.kz bumskontakte.org
bombla.org buybest1.biz
boole.onlinewebshop.net buypanicdisorderpill.com
bpro1.top buyviagraa.blogspot.com
brainboostingsupplements.org cand.jp
brandov.ru carabela.com.do
break-the-chains.com carapics.com
brus-vsem.ru cardiosport.com.ua
bugof.gq cardsdumps.com
buron.pw cashonads.com
bzero1jewelry.net casinopinup-wins.com
cacheimages.com casinos4dummies.co.uk
candycrushshop.com cdncash.net
centre-indigo.org.ua centrumcoachingu.com
ceotrk.com cfcl.co.uk
cfjump.com cheapjerseysfootballshop.com
cheap-trusted-backlinks.com
checkpagerank.net
chelnytruck.ru
cherrypointplace.ca cherrypointplace.ca
chinese-amezon.com cialischmrx.com
circlesl.com cialischstgerts.com
cleanallvirus.com cineacademy.ru
compliance-george.xyz claytransformations.info
cowblog.fr clubfashionista.com
customerpromos-a.akamaihd.net cognitiveseo.com
cutt.us compliance-fred.top
cypernhuset.se compliance-walt.top
damedingel.ya.ru countbertwistdisp26.soup.io
damasarenai.info
daretodonate.co
datadepths.com
dating-app.ru dating-app.ru
dawlenie.com davidovic.info
deluxedumps.com deanmoore.ie
dipstar.org deshevo-nedorogo.ru
discovertreasurenow.com dfwu1013.info
doreenblog.online divisioncore.com
drivotracker.com domain.webkeyit.com
e-avon.ru download-wallpaper.net
e-kwiaciarz.pl e-kwiaciarz.pl
earl-brown.info earthmagic.info
eduinfosite.com editors.choice6912650.hulfingtonpost.com
ekaterinburg.xrus.org elektrozigarettekaufen2.blogse.nl
elektronischezigarettekaufen1.beeplog.com en.home-task.com
elektrozigarette1.dreamwidth.org eralph.tk
erot.co eurosamodelki.ru
errorfixing.space exoclick.com
escortplius.com ezigarettekaufen2.blox.pl
essaypro.com failingmarriege.blogspot.com
everflora.ru farmprofi.net
evogarage.com fickluder69.com
eyelike.com.ua figuringmoneyout.com
fantasticpixcool.com findanysex.com
fast-torrent.ru fivedwld.cf
favorcosmetics.com floridamobilebillboards.com
fillmewithhappiness.com fototravel.eu
finteks.ru frankofficial.ru
flagcounter.me free-share-buttons.top
forensicpsychiatry.ru free-video-tool.com
forumprofi.de freshdz.com
gael-s.ru fungamelands.com
funponsel.com
gamingspark.com
gay.adultgalls.com gay.adultgalls.com
getoutofdebtfree.org getmyads24.com
greenzaim.ru go2jump.org
h2monline.com gonextmedia.com
hcate.com goo.ne.jp
hdwallpapers-free.com gq-catalog.gq
hermesreplica.win greenidesign.co
himazin.info gta-club.ru
hostingclub.lk i-hobot.ru
housemilan.ru i4track.net
ilovevitaly.com ie.57883.net
immobiliaremassaro.com iideaidekonkatu.info
ip-guide.com indianmedicaltourismshop.com
itrevolution.cf irkutsk.online-podarki.com
javrip.net iron-age.info
jus0wil.pp.ua iweblist.info
kazka.ru izoll.ru
keywordhouse.com j33x.com
kfon.eu jimmychoosale.online
kndxbkdx.bloger.index.hr justbcause.com
komputers-best.ru kadashihotel.com
kredit-blog.ru keywordsuggest.org
kurwa.win kinky-fetishes.com
lacasamorett.com klikbonus.com
lafriore.ru klumba55.ru
landoftracking.com kmgamex.cf
laparfumotec.com kollesa.ru
lapitec.eu konica.kz
lrac.info lesbian.xyz
m5home.ru longgreen.info
macresource.co.uk lubetube.com
maladot.com lunchrock.co
mebel-ekb.com mainlinehobby.net
megaindex.ru mamasuper.prom.ua
merryhouse.co.uk manifestation.betteroffers.review
minneapoliscopiers.com manimpotence.com
mmofreegames.online max-eclat.men
mmstat.com mcar.in.ua
mojaocena.com mcnamaratech.com
monetizationking.net menstennisforums.com
mykings.pw message-warning.net
mzdish.site metaxalonevstizanidine.blogspot.com
nordstar.pro moyakuhnia.ru
odesproperty.com muztops.ru
offer.camp my-floor.in.ua
offf.info myfreetutorials.com
onefilms.net myindospace.com
online-sbank.ru myonlinepayday.co
onlinewritingjobs17.blogspot.ru namenectar.com
ooo-gotovie.ru netvouz.com
optibuymac.com nfljerseyscheapbiz.us
nlfjjunb5.ru
nootrino.com
notfastfood.ru
novodigs.com
oivcvx.website
oneshotdate.com
online.ktc45.ru
otbelivanie-zubov.com
oyster-green.com
palocco.it
pearlisland.ru pearlisland.ru
perl.dp.ua penisvergrotendepillennl.ovh
phpdevops.com
piccshare.com piccshare.com
pliks.pl pics-group.com
poem-paying.gq picsearch.com
pojdelo.weebly.com pizda.lol
poptool.net pkr1hand.com
pornobrazzers.biz popup.matchmaker.com
pornoelita.info proekt-mos.ru
portadd.men propranolol40mg.blogspot.com
pp-budpostach.com.ua qld10000.net
predmety.in.ua questionmarque.ch
predominant-invent.tk rasteniya-vs-zombi.ru
pro-okis.ru rating-bestcasino.com
producm.ru redhotfreebies.co.uk
professionalwritingservices15.blogspot.ru rewardit.com
profit-opportunity.com s8-nowy-wygraj.comli.com
prohoster.info saddiechoua.com
pussysaga.com sady-urala.ru
puteshestvennik.com sarm.tk
remont-fridge-tv.ru sax-sex.com
remont-komputerov-notebook.ru sayyoethe.blogspot.co.za
rentalcarnavi.info sbprabooks.com
rumamba.com scanner-jane.top
running-line.ru scrapinghub.com
sandhillsonline.com seasonvar.ru
sawin.beth.webd.pl segol.tv
sbf441.com seocdvig.ru
scrnet.biz.ua sexspornotub.com
seansonline24.pl sierraapps.com
search.1and1.com simply.net
seo-traffic-ranking.info sitevaluation.com
seoprofiler.com sklad-24.ru
sex-watch.com skypasss.com
sexcamamateurchat.com solicita.info
sexs-foto.com spidtest.org
sexvideo-sex.com spin2016.cf
sexyali.com spitfiremusic.com
shakhtar-doneck.ru srgwebmail.nl
shemalegalls.blogporn.in standardchartered-forex.com
sibdevice.ru startwp.org
siteimprove.com strongsignal-a.akamaihd.net
siteonomy.com studiofmp.com
skutecznetabletkinaporostwlosow.pl support.nopeas.sk
sledstvie-veli.net surgut.zrus.org
small-games.biz swsociety.se
snsdeainavi.info syndicate.fun
soc-econom-problems.ru tabakur77.com
spasswelt.net technika-remont.ru
sports-supplements.us thepantonpractice.co.uk
stauga.altervista.org thetoiletpaper.com
stop-zavisimost.com tizanidineformigraines.blogspot.com
stroiminsk.org tizanidinehcl4mgtab.blogspot.com
susanholtphotography.com tn811.us
taqplayer.info tobeyouday.win
telefonsex-ohne0900.net tomatis.gospartner.com
tengohydar.tk top-karkas.ru
the-usa-games.blogspot.com topkarkas.com
thegameriders.com ttsq.fr
titan-ads.life tuberkulezanet.ru
tizanidineandhydrocodone.blogspot.com tvteleport.ru
tizanidinedrugtest.blogspot.com twelvevisionspartyofcolorado.com
tmtrck.com twittruth.com
toonfamilies.net uchil.net
top-l2.com udayavani.com
topsy.com uhdtv.website
torrent-to-magnet.com universals.com.ua
tourismvictoria.com usiad.net
tozup.com valmetrundan.se
traffpartners.com vertaform.com
trainoffend.ml veselokloun.ru
truck-land.life vgoloveboli.net
tv-spoty.info viagraneggrx.com
twittrading.com villakohlanta.nu
ufa.xrus.org vitalads.net
ugogo.info vitoriacabos.com
umekana.ru vladhistory.com
usbggettwku.ga vod.com.ua
vavilone.com warning.or.kr
via-energy-order.com wfb.hatedriveapart.com
videochat.life white-truck.life
videochat.mx wowcasinoonline.ooo
vids18.site www.bookmaker-bets.com
vigrx-original.ru xedserver.com
vintontech.info xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
vkmusics.ru xn----itbkqkfiq.xn--p1ai
wcb.su
webmasters.stackexchange.com
weclipart.com
weprik.ru
westermarkanjou.se
where-toget.com
www.get-free-traffic-now.com
xmladserver.com
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
xn--80aodinpgi.xn--p1ai
xolodremont.ru
xtremeeagles.net xtremeeagles.net
youtoner.it yoluxuryevents.com
zhongwenlink.com youradulthosting.com
zoogdiesney.com zahvat.ru
zvezdagedon.ru zdesformula.ru
zigarettenonlinekaufen1.bloog.pl
zvuker.net

139
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -8,6 +8,72 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html>ml>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html> </html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
@ -428,69 +494,6 @@
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<html>
<head><title>503 Service Temporarily Unavailable</title></head>
<body>
<center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
<!DOCTYPE html> <!DOCTYPE html>
<html> <html>
<head> <head>
@ -581,14 +584,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.21 0; 10.1.0.181 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.09.2589 ### Version: V4.2021.09.2590
### Updated: Mon Sep 13 22:01:26 UTC 2021 ### Updated: Tue Sep 14 10:03:23 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.09.2589 ### Version: V4.2021.09.2590
### Updated: Mon Sep 13 22:01:26 UTC 2021 ### Updated: Tue Sep 14 10:03:23 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##