vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2021.10.2659 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2021-10-18 22:08:57 +00:00
parent 1b74c27192
commit 7d2f3cac92
47 changed files with 69948 additions and 69958 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2658 #### Version: V4.2021.10.2659
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2021.10.2658 #### Version: V4.2021.10.2659
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -11,7 +11,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2021.10.2658 #### Version: V4.2021.10.2659
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8610
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2021.10.2658 #### Version: V4.2021.10.2659
#### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7078](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [623](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

8614
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8614
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

8614
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

8614
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2658 2659

8614
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

8614
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.186.140.21 0; 20.115.160.226 0;

8614
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

8614
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.186.140.21 0; 20.115.160.226 0;

8614
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.186.140.21 0; 20.115.160.226 0;

8614
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 1; 10.1.1.229 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
ADmantX Asterias
CensysInspect ExtLinksBot
Internet Ninja Iblog
Re-re Larbin
TwengaBot Snake
Vacuum WebFetch
WBSearchBot WebStripper
Wallpapers Xaldon_WebSpider
YoudaoBot Zade
ZmEu seostar

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com ASPSeek
360Spider
80legs
ADmantX
ALittle Client
Aboundex
Aboundexbot Aboundexbot
Acunetix
AhrefsBot AhrefsBot
Alexibot Aipbot
AllSubmitter AllSubmitter
AlphaBot
Anarchie
Anarchy Anarchy
Anarchy99 Ankit
Apexoo Asterias
AwarioSmartBot Attach
AwarioRssBot
BDCbot BDCbot
BackStreet BackStreet
Backlink-Ceck Backlink-Ceck
BacklinkCrawler
Badass Badass
BetaBot
Bigfoot Bigfoot
Bitacle Bitacle
Blow Black Hole
BlackWidow
Boardreader Boardreader
BotALot
Brandprotect Brandprotect
Buck Brandwatch
Buddy
BuiltWith
Bullseye Bullseye
BunnySlippers
BuzzSumo BuzzSumo
Calculon CATExplorador
CCBot
CSHttp
CazoodleBot CazoodleBot
CheTeam
CherryPicker
ChinaClaw ChinaClaw
Claritybot
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cogentbot
Collector Collector
CopyRightCheck Copyscape
Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy CyotekWebCopy
DBLBot
DIIbot DIIbot
DTS Agent DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Devil Deusu
Discobot Digincore
Dirbuster
Discoverybot
Dispatch
DnyzBot DnyzBot
DomCopBot DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Dotbot Download Wonder
ECCP/1.0 EasyDL
Ecxi Ebingbong
Evil Evil
Extractor ExtLinksBot
Extreme Picture Finder FDM
FemtosearchBot FlashGet
Fimap
Freeuploader Freeuploader
Fuzz
FyberSpider FyberSpider
G-i-g-a-b-o-t Fyrebot
GetWeb GT::WWW
Gotit GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
GrabNet GrabNet
Grabber GrapeshotCrawler
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HTTP::Lite
HTTrack HTTrack
Haansoft Haansoft
HaosouSpider HaosouSpider
Havij
Heritrix Heritrix
Hloader Hloader
Humanlinks Humanlinks
IRLbot HybridBot
Image Sucker
IndeedBot IndeedBot
InfoTekies Internet Ninja
InternetSeer Iskanie
IstellaBot
JOC Web Spider
JamesBOT JamesBOT
Jyxobot Joomla
Kenjin Spider Kenjin Spider
LNSpiderguy Keyword Density
LexiBot Kozmosbot
Libwhisker Leap
LeechFTP
LibWeb
LieBaoFast LieBaoFast
Lightspeedsystems Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey Lipperhey
Lipperhey Spider Ltx71
MIDown tool MIDown tool
MTRobot MIIxpc
Majestic12 MQQBrowser
MarkWatch MSIECrawler
MeanPath Bot Mag-Net
Meanpathbot Mail.RU_Bot
Mediatoolkitbot Majestic SEO
MegaIndex.ru MauiBot
Mb2345Browser
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access
Mister PiX Mister PiX
Moblie Safari Moblie Safari
Mojeek Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3 Mr.4x3
Msrabot
Musobot Musobot
Name Intelligence Name Intelligence
Navroad Navroad
NearSite
Net Vampire Net Vampire
NetAnts NetLyzer
NetMechanic
Nettrack
Netvibes Netvibes
NextGenSearchBot
Nibbler
Ninja Ninja
Nmap Nuclei
Nutch Offline Explorer
Octopus OrangeSpider
PECL::HTTP OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber PageGrabber
PageScorer Panscient
PageThing.com Papa Foto
Petalbot Pavuk
Pi-Monster Pi-Monster
Picscout Picscout
Pimonster Pixray
PleaseCrawl
ProWebWalker ProWebWalker
Psbot Probethenet
PyCurl Pump
Quick-Crawler PxBroker
RankActive QueryN Metasearch
RankActiveLinkBot RankActiveLinkBot
RankingBot RankFlex
RankingBot2 Rankivabot
RankurBot Re-re
RealDownload ReGet
Reaper
RebelMouse
Recorder
RepoMonkey RepoMonkey
Ripper
RocketCrawler RocketCrawler
Rogerbot Rogerbot
SEOkicks
SEOlyticsCrawler
SalesIntelligent SalesIntelligent
ScanAlert
Scrapy Scrapy
ScreenerBot ScreenerBot
Semrush Searchestate
SearchmetricsBot
SemrushBot SemrushBot
SentiBot SiteCheckerBotCrawler
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Sitebeam Sitebeam
Siteimprove Snake
SlySearch Snapbot
SmartDownload SpaceBison
Snoopy Spammen
SocialRankIOBot SputnikBot
Sociscraper
Sosospider
Sottopop
Spinn3r
Sqlworm Sqlworm
Steeler Stripper
Sucker Sucuri
SuperBot SurveyBot
SuperHTTP
Suzuran
Swiftbot Swiftbot
Szukacz T8Abot
T0PHackTeam
Teleport Teleport
TeleportPro TeleportPro
Telesphorep TightTwatBot
TheNomad True_Robot
Titan Turingos
Tracemyfile VB Project
Trendiction
Turnitin
Typhoeus
V-BOT
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VidibleScraper
Virusdie
VoidEYE VoidEYE
Voltron
WASALive-Bot WASALive-Bot
WEBDAV WBSearchBot
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWW-Mechanize
Wallpapers/3.0 WWWOFFLE
Wallpapers
Web Auto
Web Enhancer Web Enhancer
WebBandit Web Sauger
WebAuto
WebCollage WebCollage
WebFetch
WebFuck WebFuck
WebGo IS WebGo IS
WebImageCollector WebReaper
WebPix WebSauger
WebSucker WebStripper
WebZIP WebZIP
Webalta Webalta
Webshag Whack
Webster Whacker
Wotbox Whatweb
Woobot
Wprecon Wprecon
Xaldon_WebSpider Xaldon WebSpider
Xenu Xenu
Zade Zauba
Zitebot Zermelo
Zeus
ZoomBot
ZoominfoBot
ZyBorg ZyBorg
archive.org_bot archive.org_bot
arquivo.pt arquivo.pt
autoemailspider backlink-check
cah.io.community
check1.exe check1.exe
coccocbot-web clark-crawler
com.plumanalytics com.plumanalytics
crawler4j crawl.sogou.com
dataforseo.com demandbase-bot
domainsproject.org domainsproject.org
evc-batch eCatch
internetVista monitor
ips-agent
isitwp.com isitwp.com
magpie-crawler lwp-request
meanpathbot
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot
page scorer page scorer
plumanalytics pcBrowser
polaris version probe-image-size
seoscanners satoristudio.net
scan.lol
seostar
serpstatbot
sitechecker.pro
siteripz
sogouspider sogouspider
spyfu spyfu
voyagerx.com sysscan
webprosbot webpros.com
xpymep1.exe
zgrab

290
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs 404enemy
ADmantX Aboundexbot
AIBOT
ASPSeek
Alexibot Alexibot
Alligator
AlphaBot
Anarchy
Ankit
Apexoo Apexoo
AwarioSmartBot Attach
BBBike AwarioRssBot
BLEXBot
BackStreet BackStreet
Badass BacklinkCrawler
Barkrowler Barkrowler
BetaBot
Bigfoot
Bitacle
Black Hole Black Hole
Blow Blow
BlowFish BlowFish
Boardreader
Bolt Bolt
BotALot BotALot
Brandprotect
Brandwatch Brandwatch
Buddy Buddy
BuiltBotTough BuiltBotTough
BunnySlippers Calculon
CATExplorador
CCBot
CSHttp
CazoodleBot CazoodleBot
CensysInspect Cegbfeieh
CheeseBot CheTeam
CherryPicker CherryPicker
Cliqzbot Cocolyzebot
Cloud mapping Cogentbot
Copier Collector
CopyRightCheck CopyRightCheck
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
CrunchBot Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Devil Demon
Dirbuster
Discobot
Discoverybot
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
EMail Siphon Drip
EMail Wolf EMail Wolf
EasyDL Ecxi
Express WebPictures EroCrawler
Evil
Extractor Extractor
Extreme Picture Finder
EyeNetIE EyeNetIE
Ezooms
FDM FDM
FemtosearchBot FemtosearchBot
Flunky Flunky
Foobot
Freeuploader
Fuzz
FyberSpider FyberSpider
Fyrebot Fyrebot
G-i-g-a-b-o-t Genieo
GalaxyBot
GermCrawler
GetRight GetRight
GetWeb GoZilla
Getintent Grafula
Go!Zilla GrapeshotCrawler
Grabber GridBot
HEADMasterSEO HMView
HTMLparser HTMLparser
HTTrack
Haansoft
HaosouSpider HaosouSpider
Havij Havij
Heritrix
Hloader Hloader
Humanlinks HybridBot
IDBTE4M IDBTE4M
Image Sucker IDBot
InterGET Id-search
Image Fetch
IndeedBot
Indy Library
InternetSeer InternetSeer
Iria
Iskanie Iskanie
JOC Web Spider JamesBOT
Jetty JetCar
JikeSpider Jorgee
Jyxobot LNSpiderguy
LWP::Simple
Lanshanbot
Larbin Larbin
Leap Leap
LeechGet LeechGet
LexiBot
Lftp
Libwhisker
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker MJ12bot
Lmspider MSFrontPage
Ltx71
MIDown tool
Mag-Net Mag-Net
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan Masscan
Meanpathbot Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri Metauri
Moblie Safari Mister PiX
Msrabot Mojolicious
Name Intelligence Musobot
NearSite Net Vampire
NetLyzer NetLyzer
NetMechanic Netcraft
NetZIP NextGenSearchBot
Netvibes
Nibbler Nibbler
Niki-bot Niki-bot
NimbleCrawler
Ninja Ninja
Nmap Nmap
Nuclei
Nutch
Offline Explorer
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP PECL::HTTP
Page Analyzer Pandalytics
PageScorer
PageThing.com
Papa Foto
Pavuk Pavuk
Petalbot PeoplePal
Pi-Monster
Picscout Picscout
Picsearch Pimonster
PictureFinder Pockey
Piepmatz ProWebWalker
Psbot Psbot
Pump
PxBroker PxBroker
Quick-Crawler Quick-Crawler
RSSingBot RSSingBot
RankActiveLinkBot RankActive
RankFlex RankingBot
Rankivabot RankingBot2
Re-re Re-re
ReGet
RealDownload RealDownload
Reaper Reaper
Recorder RebelMouse
RedesScrapy RedesScrapy
Ripper RepoMonkey
SEOkicks-Robot Rogerbot
SBIder
SEOprofiler SEOprofiler
SEOstats
SMTBot
ScanAlert
Scanbot Scanbot
ScrepyBot ScoutJet
Scrapy
Screaming
Searchestate
SearchmetricsBot
Semrush Semrush
Seomoz SentiBot
Siteimprove SeoSiteCheckup
SlySearch SeobilityBot
SmartDownload Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Snake Snake
Snapbot Sociscraper
Snoopy Spammen
Sosospider
Spbot Spbot
Spinn3r Spinn3r
Sqlmap
Sqworm Sqworm
Steeler Stripper
Sucker Sucker
Sucuri Surfbot
SuperBot Swiftbot
Suzuran
Szukacz
T0PHackTeam T0PHackTeam
T8Abot T8Abot
TeleportPro TeleportPro
Turnitin Telesphoreo
The Intraformant
Titan
Toata
Tracemyfile
True_Robot
Turingos
TurnitinBot TurnitinBot
TwengaBot TwengaBot
Typhoeus
URLy Warning
URLy.Warning URLy.Warning
UnisterBot UnisterBot
Upflow
V-BOT V-BOT
VB Project VCI
Vacuum Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
VoidEYE Virusdie
Voltron WBSearchBot
WWWOFFLE WWW-Mechanize
WallpapersHD
WeSEE
Web Auto Web Auto
Web Collage
Web Enhancer Web Enhancer
Web Fuck
Web Pix Web Pix
Web Sauger
Web Sucker Web Sucker
WebAuto WebAuto
WebCollage
WebCopier
WebFetch
WebFuck
WebGo IS WebGo IS
WebImageCollector WebLeacher
WebPix
WebStripper
WebZIP WebZIP
WebmasterWorldForumBot Webalta
Website Quester Wonderbot
Webster Xaldon WebSpider
Whatweb Xaldon_WebSpider
Who.is Bot
WinHTTrack
Woobot
Wotbox
Xenu
YoudaoBot YoudaoBot
Zade Zermelo
ZmEu ZoomBot
ZoominfoBot ZoominfoBot
archive.org_bot archive.org_bot
backlink-check
cah.io.community cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics com.plumanalytics
crawler.feedback crawl.sogou.com
demandbase-bot domainsproject.org
eCatch
evc-batch evc-batch
instabid facebookscraper
internetVista monitor heritrix
magpie-crawler isitwp.com
mediawords lwp-trivial
oBot page scorer
pcBrowser
polaris version
probe-image-size
ripz ripz
s1z.ru scalaj-http
scan.lol
seobility seobility
seoscanners seoscanners
serpstatbot
sexsearcher
siteripz siteripz
sogouspider sogouspider
sp_auditbot
spyfu
sysscan sysscan
trendiction.com
voyagerx.com
x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
divatraffic.com app5.letmacworkfaster.world
hentaiheroes.com asdfz.pro
kaz.kz bet365.com
parfusale.se birzha-truda.eu
rvzr-a.akamaihd.net catalogs-parts.com
searchimpression.com cherrypointplace.ca
statustroll.com dikx.gdn
upstore.me htmlcorner.com
wowas31.ucoz.ru jerseychinabizwholesale.us
ynymnwbm.bloger.index.hr prod2016.com

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
123any.com 0daymusic.org
1qingdao.com 11pikachu.ru
2345.com
24x7-server-support.site 24x7-server-support.site
4istoshop.com 404.mn
4kpics.rocks 4replicawatch.net
4webmasters.org 777-club.ru
5tey7463.weebly.com 883zy.com
8gold.com adloads.com
999webdesign.com admitad.com
acortarurl.es adtology.com
acunetix-referrer.com adultfriendfinder.com
adconscious.com adultfullhd.com
adult3dgames.com adzerg.com
aktivator-windows10.blogspot.com agapovdg.ru
alfa-medosmotr.ru ahrntal.verymes.xyz
alkoravto.ru air-edem.ru
all4wap.ru all4wap.ru
allcredits.su allcredits.su
aloofly.com allnews24.in
ampower.me altamayoztourism.com
amt-k.ru alyeskaresort.com
anabolics.shop amazingninja.com
anal-acrobats.hol.es analytics-ads.xyz
animali.deagostinipassion.it anjalika.co.in
anonymous-redirect.com
anti-virus-removal.info anti-virus-removal.info
apccargo.com apccargo.com
apiholdingmypage-a.akamaihd.net apidiamondatanet-a.akamaihd.net
arenda-avtoprokat-krasnodar.ru apilinkswiftco-a.akamaihd.net
apimegabrowsebiz-a.akamaihd.net
appartement-stumm.at
appfastplay.com
appleid-verification.com
apptester.tk
arabsexxxtube.com
arate.ru
arcteryxsale.online
arendatora.ru
arkartex.ru arkartex.ru
asacopaco.tk autovideobroadcast.com
asseenontv.ru avtointeres.ru
atovh.local-finders.com awaybird.ru
aussie-prizes.com backlink4u.net
auto-zapchasti.org baditri.com
aviav.eu bagsonsale.online
avon-severozapad.ru bangla-chat-uk-paralud.ga
avtoarenda.by bbtec.net
avtovolop.ru beget.tech
ayakino.net beremenyashka.com
azarttoto.com bestmarriages.com
b-styles.xyz bestofupload.info
babespcs.com bestpornuha.com
baikaleminer.com bioinnovate.co
bala.getenjoyment.net bizfly.info
balkanfarma.ru bolezniorganov.ru
bannertesting.com bolitgorlo.net
barnfurnituremart.com brainboostingsupplements.org
besthomemadepornsites.com brandimensions.com
betterscooter.com brianhenry.co
binomo.com bukleteg.xyz
bird1.ru burger-imperia.com
bjetjt.com buscarfoto.com
blagovest-med.ru buy-forum.ru
bonky.biz buypanicdisorderpill.com
boostmyppc.com c-english.ru
bpro1.top c1.onedmp.com
brandbucket.com callawaygolfoutlet.online
buckspar.gq callcafe.info
buron.pw canoncdriverq3.pen.io
businescoop.men cardiosport.com.ua
buy-loft.ru carrauterie.be
buyantiviralwp.com cb.iphantom.com
buydissertation.net celejihad.info
bvlgariwallet.xyz cenoval.ru
callejondelpozo.es cfsrating.sonicwall.com
cam-kontakte.org cheapmoncler.xyz
candycrushshop.com checkpagerank.net
candypeople.se chlooe.com
carabela.com.do choice-credit.ru
carapics.com christianlouboutinsaleoutletonline.us
cartierlovestore.xyz cialiswithoutadoctor.net
cartujano-pre.de citetick.com
cbb1smartlist12.click clash-clans.ru
cdn.walkme.com cleanallvirus.com
cdncash.net cleansearch.net
cdnnetwok.xyz clickaider.com
cellfun.mobi clickbanksites.info
cheapbarbour.online cocyq.inwtrade.com
chidporn.com coindirect.io
chocolateslim-en-france.com com-onlinesupport.site
cialgenisrx.com contentsexpress.com
circlesl.com continent-e.tv
cleanallspyware.com cornomase.win
clknsee.com cougfan.info
coin-hive.com courtshipgift.com
construmac.com.mx covadhosting.biz
cookie-law-enforcement-aa.xyz credit.co.ua
country-chic.ru creditmoney.com.ua
crystalslot.com d0t.ru
custodieva.ru danashop.ru
customerpromos-a.akamaihd.net db.speedup.gdn
dame-ns.kz dentalpearls.com.au
datadepths.com dentfidemountpreach.tk
delayreferat.ru derevesendeco.com
deniven.1bb.ru dinkolove.ya.ru
deutschland123.de disruptingdinnerparties.com
dieta-personalna.pl diusyawiga.tk
dimkino.ru documentbase.net
dirtpics.pw dogbreedspicture.net
dosug-lux.ru dojki-hd.com
downloadeer.net dominterior.org
downloadmefiranaratb1972.xpg.com.br doreenblog.online
dptaughtme.com dorratex.tn
drivotracker.com doyouknowtheword-flummox.ml
e-avon.ru dverimegapolis.ru
dyt.net
e-poker-2005.com e-poker-2005.com
easyukraine.com ednorxmed.com
ec-file.info
ecommerce-seo.org
edwinkonijn.com.au
ekaterinburg.xrus.org
ekobata.ru ekobata.ru
ekspresihati.info ekspresihati.info
eldiariodeguadalajara.com ekto.ee
elektrischezigarette2.onsugar.com el-nation.com
elektrischezigarettekaufen2.cowblog.fr electronicadirect.com
elektronischezigarette2.mex.tl elektrozigarettekaufen2.blogse.nl
elektrozigaretten1.webs.com elmacho.xyz
emailaccountlogin.co empis.magix.net
energydiet24.ru enpolis.ru
englishgamer.com erotische-geschichten-xxl.com
ero-advertising.com eshop.md
essayservicewriting.org excaliburfilms.com
evehemming.blogspot.com.au executehosting.com
everypony.ru exportshop.us
face.hostingx.eu ezigarettenshop1.yolasite.com
fanpagerobot.com ezigarettenshop2.postbit.com
faptitans.com ezigaretteshop2.mywapblog.com
fashion-stickers.ru familyphysician.ru
fast-wordpress-start.com famix.xyz
fearcrow.com fashionindeed.ml
feargames.ru feargames.ru
filunika.com.ru fetlifeblog.com
financeloan.us
findpics.pw findpics.pw
flash4fun.com firma-legion.ru
flashahead.info fitnesspiks.com
forpackningsutveckling.se fm-upgrade.ru
fortunejack.com fodelsedagspresenter.nu
forum.poker4life.ru foodcrafts.website
forzeronly.com footbalive.org
fotosfotos.eu forminecrafters.ru
freefoto.ca fortevidyoze.net
galeon.com fotoxxxru.com
gallery.rennlist.com foxinsocks.ru
gambarkatabaru.com freevpn.space
ge0ip.com frequiry.com
generic-pills-online.com freza-sverlo.ru
getoutofdebtfree.org frighteningremain.cf
gilbertbanda.net gabeshop.ru
glastecfilms.com.my gallerily.com
gobongo.info galleryawesome.com
gogps.me gamebackyard.com
gemgrab-a.akamaihd.net
generalporn.org
get-free-traffic-now.com
gheus.altervista.org
gigapeta.com
gilsonchiro.xyz
girlspicsa.com
global-ics.co.za
go2jump.org
golfresa.lucania.se
gombita.info gombita.info
goodhousekeeping.com google-liar.ru
goosefishpost.bid gotorussia.com
gotcher.us greatidea.marketing
greatdealshop.com guge.io
gsasearchengineranker.xyz gwagka.com
guidefs.ru gwebtools.com.br
gymi.name
habermetre.com habermetre.com
hamilton.ca hdpixent.com
hatedriveapart.com healbio.ru
hdimagegallery.net hebr.myddns-flir.com
healing-dysplasia.ru highstairs-a.akamaihd.net
hem.passagen.se hkladys.com
heroz.fr homeart.space
hit-kino.ru
hmmm.cz
homedecorpicture.us homedecorpicture.us
homemature.net huimin764128.com
hopeonthestreet.co.uk hully.altervista.org
hornymatches.com humanelydrew.com
host-tracker.com hustoon.over-blog.com
hotel-mkad.ru idc.com.ua
hoterika.com igadgetsworld.com
i4track.net igru-xbox.net
iamsport.org igtools.club
ibb.com.ua imabase.com
ideawheel.com
ihc2015.info
ilmen.net
imagui.eu
imgarit.pw
imicrovision.com imicrovision.com
immobiliaremassaro.com imperia31.ru
incep.imagine-ex.co
incest-ru.com incest-ru.com
inclk.com inet-traffic.com
infospot.pt
instabid.tech
insurple.com
int.search.mywebsearch.com int.search.mywebsearch.com
internet-apteka.ru interesnie-faktu.ru
iqoption-bin.com itronics.ca
iqoption.pro izismile.com
irunfar.com james13prix.info
istizanidineanopiate.blogspot.com javrip.net
istmira.ru jeremyeaton.co
itch.io jmat.cn
jav-way.site karpun-iris.ru
jaxcube.info keywesthideaways.co
je7.us keywords-monitoring-success.com
jerseychinabizwholesale.us kidd.reunionwatch.com
jetsli.de kinotorka.ru
jjbabskoe.ru kiprinform.com
justdating.online kiskinhouse.com
kasino-money.pw
kfon.eu
kinky-fetishes.com
kino-rating.ru
kiwe-analytics.com
kiwi237au.tk kiwi237au.tk
klejonka.info klikbonus.com
knogg.net klosetkitten.com
kongoultry.net knigonosha.net
kongruan.com kometars.xyz
konkursov.net komp-pomosch.ru
konica.kz
konpax.com konpax.com
kumuk.info lafriore.ru
la-fa.ru landscaping.center
lalalove.ru
lanadelreyfans.us
languagecode.com
laserpen.club laserpen.club
laudit.ru layola.biz.tc
lerporn.info leadwayau.com
lidoradio.com legalrc.biz
lifehacĸer.com lisque.batcave.net
likesdesign.com littlesunraiser.com
likrot.com live-sexchat.ru
linkbolic.com lob.com.ru
linkwithin.com lost-alpha.ru
liupis.com luckyshop.net.ua
liveu.infoteka.hu m0r0zk0-krava.ru
localflirtbuddies.com macotool.com
locimge.pw magnetpress.sk
lolnex.us mall.uk
lombia.co manimpotence.com
long-beach-air-conditioning.com
longgreen.info
lotto6888.com
lottospring.com
ltvperf.com
mac-shield.com
magiadinamibia.blogspot.com
manipulyator-peterburg.ru manipulyator-peterburg.ru
massage-info.nl map028.com
master-muznachas.ru maranbrinfo.com.br
meddesk.ru masterseek.com
merryhouse.co.uk masturbate.co.uk
metalonly.info mediaoffers.click
michaelkorsoutletstore.net medicines-choice.com
minyetki.ru medkritika.ru
misandesign.se mega-bony2017.pl
missis.top megahdporno.net
mmog-play.ru megaindex.ru
mmostrike.ru mesto-x.com
mobplayer.ru mex-annushka.ru
mobstarr.com microstatic.pl
moesen-ficken.com mmofreegames.online
moje-recenze.cz mobot.site
mojowhois.com moivestiy.biz
moncleronline.xyz morpicert.pw
more-letom.ru moscow.online-podarki.com
morlat.altervista.org mp3downloadhq.com
mossmesi.com mustwineblog.com
mrmoneymustache.com my-big-family.com
mrsdalloways.com myghillie.info
musicktab.com myliveblog.ru
my-aladin.com
mydeathspace.com
mymobilemoneypages.com mymobilemoneypages.com
mypets.by
nacap.ru nacap.ru
narkologiya-orel.ru najaden.no
national-today-winning-winner.club narutonaruto.ru
negral.pluto.ro nationalbreakdown.com
netallergy.ru newstudio.tv
next-dentists.tk nfljerseysforsalewholesaler.com
nextconseil.com nikitabuch.com
nextlnk12.com nikkiewart.ru
nicefloor.co.uk no-rx.info
ningessaybe.me nudepatch.net
no-fuel.org nullrefer.com
npoet.ru nuup.info
nrv.co.za nyfinance.ml
nzfilecloud.weebly.com nzfilecloud.weebly.com
o333o.com o-dachnik.ru
offf.info obesidadealgarve.com
oil-td.ru obiavo.kz
oklogistic.ru oddamzadarmo.eu
online-podarki.com olgacvetmet.com
online-x.ru onlinefilmz.net
onlineserialy.ru openmediasoft.com
onlywoman.org orion-v.com
onthemarch.co outclicks.net
ooomeru.ru paccohichetoti.ml
origin-my.ru paleohub.info
ostrovtaxi.ru panamaforbeginners.com
p-business.ru paramountmarble.co.uk
pagesense.com patol01.pw
painting-planet.com pay2me.pl
panchro.co.uk pcimforum.com
perm-profnastil.ru pflexads.com
picturesboss.com phobia.us
pillscheap24h.com photokitchendesign.com
pintattoos.com photosaga.info
piulatte.cz pictures-and-images.com
play.leadzupc.com pinup-casino1.ru
pokemongooo.ml pisanieprac.info
polcin.de pizdeishn.com
porn-w.org pizdopletka.club
pl.aasoldes.fr
plaff-go.ru
platesauto.com
platinumdeals.gr
poems.com.ua
popugauka.ru
porn555.com
pornoelita.info
pornogig.com pornogig.com
porodasobak.net pornoklad.net
postclass.com pornosee.info
preconnubial.usuby.site pornosemki.info
potoideas.us
pozdrawleniya.ru
pp-budpostach.com.ua
praisong.net
predmety.in.ua predmety.in.ua
princevc.com privatefx-in.ru
printie.com pro-okis.ru
privat-girl.net profitkode.com
prodess.ru prostitutki-novgoroda.org
produkto.net pskcijdc.bloger.index.hr
profolan.pl pssucai.info
proftests.net pts163.ru
progonrumarket.ru
prospekt-st.ru
proxyelite.biz
pufip.com
pussyfleet.com pussyfleet.com
putevka24.ru questionmarque.ch
qpypcx.com qwertty.net
quangcaons.com radiodigital.co
quelle.ru
rada.ru
rank-checker.online
rapidokbrain.com rapidokbrain.com
rating-bestcasino.com razorweb-a.akamaihd.net
rcb101.ru
realtytimes.com
rebelmouse.com
recipedays.ru recipedays.ru
reelheroes.net rednise.com
regionshop.biz reeyanaturopathy.com
renecaovilla.online relatodelpresente.com.ar
responsive-test.net remont-comp-pomosh.ru
rock-cafe.info remybutler.fr
rockma.se rep-am.com
roma-kukareku.livejournal.com rezeptiblud.ru
rusvideos.su rniaeba.ga
sa-rewards.co.za rusprostitute.com
sady-urala.ru rutor.vip
sampleletters.net rvzr-a.akamaihd.net
sandhillsonline.com sabizonline.com
sankt-peterburg.nodup.ru sadaholding.com
santechnik.jimdo.com safe-app.net
sarafangel.ru sammyweaver.com
savetubevideo.com scat.porn
scanner-irvin.top
scanner-julianna.top
scoopquest.com scoopquest.com
sdelai-prosto.ru search.1and1.com
searchimpression.com searchkut.com
searchlock.com securityallianceservices.com
seksotur.ru seminarygeorgia59.ga
semaltmedia.com semrush.com
semp.net senger.atspace.co.uk
seoboxes.com seokicks.de
seofied.com serialsway.ucoz.ru
serptehnika.ru
servethis.com servethis.com
service.adtech.us sevenstars7.com
sethrollins.net sex-foto.pw
sexkontakte-seite.com sex.hotblog.top
sexobzor.info
sexreliz.com
sexyebonyteen.com
shakhtar-doneck.ru
sharpchallenge.com sharpchallenge.com
shop-electron.ru shemale-sex.net
shopperifymac.com shop.xz618.com
shopvilleroyboch.com.ua shopcheermakeup.info
shopwme.ru shopfishing.com.ua
sientalyric.co shoppytoolmac.com
siha.de shtaketniki.kz
silverage.ru sisi-go.ru
siteaero.com site.ru
slomm.ru siteheart.net
smailik.org sitevaluation.org
smartshoppymac.com skutecznetabletkinaporostwlosow.pl
snip.tw smichovbike.cz
snomer1.ru snomer1.ru
soblaznu.net soaksoak.ru
softomix.net soc-econom-problems.ru
soc-proof.su
softonicads.com softonicads.com
sonnikforme.ru
sosdepotdebilan.com sosdepotdebilan.com
spammen.de spamnuker.com
sportbetfair.com sportbetfair.com
spywarebegone.com spywarespy.com
sstroy44.ru srgwebmail.nl
stackthatbucks.com stairliftstrue.com
staff.prairiesouth.ca stardevine.com
stairliftsarea.com startufa.ru
store-rx.com staynplay.net
strag-invest.ru steebook.com
sticken.co
stjamesschool.info
stroimajor.ru stroimajor.ru
strongholdsb.ru stroiminsk.com
subj.ukr-lit.com studworks.org
svarbit.com success-seo.com
sweepstakes.rewardit.com sugarkun.com
sugvant.ru
superiends.org
superlist.biz
swinon.site
syndicate.fun
syvertsen-da.no
tampabaywatch.org tampabaywatch.org
td-33.ru teenfuck.tv
telefonsex-ohne0900.net telefonsexi.com
terraclicks.com thepantonpractice.co.uk
thaismartloan.com theporndude.com
thefarmergame.com timdreby.com
thefotosgratis.eu titslove.yopoint.in
thegamerznetwork.com tizanidine4mgprice.blogspot.com
theprofitsmaker.net tizanidinedosageforsleep.blogspot.com
thesmartsearch.net tizanidinehydrochloride4mgstreetvalue.blogspot.com
thiegs.reco.ws top-l2.com
titan-cloud.life top1-seo-service.com
tizanidinehcl4mgtablet.blogspot.com
tizanidinemusclerelaxant.blogspot.com
tizanidinezanaflex.blogspot.com
tk-assortiment.ru
top-deal.com.pl
topanasex.com
torontoplumbinggroup.com torontoplumbinggroup.com
trafficjunky.net torrent-to-magnet.com
trainoffend.ml touchmods.fr
tramadolandtizanidine.blogspot.com track2.shop
trion.od.ua trafficjunky.com
triumf-realty.ru trafficstars.com
trubywriting.com traxdom.ru
tuberkulezanet.ru truemfilelj.gq
turizm.bz turizmus.us
turkeyreport.tk tv-spoty.info
twinderbella.com tvorozhnaja-zapekanka-recept.ru
uac.net.au twojebook.pl
uamtrk.com u-cheats.ru
uhod-za-sobakoj.ru u17795.netangels.ru
um-razum.ru u555u.info
unlimitdocs.net ublaze.ru
upstore.me ukrtvory.in.ua
us-america.ru unitexindia.com
usbggettwku.ga upproar.com
uzungil.com uroki.net
vacuumcleanerguru.com urzedowski.eu
valmetrundan.se userequip.com
vbikse.com v24s.net
veerotech.com v720hd.ru
viagra.pp.ua vacuumscleaner.com
video-camer.com vashsvet.com
videochat.mx veles.shop
vids18.site vgoloveboli.net
villakohlanta.nu video-production.com
vip-parfumeria.ru villacoloniale.com
vkgaleria.com vintontech.info
vladhistory.com vitoriacabos.com
voluumtracker1.com vizitki.net
vonradio.com voluumtrk.com
vroze.com voprosotvet24.ru
vsesubwaysurfers.com vrotike.ru
vzlomfb.com vseigry.fun
vzube.com vtcdns.com
wallpaperaccess.com
wallpapersdesk.info wallpapersdesk.info
walpaperlist.com webenlace.com.ar
warningzscaler.heraeus.com webpromotion.ae
watsonrealtycorp.com website-speed-up.site
webix.me website-stealer.nufaq.com
websites-reviews.com wemarketing.se
webstatsdomain.org wemedinc.com
webtherapy.ru whosonmyserver.com
wieseversa.no wineration.com
wma-x.com woman-tampon.ru
word-vorlagen.xyz
wordpresscore.com wordpresscore.com
www.jbetting.com wowas31.ucoz.ru
www.kabbalah-red-bracelets.com wrona.it
www.solartek.ru www.souvenirua.com
www.wohnkabinen-shop.de www.timer4web.com
wzgyyq.com
x-musics.com
x-true.info
xchangetrak.com
xcombear.ru
xedserver.com xedserver.com
xerox-douglas.cf xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn----dtbndd4ae7eub.top
xn--80aafb2a.xn--p1ai xn----itbeirbjbi7bc6bh2d.xn--p1ai
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai xn--d1abj0abs9d.in.ua
xn--d1acah0c.xn--p1ai xn--e1afanlbnfckd7c3d.xn--p1ai
xrus.org xn--hxazdsfy.blogspot.com
xsion.net yaaknaa.info
xxxdatinglocal.us yellowfootprints.com
xxxhdvideo.site yellowstonevisitortours.com
za-fun-offer.com yginekologa.com
zajm-pod-zalog-nedvizhimosti.ru yhit.press
zeroredirect10.com yopoint.in
zeroredirect11.com yougame.biz
zigarettenonlinekaufen.tumblr.com youtoner.it
zigarettenonlinekaufen2.drupalgardens.com yuarra.pluto.ro
yugo-star.ru
zaimite.ru
zakon-ob-obrazovanii.ru
zakonobosago.ru
zeroredirect7.com
zhorapankratov7.blogspot.com
znaturaloriginal.com
zona-aqua.ru
zooggames.com
zvuker.net

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 00it.com
11pikachu.ru 03p.info
123cha.com 101lesbian.xyz
4k-player.pl 101raccoon.ru
6hopping.com 10bet.com
9med.net 7minuteworkout.com
actionnooz.com 7yue.org
addbin.men abusora.com
adinterax.com accessoires-mode.in
admatic.com.tr adidas.frwebs.fr
adsloads.com adnotbad.com
adtech.fr aliexpresscashback.club
allnews.md alkoravto.ru
alot.com alta-realestate.com
amateurmatch.com amateurlivechat.org
ap.senai.br appleid-verification.com
appfastplay.com applyneedy.xyz
bannerspace.com approvedlocal.co.za
beachfix.co aramaicmedia.org
berrymall.ru asacopaco.tk
best-games.today asrvvv-a.akamaihd.net
bestofpicture.com atlasvkusov.ru
bfz.biz autowebmarket.com.ua
blagovest-med.ru aviva-limoux.com
blogig.org backuperwebcam.weebly.com
bmw-ark.ru best-businessman.ru
bonux.nextview.ru bestcalovebracelet.cn
brandimensions.com billiard-classic.com.ua
bronzeaid-a.akamaihd.net birzha-truda.eu
buckspar.gq blackwitchcraft.ru
bumble.cheapwebsitehoster.com blogrankers.com
buyhoverboard.com bloke.com
buynorxx.com bluejays-jerseys.us
buytizanidineonlinenoprescription.blogspot.com bongiornos.info
byme.se brakehawk.com
cam-kontakte.org breget74.ru
canacopegdl.com butstrap.space
candy-glam-hp.com bzero1jewelry.net
candytiner.com c1.onedmp.com
canzoni.ru candiceloves.us
carloans.com cannibalcheerleader.com
cartechnic.ru carapics.com
cashonads.com carsdined.org
celejihad.info carson.getenjoyment.net
centre-indigo.org.ua cheapmarmot.online
chatroulette.life chinaelitecheapjerseys.com
cheapbarbour.online cialgenisrx.com
cjmc.info cinemaflix.website
clean-start.net clean-start.net
click2pawn.com compliance-barak.xyz
clicksotrk.com coolgamechannel.com
com-supportcenter.website cwetochki.ru
compliance-brian.top
covid-schutzmasken.de
creditnation.ru
customboxes4less.com
cyse.tk cyse.tk
d-black.bz dating-time-now.com
darkbooks.org delitime.info
detsky-nabytek.info discovertreasure-a.akamaihd.net
dgfitness.co diy-handmade-ideas.com
dogclothing.store eachdayisagift.review
domainsphoto.com eropho.com
doreenblog.online erotag.com
download-walpaperhd.blogspot.com everypony.ru
drugspowerstore.com extractorandburner.com
dvervmoskvu.ru ezigarettenkaufen1.deviantart.com
ekobata.ru falllow.gq
electricwheelchairsarea.com familyholiday.ml
energydiet-info.ru fanoboi.com
erotische-geschichten-xxl.com filefilter.weebly.com
exonline.info filmbokep69.com
eyemagination.com findpik.com
fanrto.com flashlarevista.com
fast-wordpress-start.com fototravel.eu
fetlifeblog.com free-stock-illustration.com
filesvine.com frivgame250.com
footballfarrago.com fsakhalin.ru
foxydeal.com funponsel.com
free-share-buttons.com fxtips.ru
free-share-buttons.top gamerscorps.com
freenom.link gamevalue7.weebly.com
freewhatsappload.com gemgrab-a.akamaihd.net
getlamborghini.ga generic-pills-online.com
globalsurfari.com glall.ru
gourcy.altervista.org glass-msk.ru
graphics8.info gobongo.info
gratis-sexkontakte.com golaya.pw
gz2.bbsoldes.fr goodwriterssales.com
handicapbathtubarea.com googlsucks.com
hasfun.com greatzip.com
hauleddes.com greendream.com.ua
hawaiielectriclight.com greenzaim.ru
hd-film.pl grupografico-pilar.com.ar
headpharmacy.com guarrasdelporno.xxx
herokuapp.com hacktougroup.ru
high-speed1.net hanink.biz.ly
highstairs-a.akamaihd.net hdimagegallery.net
hmmm.cz helicalpile.us
hotloans.ru hotel-mkad.ru
hoverboard360.es ilovevitaly.ru
hscsscotland.com imagecoolpub.com
ilo134uloh.com interesnie-faktu.ru
inclk.com internetartfair.com
investingclub.ru jacago.com
istizanidineacontrolledsubstance.blogspot.com jerseywholesalechinabiz.com
itch.io jongose.ninja
iwantedmoney.com jpcycles.com
izhevsk.zrus.org jyrxd.com
japan-bearings.ru kaliningrad.zrus.org
jjbabskoe.ru kamagragelusa.net
jose.mulinohouse.co kiinomaniak.pl
journeydownthescale.info klumba55.ru
jurajskie.info koronirealestate.gr
kadashihotel.com kotaku.com
kanimage.com kredit-blog.ru
kazka.ru
keki.info
kiskinhouse.com
kmd-pto.ru
knigonosha.net
konkursov.net
koral.se
krasivoe-hd.net
kretpicf.pw
ks1234.com
kustanay.kz kustanay.kz
lafourmiliaire.com kuzinsp.ru
lancheck.net
landscaping.center landscaping.center
letmacworkfaster.site laserpen.club
lightinghomes.net louisvuittonoutletstore.net
lignofix.ua mabdoola.blogspot.com
livetsomudvekslingstudent.bloggersdelight.dk masserect.com
love-baby.cz mcar.in.ua
luxmagazine.cf mebeldekor.com.ua
m292.info mexicosleevegastrectomy.com
marwer.info micasainvest.com
masturbate.co.uk michaelkorssaleoutletonline.net
mebel-ekb.com mindbox.co.za
mebel-vstroika.ru mmstat.com
medi-fitt.hu mobstarr.com
meduza-consult.ru moesen-ficken.com
megakino.net monclerjacketsoutlet.win
metarip.ru money-for-placing-articles.com
middlerush-a.akamaihd.net moneyviking-a.akamaihd.net
misandesign.se moviemail-online.co.uk
mobsfun.net mrbitsandbytes.com
musirc.com msfsaar.de
musflashtv.com
music7s.me
muz-tracker.net muz-tracker.net
mygameplus.com myghillie.info
mywallpaper.top na-telefon.biz
naj-filmy24.pl naphukete.ru
national-today-winning-winner.club networkcheck.xyz
news-readers.ru
newstraveller.ru
nodding-passion.tk
nottyu.xyz nottyu.xyz
novatech.vn ochistka-stokov.ru
nuup.info offer.camp
online-podarki.com oivcvx.website
onlinewritingjobs17.blogspot.ru ok.ru
onlyporno.ru onclickpredictiv.com
optom-deshevo.ru onclkads.com
papasdelivery.ru onlineslotmaschine.com
pcboa.se onload.pw
pertlocogasilk.tk orion-code-access.net
petedrummond.com paccohichetoti.ml
pinwallpaper.xyz paceform.com
pirateday.ru paighambot.com
polcin.de pdns.cz
poptool.net pills24h.com
pornonik.com piratecams.com
prefersurvey.net pk-pomosch.ru
projectforte.ru playtap.us
puteshestvennik.com pobeiranie.pl
putevka24.ru popserve.adscpm.net
quickchange.cc popunder.net
raisedseo.com pornoklad.net
razorweb-a.akamaihd.net portside.xyz
posible.net
pro-poly.ru
pufip.com
rasteniya-vs-zombi.ru
rebrand.ly rebrand.ly
reklamuss.ru redbottomheels.xyz
responsinator.com
rewardpoll.com
riralmolamsaca.tk riralmolamsaca.tk
ryetaw.com rocis.site
sandhillsonline.com
saneitconsulting.com
sawin.beth.webd.pl
scanner-don.top
score-ads.men score-ads.men
sdrescher.net scrapy.org
searchwebknow-a.akamaihd.net seokicks.de
securityallianceservices.com seorankinglinks.xyz
seo-prof1.xyz seorussian.ru
sexblog.pw sex-foto.pw
shopcheermakeup.info sexsaoy.com
shopsellcardsdumps.com shikiso.info
sibtest.ru shisha-swag.de
small-game.com siteonomy.com
solnplast.ru skanninge.se
spasswelt.net skuteczna-dieta.co.pl
studentguide.ru sladkoevideo.com
svtrd.com smartadserver.com
syvertsen-da.no smartshoppymac.com
tam-gde-more.ru sobecjvuwa.com.ru
tamada69.com social-vestnik.ru
tanieaukcje.com.pl space4update.pw
teesdaleflyballclub.co.uk speeddream.xyz
thebluenoodle.com srecorder.com
thenews-today.info ssconstruction.co
todohr.com sterva.cc
torture.ml stickers-market.ru
trafficgenius.xyz superfish.com
tupper-shop.ru suralink.com
tvoystartup.ru tarad.com
uk-zheu20.ru tgtclick.com
ukrtvir.com.ua theheroes.ru
url2image.com tizanidinehcl4mgtablet.blogspot.com
userequip.com tizanidinesideeffectsweightloss.blogspot.com
vbikse.com tn811.us
vchulkah.net tomatis.gospartner.com
vedomstvo.net tonerbox.kz
ventelnos.com topbestgames.com
video-hollywood.ru topdownloads.ru
video-woman.com torontoplumbinggroup.com
vietimgy.pw torrentdownloadhub.com
voprosotvet24.ru torrentgamer.net
vroze.com totu.us
vysigy.su toyota.7zap.com
w7s.ru traffic2money.com
wallpaperstock.net truck-land.life
watchdogs-2.ru uchebavchehii.ru
waterpurifier.club ultimateclassicrock.com
watracker.net unitexindia.com
webcamdevochka.com unitygame3d.com
whereverdesperate.gq usswrite.com
wildworld.site vapomnoncri.tk
winner7777.net venta-prom.ru
xmlinde.com videochat.bz
videochat.life
videositename.com
vielporno.net
visa-pasport.ru
vmnmvzsmn.over-blog.com
vsesubwaysurfers.com
vuclip.com
website-speed-check.site
website-speed-up.top
websitevaluebot.com
wholinkstome.com
witherrom55.eklablog.fr
xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai xnxxandxvideos.com
xn----ctbigni3aj4h.xn--p1ai xxxhdvideo.site
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai yes-com.com
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai yourserverisdown.com
xn--80ahdheogk5l.xn--p1ai zakazvzloma.com
xportvusbdriver8i.snack.ws
your-bearings.com
zakon-ob-obrazovanii.ru zakon-ob-obrazovanii.ru
zazagames.org zapatosenventa.info
zeroredirect1.com zero1.it
zeroredirect9.com znakomstva-piter78.ru
zhongwenlink.com zvezdagedon.ru
znakomstvaonlain.ru
zootoplist.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.85 0; 10.1.1.229 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2658 ### Version: V4.2021.10.2659
### Updated: Mon Oct 18 10:12:48 UTC 2021 ### Updated: Mon Oct 18 22:03:05 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2021.10.2658 ### Version: V4.2021.10.2659
### Updated: Mon Oct 18 10:12:48 UTC 2021 ### Updated: Mon Oct 18 22:03:05 UTC 2021
### Bad Bot Count: 623 ### Bad Bot Count: 623
################################################### ###################################################
### Version Information ## ### Version Information ##