vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3448 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-03 10:09:50 +00:00
parent b841b8d16a
commit 221ef68126
48 changed files with 96437 additions and 96437 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3447 #### Version: V4.2022.11.3448
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3447 #### Version: V4.2022.11.3448
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3447 #### Version: V4.2022.11.3448
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11916
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3447 #### Version: V4.2022.11.3448
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11920
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11920
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11920
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11920
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3447 3448

11920
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11920
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.242.88.132 0; 20.253.230.223 0;

11920
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

11920
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.242.88.132 0; 20.253.230.223 0;

11920
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.242.88.132 0; 20.253.230.223 0;

11920
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 1; 10.1.0.227 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 Digincore
Ebingbong Image Sucker
LeechGet LexiBot
NearSite PageThing.com
Pi-Monster RankingBot
ProWebWalker Scanbot
Pu_iN SiteSnagger
WBSearchBot WiseGuys Robot
lwp-trivial Xaldon_WebSpider
netEstate NE Crawler spyfu

306
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
404enemy
ADmantX
ALittle Client ALittle Client
ASPSeek
Aboundex Aboundex
AiHitBot
Alexibot
Alligator
AlphaBot AlphaBot
Anarchie Anarchie
Apexoo Anarchy
Ankit
Anthill
Aspiegel
Asterias
Atomseobot Atomseobot
Attach
AwarioRssBot AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDCbot BBBike
BDFetch BDFetch
BLEXBot BackStreet
BackWeb BackWeb
BacklinkCrawler
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bigfoot Bigfoot
Bitacle Blow
Blackboard
BlowFish BlowFish
BotALot Bolt
BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CODE87 CSHttp
Calculon
Cegbfeieh
CheTeam CheTeam
CheeseBot CheeseBot
Cliqzbot ChinaClaw
Cocolyzebot Chlooe
Copier
CopyRightCheck CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot CrunchBot
DSearch CyotekWebCopy
DBLBot
Demon
Deusu Deusu
Devil
Digincore
DigitalPebble
Disco Disco
DittoSpyder Dispatch
DnBCrawler-Analytics DomainAppender
DomainSigmaCrawler DomainSigmaCrawler
Domains Project DomainStatsBot
Dotbot Dotbot
Download Wonder Download Wonder
Drip Drip
ECCP/1.0 Ebingbong
EMail Wolf EroCrawler
EasyDL Evil
Express WebPictures Exabot
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
FHscan
FemtosearchBot FemtosearchBot
Foobot Firefox/7.0
Freeuploader FlashGet
FrontPage FrontPage
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetRight GetRight
Grabber Getintent
Grafula Go-Ahead-Got-It
GrapeshotCrawler GrapeshotCrawler
GridBot
HMView HMView
HTTrack
Haansoft Haansoft
Heritrix Heritrix
Hloader HonoluluBot
Humanlinks IDBTE4M
HybridBot
IRLbot
Iblog
IlseBot
Image Fetch Image Fetch
Intelliseek IndeedBot
Indy Library
InterGET InterGET
Internet Ninja IstellaBot
Iskanie
JOC Web Spider
JamesBOT
Joomla Joomla
Jorgee Keybot Translation-Search-Machine
JustView
Kenjin Spider
Kinza Kinza
Kozmosbot
LeechFTP
LeechGet LeechGet
LexiBot LexiBot
Lftp
LibWeb LibWeb
LieBaoFast LinkWalker
LinkScan Linkbot
LinkpadBot LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Lipperhey
MIDown tool Lmspider
Ltx71
MIIxpc MIIxpc
MJ12bot Mail.RU_Bot
Magnet Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor MarkMonitor
Mass Downloader MarkWatch
Meanpathbot Masscan
Mediatoolkitbot Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
MicroMessenger MicroMessenger
Microsoft URL Control Microsoft Data Access
Morfeus Fucking Scanner Minefield
Mister PiX
Mojeek
MolokaiBot
Musobot
NICErsPRO
NPbot NPbot
Nameprotect Name Intelligence
Navroad NearSite
NetAnts
NetLyzer NetLyzer
Netcraft Netvibes
NextGenSearchBot Nibbler
Niki-bot Niki-bot
Nikto NimbleCrawler
Nuclei Not
Offline Navigator Nutch
OnCrawl Octopus
OpenVAS
Openfind Openfind
Openvas OutclicksBot
OrangeBot POE-Component-Client-HTTP
OutfoxBot PageAnalyzer
PECL::HTTP
PageScorer PageScorer
PeoplePal PageThing.com
Pi-Monster Pandalytics
Picsearch Petalbot
Psbot Picscout
Quick-Crawler ProPowerBot
Pu_iN
Pump
PxBroker
RSSingBot RSSingBot
RankActiveLinkBot
RankFlex RankFlex
RankingBot RankingBot2
RankurBot RankurBot
Reaper ReGet
RepoMonkey RealDownload
RebelMouse
RocketCrawler
Rogerbot Rogerbot
SEOkicks-Robot SBIder
SEOkicks
SEOprofiler
SEOstats
SISTRIX SISTRIX
SMTBot
SalesIntelligent SalesIntelligent
ScoutJet ScanAlert
Searchestate SemanticJuice
SearchmetricsBot SemrushBot
Seekport SeoSiteCheckup
Shodan
Siphon Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker
Siteimprove
Sitevigil Sitevigil
SlySearch SlySearch
SmartDownload SmartDownload
Snapbot Sogou web spider
SocialRankIOBot
Sottopop Sottopop
SpaceBison
Spammen
SpankBot SpankBot
Spanner Sqworm
Spbot
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper Stripper
Sucuri Swiftbot
SuperBot Szukacz
SuperHTTP
T8Abot T8Abot
Telesphoreo TeleportPro
Telesphorep Telesoft
The Intraformant The Intraformant
TheNomad
Thumbor
Titan
Trendiction Trendiction
Trendictionbot Trendictionbot
Turingos
TwengaBot TwengaBot
Typhoeus Twice
Upflow URLy Warning
VCI UnisterBot
V-BOT
VB Project
Vacuum Vacuum
Virusdie WASALive-Bot
Voltron
WBSearchBot WBSearchBot
WWW-Mechanize WEBDAV
WallpapersHD WISENutbot
WeSEE WWWOFFLE
Wallpapers
Web Auto Web Auto
Web Enhancer Web Collage
Web Fuck
Web Pix
Web Sucker
WebAuto WebAuto
WebCollage WebCollage
WebEnhancer WebCopier
WebFuck WebFetch
WebImageCollector
WebPix
WebReaper WebReaper
WebZIP WebStripper
WebSucker
WebWhacker
Webshag
WebsiteExtractor WebsiteExtractor
Webster Webster
Who.is Bot
Widow Widow
WinHTTrack WinHTTrack
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zauba Zade
Zermelo
Zitebot
ZmEu ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZumBot
adscanner adscanner
arquivo.pt arquivo-web-crawler
backlink-check
clark-crawler clark-crawler
cognitiveseo coccocbot
com.plumanalytics crawl.sogou.com
crawler4j
eCatch eCatch
gopher
heritrix heritrix
internetVista monitor
ips-agent ips-agent
isitwp.com linkdexbot
magpie-crawler
meanpathbot meanpathbot
oBot
pcBrowser
probe-image-size probe-image-size
ripz satoristudio.net
scalaj-http seobility
scan.lol serpstatbot
seoscanners siteripz
sysscan sogouspider
trendiction.com trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x09Mozilla x09Mozilla
x22Mozilla
zgrab

318
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
80legs 360Spider
ADmantX 404enemy
AIBOT AIBOT
ALittle Client ASPSeek
Aboundexbot Aboundex
AfD-Verbotsverfahren Acunetix
AllSubmitter AhrefsBot
Ankit Aipbot
Anthill Alligator
Apexoo Anarchy
Aspiegel Aspiegel
Atomseobot
BDFetch BDFetch
BackDoorBot BLEXBot
BackWeb BackStreet
Backlink-Ceck BacklinkCrawler
Bandit
Barkrowler Barkrowler
Battleztar Bazinga BatchFTP
Bigfoot Bigfoot
Bitacle Bitacle
Black Hole
Blow Blow
BlowFish BlowFish
Bolt BuiltBotTough
BotALot
Brandwatch
Bullseye Bullseye
BunnySlippers CCBot
BuzzSumo
CODE87 CODE87
Calculon CSHttp
CazoodleBot CazoodleBot
CensysInspect CensysInspect
CheTeam CheTeam
CherryPicker CheeseBot
Citoid
Claritybot
Cliqzbot Cliqzbot
CopyRightCheck Cloud mapping
Collector
Crawling at Home Project
CrazyWebCrawler
Crescent Crescent
CrunchBot Custo
Curious
CyotekWebCopy
DBLBot
DIIbot DIIbot
DSearch DSearch
DTS Agent DatabaseDriverMysqli
Demon
Deusu Deusu
Dirbuster Devil
Discobot Digincore
DigitalPebble
Disco
Discoverybot Discoverybot
DomCopBot
DomainCrawler DomainCrawler
DomainSigmaCrawler Dotbot
Download Wonder Download Wonder
Drip Drip
ECCP/1.0 ECCP/1.0
EMail Siphon
EasyDL EasyDL
EroCrawler Ebingbong
ExtLinksBot Evil
ExtractorPro Exabot
Ezooms Extractor
FemtosearchBot Extreme Picture Finder
FlashGet FlashGet
Flunky Freeuploader
FyberSpider Gigabot
Fyrebot
GalaxyBot
Getintent
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
Grabber Grabber
Grafula HMView
GrapeFX HTMLparser
GridBot HTTP::Lite
HTTrack
Haansoft Haansoft
HaosouSpider
Heritrix
Hloader Hloader
HonoluluBot
Humanlinks Humanlinks
IDBot HybridBot
Id-search IDBTE4M
IlseBot Iblog
Image Sucker
IndeedBot
InfoNaviRobot InfoNaviRobot
InternetSeer Internet Ninja
JOC Web Spider JOC Web Spider
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot
JetCar JetCar
Joomla
Jyxobot Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density LNSpiderguy
Kozmosbot Larbin
LWP::Simple LeechGet
Lanshanbot LexiBot
Leap Libwhisker
LeechFTP
LieBaoFast LieBaoFast
Likse LinkScan
LinkextractorPro LinkWalker
Lipperhey Spider Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
Ltx71 Ltx71
MJ12bot MIIxpc
MQQBrowser
MSFrontPage MSFrontPage
MTRobot MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO Majestic-SEO
MarkMonitor
MarkWatch MarkWatch
Meanpathbot Masscan
Mediatoolkitbot MauiBot
MegaIndex.ru MeanPath Bot
MicroMessenger Metauri
Microsoft URL Control Microsoft Data Access
Mojeek Mister PiX
Mojolicious
MolokaiBot MolokaiBot
Mozlila Mr.4x3
Msrabot Msrabot
Musobot
NICErsPRO
NearSite NearSite
NetAnts Needle
NetLyzer Nessus
Netvibes NetSpider
NetZIP
Netcraft
Nettrack
NextGenSearchBot NextGenSearchBot
Nikto Niki-bot
Nmap Nimbostratus
Nuclei Ninja
Nutch Nutch
Offline Navigator Offline Explorer
OpenLinkProfiler OpenLinkProfiler
OrangeSpider PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer Pandalytics
Panscient
Pavuk Pavuk
Pi-Monster Petalbot
Picscout
Piepmatz Piepmatz
PleaseCrawl Pockey
ProPowerBot
ProWebWalker ProWebWalker
Psbot Pu_iN
Pump
PxBroker PxBroker
PyCurl QueryN Metasearch
RSSingBot RSSingBot
RankActiveLinkBot ReGet
RankFlex
RankingBot
Re-re
RealDownload RealDownload
Ripper Reaper
RocketCrawler RedesScrapy
Rogerbot RepoMonkey
SEOkicks-Robot SBIder
SEOlyticsCrawler SEOlyticsCrawler
SEOstats
SISTRIX SISTRIX
SMTBot ScreenerBot
SalesIntelligent ScrepyBot
Scanbot Searchestate
ScoutJet Semrush
Screaming
Seekport
SemrushBot
SentiBot SentiBot
SeobilityBot
Seomoz Seomoz
Shodan SiteLockSpider
Site Sucker Sitebeam
SiteCheckerBotCrawler SlySearch
SiteSucker
SmartDownload SmartDownload
Snake Snake
Snapbot Snapbot
SpaceBison Snoopy
SpankBot Sociscraper
SputnikBot Sogou web spider
Sosospider
Spammen
Spanner
Spbot
Sqlmap Sqlmap
Sqworm
SuperBot
SuperHTTP
Suzuran Suzuran
Swiftbot The Intraformant
Teleport Thumbor
Telesoft
Telesphoreo
Titan Titan
Toweyabot
Tracemyfile Tracemyfile
Trendiction Trendictionbot
Turingos Turnitin
TurnitinBot TurnitinBot
TwengaBot UnisterBot
Upflow VB Project
V-BOT Vacuum
VeriCiteCrawler VeriCiteCrawler
Virusdie Voil
VoidEYE Voltron
WBSearchBot WBSearchBot
WISENutbot
WPScan
WWW-Mechanize WWW-Mechanize
WeSEE Wallpapers
Web Fuck Web Sucker
Web Pix WebEnhancer
Web Sauger
WebAuto
WebCollage
WebCopier
WebFetch WebFetch
WebImageCollector WebFuck
WebPix
WebSauger WebSauger
WebStripper WebStripper
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
WebsiteExtractor Webster
Whack WinHTTrack
Whacker Wprecon
Whatweb Xaldon WebSpider
Wonderbot Xaldon_WebSpider
Wotbox Xenu
YoudaoBot YoudaoBot
Zade
Zauba Zauba
ZmEu Zeus
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
adscanner ZyBorg
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
clark-crawler check1.exe
coccocbot com.plumanalytics
cognitiveseo
crawler.feedback crawler.feedback
instabid crawler4j
facebookscraper
isitwp.com
iubenda-radar iubenda-radar
linkdexbot linkdexbot
lwp-request
lwp-trivial lwp-trivial
meanpathbot magpie-crawler
netEstate NE Crawler mediawords
pcBrowser muhstik-scan
oBot
ripz ripz
s1z.ru s1z.ru
satoristudio.net
scan.lol scan.lol
seocompany.store siteripz
serpstatbot sp_auditbot
sitechecker.pro spyfu
sysscan tAkeOut
trendiction.de trendiction.com
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com
webmeup-crawler webmeup-crawler
x09Mozilla webpros.com
xpymep1.exe webprosbot
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
hostsshop.ru ads.gold
husky-shop.cz bjorkbacken.nu
hydropump.su contentsexpress.com
joy-penguin.com distver.ru
louboutinbooties.xyz earn-from-articles.com
okeinfo.online mesto-x.com
online-podarki.com muz-shoes.ru
space-worry.ml tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidine4mg.blogspot.com tizanidinehcl4mgtab.blogspot.com
venta-prom.ru znakom.sibtest.ru

948
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1kdailyprofit.me 0n-line.tv
4ur.click 101lesbian.xyz
57883.net 1millionusd.xyz
6hopping.com 21h2o.com
7xc4n.com 24-ak.ru
aa08daf7e13b6345e09e92f771507fa5f4.com 28n2gl3wfyb0.ru
aa625d84f1587749c1ab011d6f269f7d64.com 40cg.com
abcdeg.xyz 4webmasters.com
abiente.ru 8jn.dating-app.ru
abusora.com 8xv8.com
acc.eu.org aadroid.net
adconscious.com abclauncher.com
addblueoff.com.ua activecampaign.dreamhosters.com
adktrailmap.com addtoadd.men
adman.gr adhome.biz
adult3dgames.com adnotbad.com
adultfriendfinder.com adrenalin-stk.ru
advertisingtag.net adsfresh.men
adzerg.com adultactioncam.com
agroeconom.kz afslankpillen2017nl.eu
ald2014.org ahrntal.verymes.xyz
alert-hgd.xyz alfa-medosmotr.ru
alert.scansafe.net algarveglobal.com
alfa-img.com alldezservice.kz
alfa9.com
alienwheel.es
allsilver925.co.il allsilver925.co.il
alphahoverboards.com alot.com
alphavisions.net amigobulls.com
alvtank.se amoi.tn
animaltoplist.com ample-awards-today.us
animebox.com.ua angel1777.kz
apccargo.com ap.senai.br
apidiamondatanet-a.akamaihd.net apelsinnik.website
app-ready.xyz apibetweenlinesn-a.akamaihd.net
apper.de apiqualitinknet-a.akamaihd.net
approved.su appfixing.space
aviav.eu applicationg29.com
aviav.org aquarium-pro.ru
avkzarabotok.info arvut.org
avtocredit-legko.ru as5000.com
ayanaspa.com asiengirls.net
azartmix.com asrvrep-a.akamaihd.net
azartmsl.com atleticpharm.org
azbuka-mo.ru auto-moto-elektronika.cz
b2b-lounge.com automobile-spec.com
becuo.com autotop.com.ua
belsetirehafi.tk aversis.net
best-coupon-offer.com avto-oligarh.ru
best-way.men avtoarenda.by
bestcurs.org babosas.com
bestmouthwash.club baixar-musicas-gratis.com
betonka.pro baltgem.com
bget.ru battlecarnival.su
bimatoprost-careprost.com.ua bbtec.net
bizlist.com.de bdsmgalls.net
biznesluxe.ru best-seo-solution.com
blagovest-med.ru bg6s0.com
bharatdefencekavach.com
bigames.online
bimatoprost-careprost.com
bio.trade-jp.net
bioscorp.ru
bkns.vn
blog.koreadaily.com
blogig.org
blogs.rediff.com blogs.rediff.com
blue-square.biz boltalko.xyz
bluerobot.info bongiornos.info
boeuklad.com bonkers.name
boo-arts.com bonvillan.com
brainxs.us bonzbuddy.com
brakehawk.com boole.onlinewebshop.net
buketeg.xyz breget74.ru
butstrap.space bryansk.zrus.org
c-english.ru c1.onedmp.com
camel-beach.com call-of-duty.info
carfax.com.ua calvet.altervista.org
carina-sy.de candiceloves.us
carson.getenjoyment.net canrioloadm.gq
carstrends2015.com canrole.com
cartierlovebracelet.xyz carsplate.com
casablancamanor.co.za cartierbraceletsreplica.pw
catalogs-parts.com cartierlove2u.com
ccjp.eu cartujano-pre.de
certifywebsite.win casinorewards.info
cfsrating.sonicwall.com caulderwoodkennels.com
cheapbarbour.online cete.ru
cheapbelstaff.online cfjump.com
cheapjerseysbizwholesale.us ciproandtizanidine.blogspot.com
cheapmoncler.xyz cjs.com.ru
check-host.net classicakuhni.ru
cherubinimobili.it clippingphotoindia.com
christianlouboutinoutlet.win co.lumb.co
ci.ua cocolyze.com
cineacademy.ru codysbbq.com
claytransformations.info comissionka.net
click2pawn.com companies-catalog.com
clickzzs.nl compliance-jess.top
clksite.com
clmforexeu.com
club-samodelkin.ru
coinsspb.com
collegerentals.com
compliance-jessica.top
compliance-julia.top
compliance-julianna.top compliance-julianna.top
compucelunlock.net connectionstrenth.com
coolyarddecorations.com cookie-law-enforcement-ee.xyz
copblock.org covadhosting.biz
cowlmash.com craftburg.ru
creditnation.ru cubook.supernew.org
d-black.bz cyprusbuyproperties.com
daretodonate.co czat.wp.pl
datadepths.com daisye.top
dealighted.com danceuniverse.ru
decoratinghomes.ga dandiyabeats.in
delitime.info danschawbel.com
dichvuvesinhhanoi.com data.vtc.pw
dieta-personalna.pl data1.scopich.com
dinosaurus.site db.speedup.gdn
div.as deda-moroza-zakaz.ru
dividendo.ru delayreferat.ru
dnepr-avtospar.com.ua deplim.com
doctormakarova.ru detsky-nabytek.info
documentbase.net dev-seo.blog
dojki365.online dev.citetick.com
domain-tracker.com diesel-parts28.ru
domznaniy.ru disruptingdinnerparties.com
dostavka-v-krym.com distver.ru
download-of-the-warez.blogspot.com doktoronline.no
downloadeer.net domik-derevne.ru
drpornogratisx.xxx dominterior.org
dvd-famille.com downtuptv.gq
dverimegapolis.ru driving.kiev.ua
dyt.net dstroy.su
e-biznes.info easyukraine.com
e90post.com ecommerce-seo.org
earncash.com.ua ekspertmed.com
earthmagic.info ekto.ee
ed-shop01.ru elite-sex-finders.com
eksprognoz.ru eloconcream.blogspot.com
electronicadirect.com eluxer.net
elektrischezigaretten1.blogse.nl embedle.com
elexies.info emergencyneeds.org
elmacho.xyz englishdictionaryfree.com
emediate.eu eropho.net
emerson-rus.ru eropornosex.ru
enternet.ee esfchat.tk
enthuse.computernetworksonline.com este-line.com.ua
erot.co estelight.ru
etm-consult.de
eugenevaultstorage.com eugenevaultstorage.com
exci.ru euromasterclass.ru
ezigarettenshop2.postbit.com event-tracking.com
factorynightclub.com extremepornos.net
fapgon.com facecup.top
fast-torrent.ru favornews.com
fetishinside.com fearcrow.com
fickenbumsen.net fefo.gdn
filesdatabase.net femdom.twiclub.in
filesvine.com fickenprivat.info
firstdrugmall.ru fickkontakte.org
flashlarevista.com fickluder69.com
fok.nl filkhbr.com
food.dtu.dk findsexguide.com
foxweber.com fireads.men
freemags.cc firma-legion.ru
freeseedsonline.com flashahead.info
freshberry.com.ua flex4launch.ru
ftns.ru fodelsedagspresenter.nu
fuel-gas.com footbalive.org
gameplexcity.com forex-indextop20.ru
gamingspark.com forex21.ru
gate5.co.za forums.toucharcade.com
frameimage.org
free-fb-traffic.com
freecamdollars.com
freelifetimefuckbook.com
fullfileaccess.com
fxund.us
gael-s.ru
galaxys6manual.info
gambarkataku.co
gamedayhouse.com
gdzkurokam.ru gdzkurokam.ru
gearcraft.us ge0ip.org
geile-lelly.eu geile-lelly.eu
gemara.com getlamborghini.ga
gembird.com girlsfuckdick.com
germes-trans.com glavprofit.ru
germetiki.com.ua globetrotting-culture.ru
get-seo-domain.com good-mummy.ru
getmyads24.com goodhousekeeping.com
ghernnqr.skyrock.com gotomontenegro.net
glass-msk.ru graphicwe.org
golmau.host.sk greatfind-a.akamaihd.net
gosmeb.ru grtyi.com
gowreckdiving.com gsou.cf
gratuitxblcodes.com guigyverpo.cf
greamimgo.pw hamptonoaks.ca
greenidesign.co handsandlegs.ru
growmyfunds.ca hanwei.us
growshop.es hard-porn.mobi
gungamesz.com hatedriveapart.com
guod.me hawaiielectriclight.com
hamacapty.com health-medical-portal.info
hawaiisurf.com healthcarestore.info
hdimagegallery.net
hdwalls.xyz
hebr.myddns-flir.com hebr.myddns-flir.com
help.tpu.ru helicalpile.us
helpmymacfaster.trade hermesbirkinhandbagoutlets.com
hexpilot.com hifidesign.ru
hit-kino.ru highland-homes.com
hitsbox.info himgaws.pw
hkdiiohi.skyrock.com
hmmm.cz hmmm.cz
homemade.gq hmywwogw.bloger.index.hr
homik.pw home.myplaycity.com
honyaku.yahoofs.jp
horoshieokna.com horoshieokna.com
husky-shop.cz igadgetsworld.com
iblogpress.xyz ikearugs.xyz
ihtec2019.org ilbe.club
img.wallpaperstock.net imagez.co
indo-export.ru imperia31.ru
infektsii.com in-tandem.co
informatiecentro.be increasewwwtraffic.info
integritylandscapeservices.com infoupdate.org
invivo.hu insomniagamingfestival.com
islandminingsupply.wordpress.com intellekt21.ru
ispaniya-costa-blanca.ru investpamm.ru
itsdp3.com investyb.com
ipchicken.com
ivanstroi.ru ivanstroi.ru
iwantedmoney.com iwantedmoney.com
javlibrary.cc izismile.com
jaxcube.info jav-idol.com
jerseychinabizwholesale.com javidol.site
jrpmakati.com jbl-charge.info
justdating.online jimmychoosale.online
jyrxd.com journeydownthescale.info
kalb.ru kadashihotel.com
kanimage.com kareliatobacco.ru
kashubadesign.ru kfon.eu
kerch.site khadastoafarde.tk
keywordblocks.com kletkimehan.ru
klejonka.info knigonosha.net
kliksaya.com koleso24.com.ua
komputernaya-pomosh-moscow.ru konpax.com
kongruan.com koptims.tiu.ru
konoplisemena.com ks1234.com
koronirealestate.gr lafourmiliaire.com
kostenlos-sexvideos.com laulini.soclog.se
kotaku.com law-check-two.xyz
kozhniebolezni.com laxob.com
krafte.ru leadwayau.com
krasivoe-hd.net lecbter-relationships.ga
ktotut.net lechtaczka.net
kung-fu-ru.com lerporn.info
kurbappeal.info letolove.ru
laapp.com li-er.ru
labvis.host.sk lida-ru.com
lafriore.ru lineshops.biz
lampokrat.ws linkbux.ru
laudit.ru live-cam6.info
lawyers.cafe liveinternet.ro
lazymanyoga.com livejasmin.com
likrot.com lmrauction.com
linkarena.com lolnex.us
linkredirect.biz lowephotos.info
livefixer.com mafa-free.com
localmatchbook.com magnetic-bracelets.ru
lockerz.com manipulyator-peterburg.ru
locustdesign.co mapquestz.us
losangeles-ads.com maximpartnerspr.com
louboutinbooties.xyz medicine-4u.org
lrac.info meduza-consult.ru
lumb.co mere.host.sk
m4ever.net mesbuta.info
m5home.ru metafilter.com
mafcards.ru mhtr.be
manifestation.betteroffers.review mnogabukaff.net
maranbrinfo.com.br mole.pluto.ro
mecash.ru mompussy.net
megaapteka.ru monarhs.info
michaelkorsoutlet.store monclercoats.xyz
minet.club moneyteam24.com
mir-limuzinov.ru moskva.nodup.ru
mirobuvi.com.ua most.gov.iq
mobot.site mp3ritm.top
moi-glazki.ru mulberryoutletonlineeu.com
mokrayakiska.com music.utrolive.ru
monclerboots.xyz mxgetcode.com
moncleronline.xyz myanyone.net
moncleroutletonline.win myliveblog.ru
moscow-clining.ru mywallpaper.top
mossmesi.com najaden.no
musezone.su narkologiya-voronezh.ru
mydoctorok.ru netanalytics.xyz
myhitmp3.club nextconseil.com
myindospace.com nfljerseys.online
myiptest.com nfljerseyscheapbiz.us
myonigroup.com nhl17coinsforps3.gratisblog.biz
nacap.ru nofreezingmac.work
nakozhe.com novgorod.xrus.org
narutonaruto.ru nowtorrents.com
netcheckcdn.xyz obsessionphrases.com
nfljerseysforsalewholesaler.com odoratus.net
nfvsz.com offergroup.info
nikhilbahl.com oivcvx.website
no-fuel.org online-templatestore.com
nordvpn.com openfrost.net
novodigs.com ourville.info
o-o-6-o-o.ru outclicks.net
oakridgemo.com ownshop.cf
obiavo.com oz-offers.com
ochistka-stokov.ru page2rss.com
oda.as paidonlinesites.com
okonich.com.ua
onclkads.com
optikremont.ru
ordernorxx.com
outpersonals.com
oxotl.com
ozas.net
pagesense.com
paleohub.info paleohub.info
panicatack.com partner-high.men
parajumpersjakkesalgnorge.info
partner-pop.men
partner-stop.men partner-stop.men
partners-ship.pro pawli.eu
pavlodar.xkaz.org paydayonlinecom.com
pendelprognos.se pb-dv.ru
pc-virus-d0l92j2.pw
pdfprof.com
pdns.cz
pelfind.me
penisvergrotendepillennl.ovh
perfectpracticeweb.com
perm-profnastil.ru perm-profnastil.ru
perm.xrus.org perm.xrus.org
pics-group.com picsforkeywordsuggestion.com
piluli.info pihl.se
pillscheap24h.com
pinkduck.ga pinkduck.ga
pinstake.com platinumdeals.gr
pistonclasico.com pojdelo.weebly.com
pixelrz.com popads.net
plastgranar.nu
pomoc-drogowa.cba.pl
popcash.net popcash.net
popup-jdh.xyz poptool.net
porn-w.org pornoelita.info
porno-home365.com pornonik.com
pornofeuer.com pornophoto.xyz
pornofiljmi.com pornoplen.com
pornogad.com potolokelekor.ru
pornosexrolik.com pp-budpostach.com.ua
portal-eu.ru preconnubial.usuby.site
portnoff.od.ua privat-girl.net
pourvous.info producm.ru
preventheadacheguide.info progonrumarket.ru
pricheski-video.com promgirldresses.xyz
princeadvantagesales.com prosperent.com
pro-tec.kz pussyspace.net
professionalwritingservices15.blogspot.ru pxhdwsm.com
profitkode.com pyramidlitho.webs.com
promover.org q-moto.ru
prostitutki-tolyatti.org qitt.ru
proxyradar.com randki-sex.com
psvita.ru rankia.com
ptr.ruvds.com raschtextil.com.ua
pukaporn.com rep-am.com
pulse33.ru responsive-test.net
quit-smoking.ga rossmark.ru
razleton.com russia-tao.ru
rczhan.com saletool.ru
real-time-analytics.com salutmontreal.com
redirectme.net sampleletters.net
renecaovilla.online scanner-george.top
rfd-split.hr scanner-jess.top
rightenergysolutions.com.au scanner-john.top
rockingclicks.com scanner-mark.top
royalvegascasino.com scanner-marwin.top
rp9.ru scat.porn
ruf777.com scrnet.biz.ua
rusprostitute.com sdi-pme.com
russia-today-video.ru search.pch.com
ryetaw.com
s.lollypopgaming.com
sabaapress.com
salut-camp.ru
sarahmilne.top
saratov.xrus.org
sax-sex.com
sbf441.com
sbornik-zakonov.ru
scanner-josh.top
se.bnt-team.com
search.alot.com
search.xtconnect.com
searchaddis.com
searchinquire.com
seasaltwithfood.com
secret.xn--oogle-wmc.com secret.xn--oogle-wmc.com
seeingmeerkat.com seinterface.com
semrush.com seo-prof1.xyz
seocdvig.ru
seolab.top seolab.top
seozoom.it
sevenstars7.com sevenstars7.com
sex-dating.co sex-sex-sex5.com
sexreliz.com sexobzor.info
shakhtar-doneck.ru sherlock.se
sharpchallenge.com shisha-swag.de
shillyourcoins.com shop-electron.ru
ship-marvel.co.ua shop.acim.org
shlyahten.ru shopperifymac.com
siha.de sicfor.bcu.cc
simon3.ru sims-sims.ru
site-speed-checker.site sindragosa.comxa.com
slonechka.ru site3.free-share-buttons.com
slowmac.tech sizeplus.work
sneakyboy.com smartshoppymac.com
snegozaderzhatel.ru smokewithrabbits.com
sobecjvuwa.com.ru snomer1.ru
socialbookmarksubmission.org social-fun.ru
sofit-dmd.ru socialmonkee.com
solinf.co soft-program.com
sovetogorod.ru soheavyblog.com
soviet-portal.do.am spb-plitka.ru
spasswelt.xyz sports-supplements.us
specialfinanceoffers.com spylog.com
spin2016.cf stats-collector.org
steelmaster.lv statustroll.com
strigkaomsk.ru sticken.co
stroiminsk.com stroiminsk.com
strongholdsb.ru
stroydetali.ru stroydetali.ru
studentguide.ru studentguide.ru
students-cheapskate.ml subj.ukr-lit.com
studiofaca.com sucsesofinspiration.com
studiofmp.com superstats.com
sugvant.ru tanieaukcje.com.pl
support.nopeas.sk tds-advert002.info
swiped.su techart24.com
tabletkinaodchudzanie.com.pl thedownloadfreeonlinegames.blogspot.com
tako3.com thegameriders.com
tech4master.com thegamerznetwork.com
telsis.com thenetinfo.com
the-torrent-tracker.blogspot.com theprofitsmaker.net
thebluffs.com thetardistimes.ovh
thexart.club thfox.com
timeallnews.ru time-japan.ru
timhost.ru tivolibasket.it
tizanidinedruginteractions.blogspot.com tizanidine4mgstreetvalue.blogspot.com
tizanidinehcl2mgsideeffects.blogspot.com tizanidinedosage.blogspot.com
tizanidinerecreationaluse.blogspot.com tizanidineformigraines.blogspot.com
tjkckpytpnje.com tizanidinestreetvalue.blogspot.com
tk-assortiment.ru tnaionline.org
tmtrck.com top1-seo-service.com
token-lab.org topanasex.com
toolsky.com topdownloads.ru
topbestgames.com topflownews.com
topkarkas.com torrent-newgames.com
trafficshaper.com trafficmp.com
traffixer.com trafficnetzwerk.de
tripper.de trainoffend.ml
trkur.com trustedhealthtips.com
tt-ipd.info try-rx.com
tsan.net
ttrraacckkrr.com ttrraacckkrr.com
tuberkulezanet.ru twodollarshows.com
turbabitload.weebly.com ucsol.ru
twinderbella.com ufa.xrus.org
twittruth.com umg-stroy.ru
twu.com.ua unimodemhalfduplefw.pen.io
uhdtv.website uptime.com
unitexindia.com urll.eu
usadacha.net usacasino.com
vadimkravtcov.ru
vapeface.club
vavilone.com vavilone.com
vbabule.net vegascosmetics.ru
vesnatehno.ru venerologiya.com
vezuviy.su vgoloveboli.net
viandpet.com viagroid.ru
viberdownload10.com video-chat.in
video--production.com videochat.world
video-chat.cn videojam.tv
vip-dom.in videonsk.com
vip-parfumeria.ru vip2ch.com
vipromoffers.com virtuagirl.com
vltai.com visa-pasport.ru
voloslove.ru viveresaniesnelli.it
vucms.com vseuznaem.com
warezaccess.com w7s.ru
watsonrealtycorp.com watch-movies.ru
webenlace.com.ar website-audit.com.ua
webradiology.ru website-speed-check.site
webshoppermac.com weclipart.com
webtherapy.ru wheelchairliftsarea.com
weekes.biz.tc whengirlsgowild.com
whatsappdownload10.com
whipme.yopoint.in
whiteelephantwellington.com whiteelephantwellington.com
wholesalejerseys-cheapest.com whos.amung.us
wineration.com wildcattube.com
wonderfulflowers.biz wingsoffury2.com
workle.website winner7777.net
xev.ru winterclassichockeyjerseys.com
xgames-04.com wordpresscore.com
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai worldinternetauthority.com
xn----dtbndd4ae7eub.top worldis.me
xxxkaz.org worldmusicfests.com
xxxnatelefon.ru www.arenda-yeisk.ru
yatrk.xyz www.bookmaker-bets.com
yellowstonesafaritours.com www.labves.ru
yoluxuryevents.com x-porno.video
yottos.com x69ty.ru
youdao.com xclicks.net
zajm-zalog-krasnodar.ru xmnb.net
zarabotok--doma.ru xn----itbkqkfiq.xn--p1ai
zeroredirect12.com xxxtubesafari.com
zeroredirect6.com xz618.com
zixizop.net.ru yadro.ru
zmoda.hostreo.com yellocloud.be
zoogdisany.com you-shall-not-pass.is74.ru
zs2vm.top youjizz.vc
zvetki.ru youradexchange.com
zx6.ru youtube-downloader.savetubevideo.com
zaapplesales.blogspot.com
zarabotat-na-sajte.ru
zdesoboi.com
zebramart.ru
zeg-distribution.com
zooggames.com
zscalerone.net
zytpirwai.net

470
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
00author.com 00author.com
101lesbian.xyz 1688.com
1kinobig.ru 23kw.ru
1xbet4you.com 2rich4bitches.com
3rbseyes.com 5forex.ru
4ur.click 8jn.dating-app.ru
7wind.ru abtasty.com
a1security.com.ua acortarurl.es
aa08daf7e13b6345e09e92f771507fa5f4.com adidas.frwebs.fr
aac500b7a15b2646968f6bd8c6305869d7.com adpremium.org
aasoldes.fr agreda.pluto.ro
abctoppictures.net alfapro.ru
abusora.com alyeskaresort.com
addbin.men
addblueoff.com.ua
adrenalin-stk.ru
adult3dgames.com
adventureparkcostarica.com
ageofclones.com
air-edem.ru
alfa9.com
alphavisions.net
ameblo.jp
ampower.me
analytics-ads.xyz
anapa-inns.ru anapa-inns.ru
andpolice.com andpolice.com
apibrowsesmartne-a.akamaihd.net android-vsem.org
asrv-a.akamaihd.net arcadepages.com
avkzarabotok.info asia-forum.ru
avtointeres.ru atlant-auto.info
audiofree.ru
baixar-musicas-gratis.com
balook.com
bard-real.com.ua
belstaffstore.online
berlininsl.com
best-deals-products.com best-deals-products.com
best-way.men bestdraws.com
bestfortraders.com beztuberkuleza.ru
bigames.online bg6s0.com
binaryoptionscops.info binomo.kz
bio.trade-jp.net birzha-truda.eu
bizfly.info
bkgr.se bkgr.se
blockworld.ru
blpmovies.com
brainzpod.win brainzpod.win
bravegirlsclub.com brandehk.dk
buqyxa.rincian.info brendbutik.ru
bwlx.prepedu.cn brothers-smaller.ru
cartierlovestore.xyz businescoop.men
check-host.net callejondelpozo.es
christianlouboutinoutlet.win canrioloadm.gq
classicakuhni.ru caveavins.fr
clickintext.net cdncash.org
compliance-checker.info cheapestjerseys-wholesale.com
compliance-george.xyz cheapmoncler.win
compliance-josh.top cheapsergiorossi.online
confib.ifmo.ru cherubinimobili.it
coolyarddecorations.com cialischmrx.com
crazyboost.pro cialischstgerts.com
cityadspix.com
clevernt.com
compliance-willy.top
cookingmeat.ru
cornerstone-countertops.com
credit.co.ua
crest3d.ru crest3d.ru
ddospanel.com cupday.com
detoxmed24.ru czeshop.info
digitalassetmanagement.site de.zapmeta.com
discovertreasurenow.com dealitright.click
div.as decoratinghomes.ga
dekorkeramik.ru
digilander.libero.it
distver.ru
dms-sw.ru dms-sw.ru
dogbreedspicture.net drillsaw.ru
drivotracker.com eksprognoz.ru
dumpsmania24.com ekto.ee
dvd-famille.com elektir.ru
e-kwiaciarz.pl elidelcream.weebly.com
ebooknovel.club elitedollars.com
edwinkonijn.com.au elitesportsadvisor.com
ekspertmed.com elmifarhangi.com
elektronischezigarettekaufen2.tumblr.com eropornosex.ru
elektrozigarette2.wordpressy.pl
emediate.eu
ertelecom.ru ertelecom.ru
eu-cookie-law.blogspot.com es5.com
esfchat.tk
europages.com.ru
everflora.ru
expolicenciaslatam.co
facecup.top
failingmarriege.blogspot.com
falopicm.pw
fanrto.com fanrto.com
fashion-stickers.ru faptitans.com
femmesdenudees.com faracontrol.ir
finansov.info fetlifeblog.com
findpics.pw ff30236ddef1465f88547e760973d70a.com
findthe.pet financeloan.us
firstdrugmall.ru freejabs.com
florida-tourism.net freenode.info
focalink.com freeuploader.com
foto-sisek.porngalleries.top fungirlsgames.net
fotopop.club gamingspark.com
freesitetest.com gateway.zscalerone.net
freetangodownload.com gotcher.us
freshdz.com gymi.name
frustrated-favorable.gq hdapp1008-a.akamaihd.net
gaypornmovie.net hesteel.pl
gcup.ru homeandhealth.ru
gearsadspromo.club hotblognetwork.com
generousdeal-a.akamaihd.net hotsocialz.com
getlamborghini.ga houtings.xyz
glicol.kz hoverboard360.de
gnuetella.com htmlcorner.com
gsasearchengineranker.site huimin764128.com
guardlink.org humanorightswatch.org
hacktougroup.ru ifirestarter.ru
handicapvansarea.com impisr.edunsk.ru
hayate.biz infoupdate.org
heliko.no intim-uslugi.info
hermesbelts.xyz investyb.com
highstairs-a.akamaihd.net jasonpartington.com
hoste.octopis.com jerseychinabizwholesale.com
housemilan.ru jmat.cn
hoverboard360.se joingames.org
hydropump.su justucalling32211123456789.tk
hyipmanager.in
ido3.com
iinstalll-fii1leis.jus0wil.pp.ua
ilovevitaly.ru
imagefinder.site
imagez.co
imagine-ex.co
interfucks.net
ispaniya-costa-blanca.ru
ivanstroi.ru
ixora.pro
izoll.ru
javatex.co.id
katadhin.co
ketoanhanoi.info ketoanhanoi.info
keyhantercume.com kfon.eu
keywordteam.net kinogonew.ru
kinocccp.net
kit-opt.ru
klitimg.pw klitimg.pw
kmgamex.cf konkursov.net
kosynka-games.ru krasivoe-hd.net
kredit-pod-zalog-krasnodar.ru krasula.pp.ua
la-fa.ru kupiproday.com.ua
lineavabit.it laparfumotec.com
linkbux.ru lazy-z.com
littlesunraiser.com ledpolice.ru
locustdesign.co letolove.ru
lost-alpha.ru lietaer.com
lutherstable.org liky.co.ua
mail.allnews24.in longadventure.com
mearns-tractors.co.uk magicplayer-s.acestream.net
meendo-free-traffic.ga manifestation.betteroffers.review
mindbox.co.za medi-fitt.hu
mir-limuzinov.ru mirtorrent.net
mobsfun.net missis.top
monclervests.xyz mistr-x.org
morf.snn.gr mixx.com
moscow-clining.ru mobile-appster.ru
moscow.online-podarki.com moesexy.com
moyakuhnia.ru moinozhki.com
moviezbonkerssk.cf
mundoaberrante.com mundoaberrante.com
music7s.me mycaf.it
my-bc.ru nakrutka.cc
nakozhe.com napalm51.nut.cc
narkologiya-belgorod.ru
narkologiya-penza.ru narkologiya-penza.ru
naturtreenspicerx.pw naturalpharm.com.ua
no-fuel.org nowtorrents.com
novatech.vn obsessionphrases.com
obiavo.in offers.bycontext.com
odesproperty.com online-hd.pl
odywpjtw.bloger.index.hr parfusale.se
oil-td.ru pathwhelp.org
pacificair.com pc4download.co
parajumpersjakkesalgnorge.info perederni.net
penisvergrotendepillennl.ovh perfectplanned.com
picswe.com petrovka-online.com
pictures-and-images.net pewit.pw
placid-rounded-coast.glitch.me pflexads.com
prostitutki-odessa.org pinup-casino1.ru
pts163.ru pixshark.com
rabotaetvse.ru pizdopletka.club
ranksonic.info pk-services.ru
redirect.trafficreceiver.club plugingeorgia.com
reeyanaturopathy.com pokerniydom.ru
refererx.com pornogad.com
rimedia.org pornosexrolik.com
ritlweb.com preventheadacheguide.info
rukino.org printdirectforless.com
saletool.ru prize44.com
sanyuprojects.com pro-tec.kz
sarafangel.ru prodess.ru
saveriopiazza.it producm.ru
sawin.beth.webd.pl produkto.net
seo-2-0.com profit-opportunity.com
sexvporno.ru promalp-universal.ru
sexy-screen-savers.com prostitutki-kiev.org
shemale-sex.net prostitutki-yaroslavlya.org
shinikiev.com.ua purchasepillsnorx.com
shtaketniki.ru quickchange.cc
sisi-go.ru rabot.host.sk
site-speed-check.site rapidsites.pro
skuteczna-dieta.co.pl rcpmda.ikan1080.xyz
smailik.org registry-cleaner.net
small-games.biz relax.ru
smartbalanceworld.com restorator-msk.ru
snegozaderzhatel.ru rethinkwasteni.info
social-s-hhh.xyz russintv.fr
sosdepotdebilan.com russkie-gorki.ru
sovetogorod.ru salut-camp.ru
samoiedo.it
scanner-walter.top
searchwebknow-a.akamaihd.net
seasaltwithfood.com
security60-e.com
servisural.ru
sideeffectsoftizanidine.blogspot.com
sims-sims.ru
socialbutton.xyz
softomix.net
solution4u.com
sophang8.com
spb.ru spb.ru
spyfu.com sr-rekneskap.no
stpolice.com startufa.ru
strag-invest.ru stockquotes.wooeb.com
sudexpert66.ru stromerrealty.com
takethatad.com superfish.com
td-l-market.ru svarbit.com
thecoral.com.br swimpool.ca
thegolfclub.info sygraem.com
theplacetoupdating.pw teenfuck.tv
ticketsys.inetwd.com themeforest.net
time-japan.ru thetoiletpaper.com
tizanidinehydrochloride2mg.blogspot.com timhost.ru
tizanidinenarcotic.blogspot.com tizanidinehcl4mgtablet.blogspot.com
toolsky.com tmm-kurs.ru
torture.ml token-lab.org
tozup.com topdownloads.ru
track2.shop u17795.netangels.ru
trustl.life uhodzalijami.ru
tube8.com ukrtextbook.com
tuckermktg.com unimodemhalfduplefw.pen.io
u555u.info urccvfmc.bloger.index.hr
ucsol.ru vip-file.com
uhdtv.website vip.51.la
ukrup.com virtuagirl.com
undergroundcityphoto.com visa-pasport.ru
v-doc.co visitcambridge.org
vabasa.inwtrade.com vkmusics.ru
vacances-voyages.info vltai.com
valmetrundan.se voloslove.ru
vashsvet.com webshoppermac.com
videojam.tv wellcome2slovenia.ru
vietimgy.pw wholesalejerseychinaoutlet.com
vinylvault.co.uk wineitudes.wordpress.com
vkontaktemusic.ru winterclassichockeyjerseys.com
voprosotvet24.ru wnoz.de
wanker.us wordkeyhelper.com
waterpurifier.club wordpress-crew.net
watracker.net wordpresscore.com
wesharepics.site world-mmo.com
xlolitka.com x69ty.ru
xlovecam.com xmladserver.com
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn--80ahvj9e.xn--p1ai xnxx-n.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai za-fun-offer.com
xxxguitars.com zajm-zalog-krasnodar.ru
yhit.press
youdesigner.kz
zigzog.ru
znakom.sibtest.ru
zynax.ua

12
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -1,11 +1,21 @@
<!DOCTYPE html>
<html> <html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html><html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center> <hr><center>nginx/1.18.0 (Ubuntu)</center>
</body> </body>
</html> </html>
ml><html> <html>
<head><title>503 Service Temporarily Unavailable</title></head> <head><title>503 Service Temporarily Unavailable</title></head>
<body> <body>
<center><h1>503 Service Temporarily Unavailable</h1></center> <center><h1>503 Service Temporarily Unavailable</h1></center>

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.85 0; 10.1.0.227 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3447 ### Version: V4.2022.11.3448
### Updated: Wed Nov 2 22:01:15 UTC 2022 ### Updated: Thu Nov 3 10:03:57 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3447 ### Version: V4.2022.11.3448
### Updated: Wed Nov 2 22:01:15 UTC 2022 ### Updated: Thu Nov 3 10:03:57 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##