vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.05.3136 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-05-30 10:09:19 +00:00
parent bb77221f9a
commit b583c1e7ef
46 changed files with 95516 additions and 95516 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3135 #### Version: V4.2022.05.3136
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.05.3135 #### Version: V4.2022.05.3136
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.05.3135 #### Version: V4.2022.05.3136
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11804
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.05.3135 #### Version: V4.2022.05.3136
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11808
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11808
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11808
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11808
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3135 3136

11808
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11808
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.122.209 0; 104.209.182.50 0;

11808
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

11808
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.122.209 0; 104.209.182.50 0;

11808
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.106.122.209 0; 104.209.182.50 0;

11808
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 1; 10.1.1.31 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BlowFish CazoodleBot
Ezooms Copyscape
FyberSpider DittoSpyder
Jyxobot Dragonfly
PageGrabber Kenjin Spider
ReGet Lipperhey
RedesScrapy MTRobot
Virusdie OrangeSpider
WebImageCollector Toweyabot
ubermetrics-technologies.com WebCopier

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404enemy
80legs
ADmantX ADmantX
AIBOT
ALittle Client ALittle Client
Abonti ASPSeek
Aboundexbot Aboundexbot
AiHitBot Acunetix
AllSubmitter AfD-Verbotsverfahren
Aipbot
AlphaBot
Anarchy
Anarchy99 Anarchy99
Ankit Ankit
Asterias Attach
AwarioSmartBot AwarioRssBot
BDCbot
BackDoorBot BackDoorBot
Badass BackWeb
Backlink-Ceck
Bandit
Bitacle
Black Hole
Blackboard Blackboard
Boardreader Blow
Buck BotALot
Buddy Brandwatch
BuiltBotTough
BuiltWith
Bullseye Bullseye
BunnySlippers CCBot
BuzzSumo Calculon
CATExplorador CazoodleBot
CSHttp Claritybot
Cegbfeieh Cloud mapping
CherryPicker Collector
ChinaClaw
Cocolyzebot
Copyscape Copyscape
CrazyWebCrawler
CrunchBot
Curious Curious
Custo
DBLBot DBLBot
DIIbot DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Deusu Deusu
Devil
DigitalPebble DigitalPebble
Dirbuster DittoSpyder
Discobot
Discoverybot
DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainAppender Domains Project
DomainCrawler Download Wonder
Dragonfly EMail Siphon
Drip EMail Wolf
EasyDL
Ebingbong Ebingbong
Ecxi Ecxi
EirGrabber EirGrabber
Exabot ExtractorPro
ExtLinksBot Extreme Picture Finder
Extractor
Ezooms
FDM FDM
FHscan Flunky
FemtosearchBot
FlashGet
Freeuploader Freeuploader
FrontPage FrontPage
Genieo G-i-g-a-b-o-t
GT::WWW
GermCrawler GermCrawler
GetRight GetWeb
Grabber Getintent
Grafula Go-Ahead-Got-It
GrapeFX HMView
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite HTTP::Lite
Haansoft HaosouSpider
Harvest Heritrix
Havij HonoluluBot
Humanlinks IDBTE4M
HybridBot IRLbot
Iblog
Id-search Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot IndeedBot
Intelliseek InfoNaviRobot
InterGET InterGET
InternetSeer
JamesBOT
Jbrofuzz
JennyBot
Jetty Jetty
JikeSpider Joomla
Keybot Translation-Search-Machine Jorgee
JustView
Keyword Density
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple Leap
Larbin
LibWeb
Libwhisker
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinksManager LinksManager
LinqiaRSSBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
MJ12bot Lipperhey Spider
MSIECrawler Litemage_walker
Majestic-SEO Lmspider
Mediatoolkitbot Mag-Net
Magnet
MarkMonitor
MauiBot
Mb2345Browser
MegaIndex.ru MegaIndex.ru
MicroMessenger MicroMessenger
Moblie Safari Microsoft URL Control
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO NICErsPRO
Name Intelligence NPbot
Nameprotect Navroad
Nessus
Net Vampire
NetMechanic NetMechanic
Netcraft NetSpider
NextGenSearchBot NetZIP
Nibbler Nimbostratus
Not Ninja
OnCrawl Nmap
Openvas Nuclei
OrangeBot Octopus
OutclicksBot Offline Explorer
OutfoxBot OpenLinkProfiler
PHPCrawl OpenVAS
Openfind
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageGrabber
PageScorer
PageThing.com PageThing.com
Panscient Pandalytics
Papa Foto
Petalbot Petalbot
Piepmatz Pi-Monster
Pimonster
Pixray
Pockey Pockey
ProWebWalker
Probethenet Probethenet
Psbot Psbot
PxBroker PxBroker
RankActive
RankActiveLinkBot
RankFlex RankFlex
Rankivabot
RankurBot
Re-re Re-re
RebelMouse ReGet
RocketCrawler Reaper
SEOlyticsCrawler Ripper
SEOprofiler
SMTBot
SalesIntelligent SalesIntelligent
Scanbot ScrepyBot
Screaming
Searchestate
SemanticJuice
Semrush
SentiBot SentiBot
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz Seomoz
Siphon Shodan
SiteLockSpider Site Sucker
SiteSucker SmartDownload
Sitebeam Snapbot
Siteimprove Snoopy
Sitevigil SocialRankIOBot
SlySearch
Snake
Sociscraper
Sogou web spider Sogou web spider
Sottopop Sottopop
SpaceBison Spbot
Spammen Sqlmap
SputnikBot Sucuri
Sqworm SuperBot
Steeler
Stripper
Sucker
Surfbot Surfbot
SurveyBot SurveyBot
Szukacz T8Abot
Teleport
TeleportPro TeleportPro
Telesphorep Telesoft
Telesphoreo
The Intraformant The Intraformant
TheNomad Titan
Thumbor Toata
Tracemyfile Turingos
True_Robot
Turnitin Turnitin
TurnitinBot
TwengaBot TwengaBot
Twice URLy.Warning
Typhoeus
URLy Warning
UnisterBot UnisterBot
Upflow
V-BOT V-BOT
Vacuum VB Project
Vagabondo Voil
VoidEYE
Voltron
WASALive-Bot WASALive-Bot
WBSearchBot WBSearchBot
WISENutbot
WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Collage
Web Enhancer Web Enhancer
Web Fuck Web Fuck
Web Pix
Web Sucker Web Sucker
WebAuto WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebPix WebPix
WebReaper
WebSauger WebSauger
WebStripper WebStripper
WebSucker WebSucker
WebWhacker
Webalta Webalta
Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Webster Widow
Whatweb WinHTTrack
WiseGuys Robot WiseGuys Robot
Xaldon WebSpider Wprecon
YoudaoBot Xenu
Zauba Zermelo
ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZumBot ZumBot
ZyBorg
adscanner adscanner
arquivo.pt arquivo-web-crawler
backlink-check clark-crawler
coccocbot coccocbot
crawl.sogou.com com.plumanalytics
dataforseo.com crawler.feedback
crawler4j
demandbase-bot demandbase-bot
evc-batch facebookscraper
gopher internetVista monitor
heritrix ips-agent
instabid
isitwp.com
iubenda-radar
linkdexbot linkdexbot
lwp-trivial muhstik-scan
netEstate NE Crawler netEstate NE Crawler
page scorer oBot
probe-image-size polaris version
scan.lol ripz
satoristudio.net
seocompany.store
seostar seostar
serpstatbot serpstatbot
sitechecker.pro
siteripz
sogouspider
sp_auditbot sp_auditbot
spyfu sysscan
ubermetrics-technologies.com
voyagerx.com
webgains-bot webgains-bot
webpros.com webmeup-crawler
webprosbot webprosbot
x09Mozilla x09Mozilla
zauba.io xpymep1.exe

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker 404checker
80legs ASPSeek
ADmantX
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
Aipbot Aipbot
Alexibot Alexibot
Alligator AllSubmitter
AlphaBot AlphaBot
Anarchy Anarchie
Anthill Ankit
Attach
AwarioSmartBot AwarioSmartBot
BBBike
BDCbot BDCbot
BackDoorBot BDFetch
BLEXBot
BackStreet
BackWeb BackWeb
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
BatchFTP BetaBot
Battleztar Bazinga
Bigfoot Bigfoot
Bitacle
Black Hole Black Hole
Boardreader BlackWidow
BotALot Blow
Brandprotect BlowFish
Buck BuiltBotTough
Buddy BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo BuzzSumo
CCBot CCBot
CODE87 Calculon
CensysInspect CensysInspect
Cloud mapping Citoid
Cliqzbot
Cocolyzebot Cocolyzebot
Collector CopyRightCheck
Copyscape
Crawling at Home Project Crawling at Home Project
CrazyWebCrawler
CrunchBot CrunchBot
Curious
DBLBot DBLBot
DIIbot DSearch
DatabaseDriverMysqli DataCha0s
Deusu Demon
Devil
Disco
Discobot Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainCrawler Drip
DomainStatsBot
Dotbot
Download Wonder
ECCP/1.0
Ebingbong Ebingbong
EroCrawler
Evil Evil
Exabot Express WebPictures
Extractor
EyeNetIE EyeNetIE
Ezooms FDM
Fimap Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader Freeuploader
GermCrawler Fuzz
GT::WWW
Genieo
GetRight
Gigabot
Go!Zilla
GoZilla
Gotit Gotit
Grabber Grafula
GrapeFX Haansoft
HTMLparser HaosouSpider
Harvest
Havij Havij
Heritrix
Hloader Hloader
IlseBot HonoluluBot
IndeedBot IDBTE4M
IDBot
IRLbot
Iblog
Image Fetch
Indy Library Indy Library
Intelliseek Intelliseek
InternetSeer Iria
IstellaBot Iskanie
JamesBOT JOC Web Spider
JetCar
JikeSpider JikeSpider
Joomla
Jorgee
Jyxobot Jyxobot
Kenjin Spider Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy LNSpiderguy
LWP::Simple
Lanshanbot Lanshanbot
Leap
LeechFTP LeechFTP
LeechGet Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse
LinkScan
Linkbot
LinkpadBot LinkpadBot
LinksManager LinksManager
LinqiaRSSBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MIIxpc Ltx71
MQQBrowser MFC_Tear_Sample
MSIECrawler MSFrontPage
MTRobot
Mag-Net Mag-Net
Mail.RU_Bot
Majestic12
MarkMonitor MarkMonitor
MarkWatch Mata Hari
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
MegaIndex.ru MegaIndex.ru
Metauri Minefield
MicroMessenger Morfeus Fucking Scanner
Microsoft Data Access Msrabot
Mozlila Musobot
Mr.4x3 NPbot
Name Intelligence
Net Vampire Net Vampire
Netcraft NetAnts
NetMechanic
NetZIP
Nettrack
Netvibes Netvibes
Nibbler Nibbler
NimbleCrawler Niki-bot
Nimbostratus
Octopus
OnCrawl OnCrawl
OpenVAS OrangeBot
Openvas
OrangeSpider OrangeSpider
PECL::HTTP OutclicksBot
PHPCrawl
Page Analyzer Page Analyzer
PageAnalyzer
PageGrabber PageGrabber
PageScorer PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk Pavuk
PeoplePal
PictureFinder
Pimonster Pimonster
PleaseCrawl ProPowerBot
Probethenet Pump
Pu_iN RankingBot2
QueryN Metasearch Re-re
Quick-Crawler ReGet
RankingBot
RealDownload RealDownload
Reaper RepoMonkey
RebelMouse
RedesScrapy
Ripper Ripper
RocketCrawler RocketCrawler
SBIder
SEOkicks SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler SEOprofiler
SISTRIX
SalesIntelligent SalesIntelligent
Scrapy ScanAlert
Scanbot
Screaming
Seekport
Semrush Semrush
SentiBot
SeobilityBot SeobilityBot
Seomoz
Shodan Shodan
Siphon Siphon
Site Sucker SiteCheckerBotCrawler
Siteimprove SiteExplorer
Sitevigil SlySearch
Snapbot Sogou web spider
SocialRankIOBot Spbot
Sosospider
Sottopop
Spinn3r
Sqlworm Sqlworm
Sqworm
Sucuri Sucuri
SuperHTTP SurveyBot
Surfbot Suzuran
Swiftbot T0PHackTeam
Szukacz TeleportPro
T8Abot Telesoft
Telesphoreo Telesphoreo
Telesphorep
TheNomad TheNomad
TightTwatBot TightTwatBot
Titan Titan
Toata Trendiction
Tracemyfile True_Robot
Turingos
Turnitin Turnitin
Typhoeus TurnitinBot
VCI TwengaBot
Vacuum Twice
URLy Warning
URLy.Warning
Upflow
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE VoidEYE
Voltron WASALive-Bot
WEBDAV WBSearchBot
WISENutbot WPScan
WWW-Mechanize WWWOFFLE
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
Web Auto
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Fetch
Web Fuck Web Fuck
Web Pix Web Pix
WebCollage WebAuto
WebCopier WebBandit
WebLeacher WebFuck
WebPix WebPix
WebReaper WebReaper
WebSauger WebSauger
WebStripper
WebSucker
WebZIP WebZIP
Webshag WebsiteQuester
WebsiteExtractor Whack
Webster Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zauba Zauba
Zeus Zermelo
ZoominfoBot Zitebot
ZyBorg ZmEu
adscanner cah.io.community
arquivo.pt
check1.exe check1.exe
cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com crawl.sogou.com
dataforseo.com demandbase-bot
domainsproject.org
evc-batch evc-batch
facebookscraper facebookscraper
internetVista monitor gopher
heritrix
instabid
ips-agent ips-agent
lwp-request lwp-request
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler oBot
pcBrowser page scorer
s1z.ru polaris version
satoristudio.net satoristudio.net
scalaj-http seocompany.store
seoscanners
seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
sitechecker.pro
spyfu spyfu
webgains-bot webgains-bot
webpros.com webprosbot
x09Mozilla x09Mozilla
xpymep1.exe
zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
55wmz.ru adidas.frwebs.fr
bannertesting.com callawaygolfstore.online
cleanersoft.com celejihad.info
eas-seo.com culmimg.pw
gavuer.ru isistaylorporn.info
googst2.ru kino-fun.ru
heliko.no moneyviking-a.akamaihd.net
karachev-city.ru pornoplen.com
kinostorm.net redbottomheels.xyz
yellowstonevisitortours.com videochat.life

910
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1001watch.com.ua 10bet.com
1bet.com 28n2gl3wfyb0.ru
2ads.co.uk
3xforum.ro 3xforum.ro
4inn.ru 4kplayer.pl
4pp13.com 4rent.ru
4ureyesonly.com 7ooo.ru
aa81bf391151884adfa3dd677e41f94be1.com 8gold.com
abcguru.xyz 999webdesign.com
activepr.ru aac52006ec82a24e08b665f4db2b5013f7.com
admitad.com absolutelyanalog.com
adpremium.org actulite.com
adultfullhd.com adobereader-free.ru
aerogo.com adprotect.net
ahrntal.verymes.xyz advancedmassagebysara.com
alice.it advertisingtag.net
allforminecraft.ru advocatemsk.ru
ample-awards-today.us agahinameh.com
anaksma.info algarveglobal.com
android4fun.org allboard.xobor.de
androids-store.com allnews.md
animalrank.com am-se.com
apartmentratings.com amehdaily.com
apibatbrowsecom-a.akamaihd.net antons-transporte.de
appartement-stumm.at app5.letmacworkfaster.world
applicationg29.com applicationg29.com
approved.su apptester.tk
arendakvartir.kz arcadepages.com
asrvvv-a.akamaihd.net artefakct.com
aussie-prizes.com asiavirtualsolutions.com
autobudpostach.club asmxsatadriverin.aircus.com
aviav.co asrvrep-a.akamaihd.net
avto-oligarh.ru atlasvkusov.ru
avtoarenda.by auto-zapchasti.org
bannerbank.ru aviav.ru.com
barbourjackets.online azarttoto.com
barnfurnituremart.com backiee.com
bbsoldes.fr bala.getenjoyment.net
beclean-nn.ru balkanfarma.org
bedcapdealers.com balois.worldbreak.com
bannerads.de
battleforupdating.site
beremenyashka.com beremenyashka.com
bestbrainprod.win bestbrainprod.win
bestempresas.es bestchoice.cf
bestimagecoollibrary.com bestwrinklecreamnow.com
bestssaker.com bidr.trellian.com
bestwebsiteawards.com big-boards.info
bigpenisguide.com bigcities.org
birzha-truda.eu blackcurranthumidifiers.site
bloggen.be blogqpot.com
bodybuilding-shop.biz blpmovies.com
bolezniorganov.ru
bonkers.name
bonvillan.com
bonzibuddi.com bonzibuddi.com
boo-arts.com bonzybuddy.com
boobsimge.com boom-celebs.com
brainxs.us bosefux.esy.es
brandimensions.com braintobe.win
buehne-fuer-menschenrechte.de braip.com.br
buqyxa.rincian.info brandbucket.com
bus-offer.com brandedleadgeneration.com
buyparajumpers.online bristolhotel.com.ua
c-english.ru bronzeaid-a.akamaihd.net
cablecar.us browsepulse-a.akamaihd.net
cactussoft.biz builtwith.com
callejondelpozo.es burn-fat.ga
canacopegdl.com buron.pw
carstrends2015.com businesn.men
cartechnic.ru buydissertation.net
cartierbracelet.xyz buyessay3.blogspot.ru
cartierring.xyz bytimedance.ru
casinopinup-wins.com cakemediahq.com.au
casinos4dummies.co.uk cakesplus.com.au
cdncash.net callcafe.info
centre-indigo.org.ua callstevens.com
cercacamion.it canoncdriverq3.pen.io
chatroulette.video canrole.com
cheapmoncler.win canyougethighofftizanidine.blogspot.com
chocolateslim-u-srbiji.com carapics.com
chorus.terakeet.com caulderwoodkennels.com
celebsopics.com
cenokos.ru
cheapbarbour.online
cheapjerseysa.com
cheapsergiorossi.online
chinajerseyswholesalecoupons.com
choosecuisine.com
christianlouboutinoutlet.win christianlouboutinoutlet.win
cineacademy.ru christianlouboutinreplica.win
citetick.com chuckguilford.com
cl.s7.exct.net ciceros.co
clean-start.net cindymatches.com
cleanmypc.com cleanallvirus.com
clevernt.com clickcash.com
clothesforcash.com clothesforcash.com
compliance-margo.top cmhomestayagency.com
compliance-walt.top collegeessay19.blogspot.ru
compliance-willy.top comissionka.net
conboy.us compliance-don.xyz
consorzioilmosaico.org compliance-jack.top
copyrightclaims.org compliance-jess.top
cowblog.fr compliance-josh.top
crazyboost.pro concordexoticrentals.com
culturevie.info confib.ifmo.ru
customboxes4less.com contentsexpress.com
country-chic.ru
crackguru.tk
credit-respect.ru
cs-passion.pl
culad.com
custom-product-labels.com
dame-ns.kz
danceuniverse.ru danceuniverse.ru
de.zapmeta.com dating-time-now.com
dengi-pod-zalog-nedvizhimosti.ru datract.com
descargar-musica-gratis.net dayibiao.com
deshevo-nedorogo.ru dekorkeramik.ru
dickssportinggoods.com delfin-aqua.com.ua
digitalassetmanagement.site digitalassetmanagement.site
dimaka.info dikx.gdn
dipstar.org dildofotzen.net
discovertreasurenow.com div.as
dnepropetrovsk.mistr-x.org dkvorota.ru
dnsrsearch.com dostavimvdom.ru
doctissimo.fr
dodlive.mil
domain.webkeyit.com
domain2008.com
domashneeruporno.com
dotmass.top dotmass.top
dotnetdotcom.org
doublepimp.com doublepimp.com
drpornogratisx.xxx downloaddy.net
dustyorate.com doyouknowtheword-flummox.ml
e-c.al drunkenstepfather.com
earn-from-articles.com duawitchrarato.tk
ed-shop01.ru dumuelave.xyz
edwinkonijn.com.au easyukraine.com
egvar.net ege-essay.ru
ekspertmed.com ekto.ee
el-nation.com empis.magix.net
elitedollars.com espaceinventoristes.com
elvenar.com essay-edu.biz
emailaccountlogin.co etotupo.ru
encodable.com exportshop.us
eng-lyrics.com extener.org
eredijovon.com extremepornos.net
eshop4u.jp
etenininrade.ga
eu-cookie-law.info
eurosamodelki.ru
evening-dating-club.info
exmasters.com
eyemagination.com eyemagination.com
ezaz.info ezigarettenshop1.yolasite.com
ezigarettekaufen1.hpage.com f07.de
f1nder.org facebook-mobile.xyz
f5mtrack.com
famix.xyz famix.xyz
fanrto.com fanrto.com
fapgon.com favoritemoney.ru
fast-torrent.ru feel-planet.com
fast-wordpress-start.com filmgo.ru
fenoyl.batcave.net filmi-v.online
fetishinside.com
findthe.pet findthe.pet
fix-website-errors.com flooringinstallation-edmonton.com
food.dtu.dk floridahuntingfishingadventures.com
forms-mtm.ru foodgid.net
forum20.smailik.org forumprofi.de
fotoxxxru.com franecki.net
fungirlsgames.net free-floating-buttons.com
gagrasector.ru free-laptop-reward.com
gardene.ru freecamdollars.com
gateway.zscalerone.net freemags.cc
gdzkurokam.ru freshdz.com
geileweiber.tk freza-sverlo.ru
frivgame250.com
front.ru
front.to
fuckmill.com
galaxyflowers.ru
galeon.com
gateway.zscalertwo.net
gdcentre.ru
geckoandfly.com
geile-lelly.eu
generic-pills-online.com
generousdeal-a.akamaihd.net
gerhardhealer.com gerhardhealer.com
get-free-social-traffic.com gg.zzyjxs.com
get-free-traffic-now.com ghostvisitor.com
getlamborghini.ga gifspics.com
ghazel.ru gigixo.com
globalscam.ga girlporn.ru
gnuetella.com glavtral.ru
golden-praga.ru goforexvps.com
golmau.host.sk good-mummy.ru
gowreckdiving.com gotwebsite1.com
greatgrace.ru greatidea.marketing
growboxbl.ru growshop.es
grtyi.com
gsasearchengineranker.top
gsasearchengineranker.xyz
gta-club.ru gta-club.ru
guitar-master.org gtopstats.com
gwhwpxbw.bloger.index.hr gungamesz.com
gz2.bbsoldes.fr hdpixent.com
hamilton.ca heartofpayne.xyz
headpress.ru himgaws.pw
healmytrauma.info homedecorpicture.us
helicalpile.us homegardenlova.com
hermesbracelets.xyz
highland-homes.com
histats.com
hitmuzik.ru
hmmm.cz
hop.clickbank.net hop.clickbank.net
hoverboard360.nl hostnow.men
hoverboardforsaledirect.com https-legalrc.biz
howtowhitenteethfast.xyz hubbble.com
ifirestarter.ru hunthillfarmtrust.org
igithab.com ideibiznesa2015.ru
iinstalll-fii1leis.jus0wil.pp.ua ikritikimou.gr
ikearugs.xyz ilmen.net
ilovevitaly.ru incomekey.net
imadedinner.net infazavr.ru
insurple.com
intellektmedia.at intellektmedia.at
internetproviderstucson.com internetartfair.com
iplusbit.blogspot.co.za intervsem.ru
iscblog.info intimshop-fantasy.ru
isitpaleo.info investzalog.ru
istock-mebel.ru inzn.ru
itch.io isotoner.com
jamiembrown.com istizanidineacontrolledsubstance.blogspot.com
japfm.com itsdp3.com
jerseywholesaleelitestore.com itservicesthatworkforyou.com
jmat.cn ixora.pro
job.icivil.ir jagg.info
juliadiets.com janavibekken.no
kalb.ru jerseychinabizwholesale.com
kamen-e.ru jerseychinabizwholesale.us
kamorel.com jillepille.com
karaganda.xkaz.org johannesburgsingles.co.za
kasino-money.pw joy-penguin.com
kaz.kz junglenet-a.akamaihd.net
kazinogames.lv justbcause.com
kellyonline.xyz kino2018.club
kinobaks.com
kinobest.pl
kinofak.net kinofak.net
kinohall.ru kinomaniatv.pl
kiwe-analytics.com kletkimehan.ru
kleine-titten.biz knigonosha.net
kmgamex.cf kongruan.com
kolotiloff.ru koral.se
komp-pomosch.ru kosova.de
konkursowo-24.pl koversite.info
kreativperlen.ch kredit-blog.ru
kretpicf.pw lacasamorett.com
ladsblue.com lacave.ntic.fr
lafriore.ru
lanadelreyfans.us lanadelreyfans.us
laparfumotec.com landscaping.center
laxdrills.com laptoper.net
ldrtrack.com laserpen.club
le-clos-des-alouettes.com law-check-two.xyz
letolove.ru lawyers.cafe
lifehacĸer.com laxob.com
link.ac lazy-z.com
linkbuddies.com legalrc.biz
lion.playtap.us lignofix.ua
littleberry.ru lineshops.biz
liupis.com liver-chintai.org
localflirtbuddies.com liveu.infoteka.hu
localmatchbook.com
lol-smurfs.com lol-smurfs.com
lomb.co lombia.com
lonely-mature.com lonfon.xyz
lutherstable.org ltvperf.com
luckyday.world
m4ever.net m4ever.net
m5home.ru machicon-akihabara.info
magazin-pics.ru mactechinfo.info
magnetpress.sk makenahartlin.com
makedo.ru
manifestation.betteroffers.review
manifestyourmillion.com
manualterap.roleforum.ru
marcoislandvacations.net marcoislandvacations.net
matpre.top massage-info.nl
maximpartnerspr.com matchpal-a.akamaihd.net
matematikus.info
max-p.men
mediawhirl.net
mega-polis.biz.ua mega-polis.biz.ua
megaindex.ru memberty.com
megavolt.net.ua mesbuta.info
mejoresfotos.eu mikrobiologies.ru
member-quiz.com mnimmigrantrights.net
millionare.com
minecraft-neo.ru
mirzonru.net
mlvc4zzw.space
mmostrike.ru
mncrftpcs.com
mnogabukaff.net
mobile.ok.ru
monarchfind-a.akamaihd.net
moncleroutletonline.xyz moncleroutletonline.xyz
moz.com money-for-placing-articles.com
mp3s.club montredemarque.nl
muz-baza.net moscow.xrus.org
moviemail-online.co.uk
mowser.com
mrbitsandbytes.com
musezone.su
musflashtv.com
musicspire.online
mxgetcode.com
myblogregistercm.tk
mygameplus.com
myonlinepayday.co
myprintscreen.com myprintscreen.com
myra.top myseoconsultant.com
nacap.ru
narkologiya-orel.ru narkologiya-orel.ru
net-profits.xyz narkologiya-voronezh.ru
netcheckcdn.xyz nero-us.com
netpics.org nightvision746.weebly.com
nfljerseyscheapchinabiz.com
nhl09.ru
niki-mlt.ru
ningessaybe.me
nofreezingmac.click
nordvpn.com nordvpn.com
noscrapleftbehind.co
nosecret.com.ua
novatech.vn novatech.vn
onemactrckr.com novosti-hi-tech.ru
online7777.com nufaq.com
openmultipleurl.com nzfilecloud.weebly.com
openstat.com obiavo.ru
optitrade24.com ohmyrings.com
orel-reshka.net okel.co
orgasmatrix.com one-gear.com
ozoz.it onlainbesplatno.ru
page2rss.com online.ktc45.ru
panamaforbeginners.com onlinefilmz.net
panicatack.com onlyforemont.ru
partner-host.men orion-v.com
pattersonsweb.com paceform.com
paydayonlinecom.com paighambot.com
pensplan4u.com pc-virus-d0l92j2.pw
petedrummond.com pcboa.se
phelissota.xyz pendelprognos.se
pinup-casino1.ru perm.xrus.org
pix24x7.com pewit.pw
pixell.club phobia.us
pizza-tycoon.com photostudiolightings.com
pl.aasoldes.fr piccdata.com
pladform.ru picturesmania.com
playtap.us piter.xrus.org
poligon.com pl-vouchers.com
polimga.pw playlott.com
polska-poezja.com pobeiranie.pl
poem-paying.gq
polytopesexempt.com
popserve.adscpm.net popserve.adscpm.net
popugaychiki.com pornhub-ru.com
porndl.org porno-play.net
pornhub-forum.ga pornobrazzers.biz
pornmania.pl pornosmola.info
pornoinn.com powitania.pl
pornophoto.xyz printie.com
pornosee.info
pornotubs.com
pornozhara.com
pornzone.tv
porodasobak.net
powenlite24.ru
prchecker.info
priora-2.com
prizefestival.mobi prizefestival.mobi
prodvigator.ua
profolan.pl profolan.pl
prospekt-st.ru prohoster.info
proxyradar.com prombudpostach.com.ua
psvita.ru
pussyspace.net
putevka24.ru putevka24.ru
putitin.me pwwysydh.com
pxhdwsm.com q-moto.ru
qld10000.net qexyfu.bugs3.com
quality-traffic.com quangcaons.com
quickcashlimited.com quick-seeker.com
rabot.host.sk quickchange.cc
rainbowice.ru rangjued.com
realizmobi.com raschtextil.com.ua
rebuildermedical.com realnye-otzyvy.info
redirectme.net realtytimes.com
referencemoi.com redirlock.com
remmling.de reeyanaturopathy.com
remont-komputerov-notebook.ru registrydomainservices.com
responsive-test.net remybutler.fr
ricorsogiustizia.org research.ifmo.ru
ringporno.com retreatia.com
rff-cfal.info
rixpix.ru rixpix.ru
rockprogblog.com sa-rewards.co.za
roma-kukareku.livejournal.com saltspray.ru
ros-ctm.ru sandhillsonline.com
russia-today-video.ru
rutor.vip
s-iwantyou.com
sale-japan.com
sanjosestartups.com sanjosestartups.com
sbf441.com scanner-irvin.top
scanner-olga.top schalke04fc.info
scripted.com scoopquest.com
search-error.com scrapinghub.com
security60-e.com searchengineranker.email
segol.tv seeingmeerkat.com
sell-fb-group-here.com seo-smm.kz
seokicks.de seofied.com
seolab.top
seorankinglinks.us seorankinglinks.us
seryeznie-znakomstva.ru sex-pr.net
sexstream.pl shama-rc.net
sexytrend.ru shtaketniki.ru
share-buttons-for-free.com silverage.ru
sharebutton.net siteripz.net
shopwme.ru skutecznetabletkinaporostwlosow.pl
sigmund-freud.co.uk slimcdn.com
skyway24.ru sneakyboy.com
sledstvie-veli.net soaksoak.ru
snegozaderzhatel.ru social-vestnik.ru
snip.tw socialbookmarksubmission.org
snworks.com socialseet.ru
soc-econom-problems.ru soft-terminal.ru
soc-proof.su soheavyblog.com
sockshares.tv songoo.wz.cz
softonicads.com soserfis.com
softtor.com sovinsteel.ru
sortthemesitesby.com spabali.org
spb.ru spidtest.org
speechfoodie.com sport7777.net
spidtest.space spravka-medosmotr.ru
spitfiremusic.com spy-app.info
sport-video-obzor.ru stairliftstrue.com
sports-supplements.us statistici.ro
sps-shop.com
spymac.net
squidoo.com
srecorder.com
stal-rulon.ru
stockspmb.info stockspmb.info
stoki.ru stoki.ru
stpicks.com streamin.to
streetfire.net stroilka.info
stroymonolit.su students-cheapskate.ml
stuffpride.com sukirgenk.dvrlists.com
sugarlyflex.pw swingerseiten.com
sunflowerdrawingpaintings.blogspot.com symbaloo.com
superkanpo.com tackletarts.co
superoboi.com.ua tanieaukcje.com.pl
support.nopeas.sk tarad.com
svarkagid.com tecnoteakviareggio.it
swiped.su thecounter.com
swsociety.se thefotosgratis.eu
taximytishi.ru thegalerie.eu
tecspb.ru thetardistimes.ovh
telefonsexkostenlos.tk
terrafootwear.us
thejournal.ru
thepornsex.org
thesmartsearch.net
time-japan.ru
titslove.yopoint.in
tizanidine4mgstreetprice.blogspot.com tizanidine4mgstreetprice.blogspot.com
tizanidinestreetprice.blogspot.com tizanidine4mguses.blogspot.com
tizanidinevssoma.blogspot.com tizanidinedosage.blogspot.com
tmm-kurs.ru tizanidineformigraines.blogspot.com
toonfamilies.net tizanidinehcl2mg.blogspot.com
topmira.com tizanidinehcl4mgtablet.blogspot.com
torontoplumbinggroup.com tizanidineingredients.blogspot.com
tizanidinerecreationaluse.blogspot.com
tizanidinestreetvalue.blogspot.com
tonivedu.it
top10registrycleaners.com
topclickguru.com
torrentgamer.net torrentgamer.net
totu.info toursmaps.com
toyota.7zap.com track2.shop
track.deriv.com
trackmedia101.com trackmedia101.com
traffic-club.info trafaret74.ru
trion.od.ua trafficgenius.xyz
trudogolik.net trafficnetzwerk.de
tsstcorpcddvdwshbbdriverfb.aircus.com trafficreceiver.club
tuberkuleznik.ru trainoffend.ml
tubo360.com trkdf.com
tuckpointingmasonrysystems.com tvteleport.ru
turizm.bz twiclub.in
twelvevisionspartyofcolorado.com txxx.com
twodollarshows.com typer.one
twojebook.pl
uasb.ru uasb.ru
ucsol.ru uchebavchehii.ru
ultramart.biz ucoz.ru
umekana.ru ukr-lit.com
unisexjewelry.org ultimatesetnewfreeallsoftupgradesystems.pw
uroffer.link uptimechecker.com
vinylvault.co.uk ural-buldozer.ru
vkmusics.ru vbabule.net
voronezh.xrus.org vbtracker.net
vse-pesni.com vclicks.net
w7s.ru velen.io
wapsite.me veles.shop
wcb.su venerologiya.com
webkeyit.com viagraneggrx.com
wechatdownload10.com video-chat.love
wedding0venues.tk videospornogratisx.net
welcomeauto.ru viktoria-center.ru
wesharepics.com vkonche.com
whatistizanidinehclusedfor.blogspot.com vpnmouse.com
whatsappbot.flyland.ru vrnelectro.ru
whatsappdownload10.com vrotike.ru
vykup-avto-krasnodar.ru
vzubah.com
warezkeeper.com
watch-movies.ru
waterpurifier.club
waysbetter.cn
webmonetizer.net
webradiology.ru
weburlopener.com
weclipart.com
westvilletowingservices.co.za
where-toget.com
williamrobsonproperty.com
wingsofrefuge.net wingsofrefuge.net
woodyguthrie.se wma-x.com
wowas31.ucoz.ru woman-h.ru
woweb.com.ua womens-journal.net
www.888.com wonderfulflowers.biz
works.if.ua
wpsecurity.website
wstroika.ru
www.solartek.ru www.solartek.ru
xedserver.com xcombear.ru
xep.info xgftnlrt.bloger.index.hr
xgames-04.com xjrul.com
xlovecam.com xn----itbkqkfiq.xn--p1ai
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80aikhbrhr.net xn--hxazdsfy.blogspot.com
xn--80ajbshivpvn2i.xn--p1ai xolodremont.ru
xn--80atua3d.xn--p1ai xvideosporn.biz
xn--90acenikpebbdd4f6d.xn--p1ai xxxhdvideo.site
xn--l1aengat.xn--p1ai xxxkaz.org
xxxtube69.com xxxnatelefon.ru
youtube-downloader.savetubevideo.com xz618.com
zacreditom.ru yogamatsexpert.com
zastenchivosti.net yougotanewdomain.com
zawyna.ua z-master.ru
zdesoboi.com zaapplesales.blogspot.com
zebradudka.com zambini.ru
zeikopay.com zeroredirect1.com
zeroredirect7.com zeroredirect6.com
zooggames.com zigarettenonlinekaufen1.blox.pl
zygophyceous.womanstars.site zvetki.ru

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
2x2fan.ru 1kinobig.ru
aa8b68101d388c446389283820863176e7.com 2015god.org
aarbur.com 273-fz.ru
abwa.tk 2nt.ru
adconscious.com 4pp13.com
adultwebhosting.info 7xc4n.com
83net.jp
a96527gi.beget.tech
aa9bd78f328a6a41279d0fad0a88df1901.com
abclauncher.com
acunetix-referrer.com
admanaerofoil.com
advocatemsk.ru
adzerg.com
adzpower.com
afmuseum.com afmuseum.com
afslankpillen2017nl.eu aktivator-windows10.blogspot.com
agroeconom.kz akuhni.by
all4wap.ru alekseevec.ru
allfinweb.com alveris.ru
allproblog.com amateurmatch.com
am15.net animaltoplist.com
api.stathat.com ap.senai.br
applyneedy.xyz apibetweenlinesn-a.akamaihd.net
arendatora.ru apidiamondatanet-a.akamaihd.net
arquapetrarca.info apioasisspacenet-a.akamaihd.net
asrv-a.akamoihd.net arquivo.pt
astrochicks.com artparquet.ru
atmagroup.ru asophoto.com
automobile-spec.com atley.eu.pn
avtointeres.ru aviva-limoux.com
bala.getenjoyment.net azbuka-mo.ru
best-deals-products.com bank.uz
bestofupload.info bankcrediti.ru
bestwaystogetpaid.us bavsac.com
betterhdporn.com besttorrentknifta.weebly.com
big-boards.info bscodecs.com
bigcities.org btnativenav.com
bioinnovate.co btvn.ru
bird1.ru bukleteg.xyz
blue-square.biz cacheimages.com
bosman.pluto.ro cartechnic.ru
brandov.ru cartiertrinity.xyz
browsepulse-a.akamaihd.net cdncash.net
bumble.cheapwebsitehoster.com cheapwebsitehoster.com
buydissertation.net children-learningreading.info
cakesplus.com.au cialischmrx.com
camel-beach.com clayvasedesigns.tk
canoncdriverq3.pen.io club-samodelkin.ru
cejewelry.xyz commoncrawl.org
co.lumb.co compliance-elena.xyz
connectingsingles.com compliance-jack.top
construmac.com.mx compliance-john.top
cookie-law-enforcement-hh.xyz coprofam.org
coolingoods.com cornerstone-countertops.com
countbertwistdisp26.soup.io counterbot.com
customcatchcan.com countercrazy.com
cwetochki.ru cpajunkies.com
dangphoto.trade custodieva.ru
dawlenie.com custom-electric-guitar.com
dealighted.com data1.scopich.com
dev33.dioniqlabb.se daymusam.com
discovertreasurenow.com decenttools.com
dojki365.online deda-moroza-zakaz.ru
dollartree.info detskie-konstruktory.ru
drivotracker.com detskie-zabavi.ru
drugspowerstore.com digital-video-processing.com
domaineaneblanc.com
dtnlyss.com dtnlyss.com
duawitchrarato.tk edwinkonijn.com.au
dvr.biz.ua efkt.jp
eas-seo.com eleimgo.pw
efnor-ac.com elektroniksigaraankara.info
elektrozigaretten1.webs.com energydiet-info.ru
elexies.info
en.altezza.travel
ereko.ru ereko.ru
erotik0049.com excaliburfilms.com
etm-consult.de exoclick.com
eugenevaultstorage.com ezigarettenshop2.myblog.de
evrotekhservis.ru ezrvrentals.com
f00kclan.de
fable.in.ua
falopicm.pw falopicm.pw
filmgo.ru fanrto.com
forex.osobye.ru farm26.ru
franch.info fickkontakte.org
franklinfire.co firma-legion.ru
free-traffic.xyz focalink.com
forex-procto.ru
forum-engineering.ru
freshwallpapers.info
fuckbuddybestgilf.info
fullfileaccess.com fullfileaccess.com
fyl.com.ru gamezblox.com
gaming-journal.com gg.zzyjxs.com
geilehausfrauen.net globetrotting-culture.ru
go2mike.ru go2album.com
gopro-online.info gosreg.amchs.ru
gox.com.ua gov.yanao.ru
grizzlysgrill.com graphid.com
gsasearchengineranker.space gsasearchengineranker.space
gungamesz.com guruofcasino.com
hanwei.us healthcarestore.info
help.tpu.ru hitcpm.com
himazin.info home-task.com
historichometeam.com
homemature.net homemature.net
hostnow.men housekuba.org
hostsshop.ru hoverboardforsaledirect.com
hotdl.in hustoon.over-blog.com
i-hobot.ru imagefinder.site
ie.57883.net infowarcraft.ru
intim-uslugi.info internetartfair.com
intimshop-fantasy.ru inzn.ru
ipornox.xxx iwantmyfreecash.com
iqbazar.ru japfm.com
jamiembrown.com jbl-charge.info
johnnyhaley.top johnnyhaley.top
jwss.cc jumptap.com
kalandranis.gr kazrent.com
kamagragelusa.net ketoanhanoi.info
kerei.ru keywordbasket.com
keywordglobal.co.za komputers-best.ru
kinobaks.com kosova.de
kiprinform.com laxdrills.com
klejonka.info lflash.ru
konoplisemena.com lider-zhaluzi.kiev.ua
kunstaktien.info lietaer.com
larutti.ru likrot.com
lincolntheatre.com magicdiet.gq
linerdrilling.com mahnwachen-helfen.info
lion.playtap.us mastershef.club
lirunet.ru mcadamssupplyco.com
losangeles-ads.com mcnamaratech.com
lostfilm-online.ru mebelcomplekt.ru
luciddiagnostics.in mega-bony-2017.pl
lumb.co minet.club
medicine-4u.org mole.pluto.ro
meteocast.net motherboard.vice.com
microstatic.pl muzaporn.com
minecraft-neo.ru myindospace.com
mmostrike.ru newstudio.tv
mncrftpcs.com nikitabuch.com
mobifunapp.weebly.com nina.az
mojaocena.com nw-servis.ru
monsterdivx.tv offers.bycontext.com
mosrif.ru ok.ru
moviemail-online.co.uk olgacvetmet.com
mtmtv.info onlainbesplatno.ru
multgo.ru online247.ml
mydeathspace.com openmultipleurl.com
mypets.by optom-deshevo.ru
nastydollars.com p-business.ru
net-radar.com pagesense.com
nextbackgroundcheck.gq peugeot-club.org
ngps1.ru physfunc.ru
nofreezingmac.click piluli.info
nordvpn.com pix-hd.com
nottyu.xyz plastjulgranar.se
offtime.ru poem-paying.gq
openmediasoft.com pornogad.com
ordernorxx.com pornophoto.xyz
orsonet.ru pornowarp.info
ovirus.ru portadd.men
partner-high.men predmety.in.ua
pc-test.net prohoster.info
picsforkeywordsuggestion.com promodj.com
pinstake.com pronekut.com
piter.xrus.org prostitutki-tolyatti.org
pk-services.ru prostitutki-yaroslavlya.org
poligon.com puzzleweb.ru
popmarker.com quickcashlimited.com
poquoson.org rankia.com
porndairy.in rankings-analytics.com
porno-home365.com redirect.trafficreceiver.club
pornotubexxx.name rethinkwasteni.info
princeadvantagesales.com reyel1985.webnode.fr
prostitutki-novgoroda.org roofers.org.uk
prostitutki-rostova.org rossmark.ru
pst2017.onlinewebshop.net saletool.ru
pts163.ru samara.rosfirm.ru
rangoman.date sbwealthsolutions.ca
rankscanner.com sc-specialhost.com
refudiatethissarah.info scanner-alex.top
remont-mobile-phones.ru scanner-walter.top
remont-ustanovka-tehniki.ru scanspyware.net
resellerclub.com scopich.com
rocis.site searchimage.co
rubanners.com seminarykansas904.ml
ruscopybook.com serviporno.com
sabizonline.com sexcamamateurchat.com
saddiechoua.com shopsellcardsdumps.com
scmor.ilxc.cc si-unique.com
score-ads.men signx.info
screentoolkit.com skyway24.ru
sdelai-prosto.ru sloopyjoes.com
searchinterneat-a.akamaihd.net slowmacfaster.trade
searchmywindow-a.akamaihd.net soc-econom-problems.ru
seo-smm.kz social-button.xyz
seoboxes.com speechfoodie.com
sexspornotub.com sprttrack.com
sexy-pings.com studiofmp.com
sfj-ror.no supervesti.ru
shakhtar-doneck.ru td-33.ru
shikiso.info tdsing.ru
sivs.ru teguh.info
smartpet.ru tetracsaudi.com
snjack.info thaisamkok.com
snowplanes.com thepornsex.org
socialseet.ru tizanidineandcipro.blogspot.com
sonnikforme.ru tizanidineshowupondrugtest.blogspot.com
soochi.co tkanorganizma.ru
spb-plitka.ru topvidos.ru
spin2016.cf tradedeals.biz
sptslmtrafms.com traffic2money.com
spyfu.com trafficnetzwerk.de
star61.de trailer.cinemaflix.website
stillmiracle.com tubo360.com
stroyhelp-dv.ru tversvet.ru
subj.ukr-lit.com typimga.pw
sugarkun.com ublaze.ru
svnuppsalaorebro.se ukrup.com
telefonsex-ohne0900.net underthesite.com
templates.radiodigital.co univerfiles.com
thfox.com v720hd.ru
thiegs.reco.ws vacances-voyages.info
timdreby.com vereo.eu
tizanidinehcl4mgtab.blogspot.com vgoloveboli.net
tonerbox.kz via-gra.webstarts.com
top10-online-games.com video-chat.in
torrentdownloadhub.com vip-parfumeria.ru
toursmaps.com vip2ch.com
trafficmonetize.org vostoktrade.info
trahic.ru webkeyit.com
tt-ipd.info webtherapy.ru
vbtracker.net weddingdresses.xyz
videos-for-your-business.com wildnatureimages.com
vigrx-original.ru www.888.com
vuclip.com xedserver.com
wait3sec.org xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
wallpapers-best.com xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
wardreapptokone.tk xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai
waysbetter.cn xn--80ak6aa92e.com
web-analytics.date xn--d1acah0c.xn--p1ai
weblo.com yadro.ru
webscouter.net yginekologa.com
whereiskentoday.com youdesigner.kz
word-vorlagen.net ytmnd.com
word-vorlagen.xyz zeroredirect11.com
wurr.voila.net zkjovpdgxivg.ga
www.ehscloud.cn znaniyapolza.ru
xchangetrak.com zvooq.eu
xep.info
xn----7sbifcamovvfggw9d.xn--p1ai
xn----itbkqkfiq.xn--p1ai
yaaknaa.info
yaminecraft.ru
yellowstonevisitortours.com
yoluxuryevents.com
yourads.website
youtubologia.it
youtuhe.com
zhorapankratov7.blogspot.com
zryydi.com
zs2vm.top

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.113 0; 10.1.1.31 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3135 ### Version: V4.2022.05.3136
### Updated: Sun May 29 22:01:19 UTC 2022 ### Updated: Mon May 30 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.05.3135 ### Version: V4.2022.05.3136
### Updated: Sun May 29 22:01:19 UTC 2022 ### Updated: Mon May 30 10:03:31 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##