vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2909 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-10 10:09:36 +00:00
parent e8ab943e48
commit 8a25c1eefa
46 changed files with 90768 additions and 90768 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2908 #### Version: V4.2022.02.2909
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2908 #### Version: V4.2022.02.2909
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2908 #### Version: V4.2022.02.2909
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11210
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2908 #### Version: V4.2022.02.2909
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11214
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11214
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11214
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11214
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2908 2909

11214
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11214
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.234.213.132 0; 52.183.99.70 0;

11214
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

11214
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.234.213.132 0; 52.183.99.70 0;

11214
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.234.213.132 0; 52.183.99.70 0;

11214
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 1; 10.1.0.48 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Backlink-Ceck Buddy
LinksManager CopyRightCheck
Lipperhey Extreme Picture Finder
Magnet Ezooms
Microsoft URL Control Mata Hari
Msrabot Mojeek
Netvibes T8Abot
Spbot Telesphorep
netEstate NE Crawler VB Project
zgrab WebBandit

318
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider
404checker 404checker
80legs ASPSeek
ADmantX
Aboundex Aboundex
Aboundexbot Alexibot
AfD-Verbotsverfahren AllSubmitter
AhrefsBot Aspiegel
Aipbot
Alligator
Anarchie
Anarchy
Ankit
Anthill
Asterias Asterias
Atomseobot
Attach Attach
BLEXBot AwarioRssBot
BackWeb AwarioSmartBot
Badass BDFetch
Bigfoot BackStreet
Bitacle BacklinkCrawler
Barkrowler
BetaBot
BlackWidow BlackWidow
BlowFish Blackboard
Blow
Boardreader
Bolt
BotALot BotALot
Brandprotect
Buck
Buddy Buddy
CATExplorador BuiltBotTough
Calculon BuiltWith
CazoodleBot BunnySlippers
Cegbfeieh CCBot
CODE87
CheTeam
CheeseBot CheeseBot
Chlooe
Cloud mapping
Cocolyzebot Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crescent
CrunchBot
Curious Curious
DatabaseDriverMysqli DSearch
DataCha0s
Demon Demon
Deusu
Devil Devil
DigitalPebble Dirbuster
Disco Discobot
Discoverybot Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
Download Wonder DomainAppender
Drip DomainCrawler
ECCP/1.0 DomainSigmaCrawler
EasyDL DomainStatsBot
EroCrawler Domains Project
Evil Dragonfly
Express WebPictures EMail Siphon
Extractor EMail Wolf
Ecxi
EirGrabber
Extreme Picture Finder
EyeNetIE
FDM FDM
FHscan Fimap
Firefox/7.0 FlashGet
Flunky Flunky
Freeuploader Foobot
FrontPage
Fuzz Fuzz
FyberSpider FyberSpider
Fyrebot Fyrebot
Genieo Genieo
GetRight
GetWeb GetWeb
Go-Ahead-Got-It Go!Zilla
GoZilla
Gotit
GrabNet
Grabber Grabber
GrapeFX
GridBot
HEADMasterSEO HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HaosouSpider HaosouSpider
Harvest Harvest
Havij
Humanlinks
IDBTE4M IDBTE4M
Id-search Iblog
Image Fetch Image Sucker
IndeedBot IndeedBot
Indy Library InfoTekies
InfoNaviRobot Intelliseek
InternetSeer InternetSeer
Iskanie Iria
IstellaBot
JOC Web Spider JOC Web Spider
JamesBOT Jbrofuzz
JennyBot JennyBot
Jetty Jetty
Jorgee Joomla
Kenjin Spider Keyword Density
Kozmosbot Kinza
LNSpiderguy
Lanshanbot Lanshanbot
LexiBot LexiBot
Lftp
LibWeb LibWeb
LinkScan Lightspeedsystems
Linkbot Linkdexbot
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker Ltx71
MFC_Tear_Sample MIDown tool
MSFrontPage MSFrontPage
Magnet MTRobot
Majestic12 Mail.RU_Bot
MarkMonitor MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
MeanPath Bot MauiBot
Meanpathbot Mb2345Browser
Mediatoolkitbot MicroMessenger
MegaIndex.ru Microsoft Data Access
Metauri Microsoft URL Control
Minefield Moblie Safari
NPbot Mojolicious
NearSite Msrabot
NetSpider Musobot
NetZIP NICErsPRO
NimbleCrawler Name Intelligence
Nimbostratus Navroad
Net Vampire
NetLyzer
NetMechanic
Nikto
Nmap Nmap
Nuclei
Nutch
Offline Explorer Offline Explorer
Offline Navigator Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
OpenVAS PHPCrawl
PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer Page Analyzer
PageGrabber
Pandalytics
Panscient
Papa Foto
Pavuk Pavuk
Pi-Monster Petalbot
Pimonster PictureFinder
Piepmatz
Pixray Pixray
Pockey
Psbot Psbot
PxBroker PyCurl
Quick-Crawler QueryN Metasearch
RankActiveLinkBot Rankivabot
RankFlex RankurBot
RankingBot2
ReGet
RebelMouse RebelMouse
Recorder Recorder
SEOkicks-Robot RedesScrapy
SMTBot RocketCrawler
SalesIntelligent Rogerbot
Scanbot SBIder
SEOlyticsCrawler
ScoutJet ScoutJet
Scrapy Scrapy
ScreenerBot Screaming
ScrepyBot
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice SemanticJuice
SemrushBot SemrushBot
SiteCheckerBotCrawler Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer SiteExplorer
Sitevigil SiteLockSpider
Sitebeam
SlySearch SlySearch
Snake SmartDownload
Snapbot Snapbot
Sociscraper Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot SpankBot
Spbot Spbot
Spinn3r SputnikBot
Sqworm Sqlmap
Sucuri Swiftbot
Surfbot T8Abot
Szukacz Teleport
T0PHackTeam
TeleportPro TeleportPro
Telesphoreo The Intraformant
TheNomad TheNomad
Tracemyfile Thumbor
Trendiction Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus Typhoeus
URLy Warning
URLy.Warning URLy.Warning
UnisterBot
Upflow Upflow
VB Project V-BOT
Vacuum Vacuum
VelenPublicWebCrawler Virusdie
VidibleScraper
Voltron Voltron
WASALive-Bot WWW-Mechanize
WISENutbot
WWW::Mechanize WWW::Mechanize
WWWOFFLE Wallpapers
Web Collage Wallpapers/3.0
Web Enhancer WallpapersHD
Web Fetch Web Auto
Web Sauger Web Pix
Web Sucker WebCollage
WebEnhancer WebImageCollector
WebFetch
WebGo IS
WebPix WebPix
WebSauger WebSauger
Webalta WebSucker
WebsiteExtractor Webshag
WebsiteQuester WebsiteQuester
Xaldon_WebSpider Whack
YoudaoBot WinHTTrack
Zermelo WiseGuys Robot
Zeus Xenu
ZmEu Zade
ZoominfoBot
ZumBot ZumBot
arquivo-web-crawler arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler cognitiveseo
crawler4j crawler4j
domainsproject.org evc-batch
facebookscraper facebookscraper
internetVista monitor
isitwp.com isitwp.com
lwp-request iubenda-radar
lwp-trivial
magpie-crawler magpie-crawler
netEstate NE Crawler meanpathbot
oBot mediawords
pcBrowser muhstik-scan
ripz
s1z.ru s1z.ru
satoristudio.net
scalaj-http scalaj-http
scan.lol
seocompany.store seocompany.store
seostar seostar
serpstatbot
sexsearcher sexsearcher
sitechecker.pro
siteripz siteripz
sysscan sogouspider
trendiction.com sp_auditbot
trendiction.de
ubermetrics-technologies.com ubermetrics-technologies.com
webgains-bot webmeup-crawler
x22Mozilla webprosbot
zauba.io xpymep1.exe
zgrab zgrab

308
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
404checker 404enemy
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot Aboundexbot
Acunetix AiHitBot
AfD-Verbotsverfahren
Aipbot Aipbot
AllSubmitter AlphaBot
Anarchy
Anthill
Apexoo Apexoo
Aspiegel Aspiegel
AwarioRssBot Asterias
AwarioSmartBot Attach
BBBike BBBike
BDCbot
BackDoorBot BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass Bandit
BetaBot Bitacle
BlackWidow
Blow Blow
Boardreader
Bolt Bolt
BotALot Brandprotect
CCBot Buddy
BuzzSumo
CODE87
CazoodleBot
Cegbfeieh
CensysInspect CensysInspect
CheTeam CheeseBot
ChinaClaw Chlooe
Citoid Citoid
Claritybot Cocolyzebot
Collector
CopyRightCheck CopyRightCheck
Craftbot
Crescent Crescent
CrunchBot CrunchBot
Curious
Custo Custo
CyotekWebCopy DSearch
DBLBot Devil
DIIbot Dirbuster
Demon
Digincore
Discobot Discobot
Discoverybot DittoSpyder
DomainAppender DomainAppender
DomainSigmaCrawler DomainCrawler
Domains Project DomainStatsBot
Dotbot Dotbot
Dragonfly EMail Siphon
ECCP/1.0
EMail Wolf EMail Wolf
EasyDL
Evil
Exabot Exabot
EyeNetIE Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
FemtosearchBot
Firefox/7.0
Flunky
Freeuploader Freeuploader
FrontPage
Fuzz
FyberSpider FyberSpider
Fyrebot GetRight
G-i-g-a-b-o-t GoZilla
GermCrawler
Getintent
Gotit Gotit
GrabNet GrabNet
Grafula Grafula
GrapeshotCrawler GrapeFX
HEADMasterSEO
HMView HMView
HTMLparser HTMLparser
HTTP::Lite
Haansoft Haansoft
HaosouSpider
Harvest
Havij Havij
Heritrix
HonoluluBot HonoluluBot
Humanlinks
HybridBot HybridBot
IDBot
IRLbot
Id-search Id-search
Image Fetch Image Fetch
Image Sucker
IndeedBot IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
InternetSeer InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz Joomla
JetCar
JikeSpider
Jorgee Jorgee
JustView
Jyxobot Jyxobot
Kenjin Spider
Keyword Density Keyword Density
Kinza LNSpiderguy
Kozmosbot Leap
LibWeb Libwhisker
LieBaoFast LieBaoFast
Linkbot
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lmspider Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot MJ12bot
MSFrontPage MQQBrowser
Mag-Net MTRobot
Magnet Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot Meanpathbot
MegaIndex.ru Mediatoolkitbot
Metauri
Mister PiX
Mojeek Mojeek
Morfeus Fucking Scanner Mojolicious
Mozlila Musobot
NPbot
Name Intelligence
Navroad Navroad
NearSite
Net Vampire
NetAnts
NetLyzer NetLyzer
NetMechanic NetMechanic
NetSpider NetSpider
Netcraft
Netvibes
NextGenSearchBot NextGenSearchBot
Nutch Niki-bot
Nimbostratus
Ninja
Not
Nuclei
Offline Explorer Offline Explorer
OrangeBot OpenVAS
PECL::HTTP Openvas
PHPCrawl OrangeSpider
POE-Component-Client-HTTP OutfoxBot
Page Analyzer Panscient
PageThing.com Papa Foto
PeoplePal Petalbot
Picsearch Picscout
Piepmatz
Pimonster Pimonster
Pixray Probethenet
Psbot Psbot
Pump Pu_iN
PyCurl PxBroker
QueryN Metasearch QueryN Metasearch
RankActiveLinkBot
RankFlex RankFlex
Reaper RankingBot2
RepoMonkey RebelMouse
Recorder
Ripper Ripper
SBIder SEOprofiler
SEOstats SISTRIX
SalesIntelligent
ScrepyBot
Searchestate Searchestate
Semrush SearchmetricsBot
SemanticJuice
SemrushBot SemrushBot
Shodan Seomoz
Site Sucker
SiteCheckerBotCrawler SiteCheckerBotCrawler
SiteExplorer
SiteSucker SiteSucker
SlySearch Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sogou web spider Sogou web spider
Sosospider Sosospider
Sottopop SpaceBison
SpankBot Spammen
Spanner Stripper
SputnikBot
Sqworm
Steeler
Sucker
Sucuri
SuperBot SuperBot
SuperHTTP Telesphoreo
SurveyBot Thumbor
Suzuran TightTwatBot
Swiftbot
T0PHackTeam
Teleport
Titan
Toata Toata
Tracemyfile Toweyabot
Trendiction Trendiction
Trendictionbot
True_Robot
TurnitinBot TurnitinBot
Typhoeus TwengaBot
URLy Warning URLy.Warning
V-BOT
VB Project VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper VidibleScraper
VoidEYE Virusdie
Voltron Voltron
WASALive-Bot
WEBDAV
WISENutbot WISENutbot
WWWOFFLE WPScan
Web Auto Wallpapers/3.0
WeSEE
Web Collage
Web Fetch Web Fetch
Web Fuck
Web Pix
Web Sucker Web Sucker
WebBandit WebAuto
WebCollage WebEnhancer
WebCopier
WebFetch
WebFuck
WebImageCollector WebImageCollector
WebLeacher WebZIP
WebPix WebmasterWorldForumBot
WebReaper Website Quester
WebSauger Whack
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
Whacker Whacker
Whatweb Whatweb
Widow
WiseGuys Robot WiseGuys Robot
Wprecon Woobot
Xaldon WebSpider Xaldon WebSpider
YoudaoBot Zauba
Zade
Zeus
ZoominfoBot
ZumBot ZumBot
ZyBorg adscanner
arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider clark-crawler
check1.exe coccocbot-web
crawler.feedback cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j crawler4j
dataforseo.com
demandbase-bot demandbase-bot
eCatch eCatch
evc-batch
facebookscraper facebookscraper
gopher gopher
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
meanpathbot meanpathbot
netEstate NE Crawler pcBrowser
oBot
polaris version
probe-image-size probe-image-size
scalaj-http ripz
scan.lol seobility
seocompany.store
seostar
serpstatbot serpstatbot
sitechecker.pro sitechecker.pro
siteripz voyagerx.com
spyfu webmeup-crawler
tAkeOut
webpros.com
webprosbot webprosbot
x09Mozilla x09Mozilla
xpymep1.exe
zauba.io zauba.io
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
angkortours.vn artparquet.ru
deanmoore.ie atout-energie-69.com
div.as courtshipgift.com
gobongo.info cpabegins.ru
mezaruk.info damedingel.ya.ru
promoforum.ru game-top.su
shop.xz618.com nuup.info
solution4u.com stroy-portal22.ru
strangeduckfilms.com surgut.zrus.org
strfls.com tourcroatia.co.uk

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com
00webcams.com 00webcams.com
03p.info 01apple.com
0c47f8422d3f.com 0n-line.tv
1008.su 1-free-share-buttons.com
100dollars-seo.com 101raccoon.ru
100searchengines.com 12masterov.com
123cha.com 13tabs.com
178evakuator178.ru
1adult.com 1adult.com
1stat.ru 1webmaster.ml
1xbet4you.com 2015god.org
256bit.by 256bit.by
2drittel.de 34.gs
2x2fan.ru 4kplayer.pl
3w24.com 4webmasters.com
4webmasters.org 8xv8.com
5000-cotydzien.com a14download.com
7yue.org aa81bf391151884adfa3dd677e41f94be1.com
8lufu.com aa8780bb28a1de4eb5bff33c28a218a930.com
a.pr-cy.ru above.com
aad1f4acb0a373420d9b0c4202d38d94fa.com abovetherivernc.com
absolutelyanalog.com adexprts.com
abtasty.com adloads.net
adktrailmap.com adman.se
ads-seo.men ads.gold
adsloads.com adultactioncam.com
adult-shop.com.ua
adultmeetonline.info adultmeetonline.info
adzpower.com aero2.ru
aerogo.com affiliate-fr.com
afslankpillen2017nl.eu alienwheel.es
ahhjf.com
akusherok.ru
albamargroup.com
all-number.com all-number.com
allproblog.com alldubai.biz
allstatesugarbowl.org allfinweb.com
alphaforum.ru altamayoztourism.com
alvtank.se amazon-adsystem.com
amateurmatch.com amospalla.es
animenime.ru angkortours.vn
apessay.com anti-virus-removal.info
antons-transporte.de
apiadanaknet-a.akamaihd.net apiadanaknet-a.akamaihd.net
apibetweenlinesn-a.akamaihd.net apiappenableinfo-a.akamaihd.net
apioasisspacenet-a.akamaihd.net apibrowsesmartne-a.akamaihd.net
apisecretsaucebi-a.akamaihd.net arcadeplayhouse.com
app-ready.xyz arcteryxstore.online
appiq.mobi asmxsatadriverin.aircus.com
apple.com-webbrowsing-security.review asseenontvonline.ru
arabgirls.adultgalls.com atlant-auto.info
arcadepages.com
asophoto.com
asscenihotosidea.blogspot.com
atofilms.com
aussie-prizes.com aussie-prizes.com
aviav.ru autoblogger24.info
avon-severozapad.ru automobile-spec.com
azarttoto.com autowebmarket.com.ua
azbuka-mo.ru aviapanda.ru
azlex.uz babyfactory.fr
balois.worldbreak.com bankmib.ru
bangla-chat-uk-paralud.ga bannerads.de
baoxaydung.com.vn
beauby.ru
beauty-b0x.pl
beauty-bracelet.com
berdasovivan.ru
best-coupon-offer.com
best-seo-solution.com best-seo-solution.com
bestcoin.cc
bestdraws.com bestdraws.com
bestpriceninja.com besthomemadepornsites.com
betteroffers.review bg6s0.com
bget.ru biglistofwebsites.com
bigcareer.info bigpenisguide.com
billiard-classic.com.ua
bimatoprost-careprost.com
binaryoptionscops.info
bingoporno.com bingoporno.com
biteg.xyz boc.kz
bizcheapjerseyswholesalechina.com bonux.nextview.ru
blogs.rediff.com bonzbuddy.com
blue-square.biz brk-rti.ru
bmw.afora.ru browsepulse-a.akamaihd.net
boazpower.com cablecar.us
bobba.dzaba.com callmd5map.com
bonzibuddi.com camel-beach.com
book-bets.com
bracketsmackdown.com
breget74.ru
browserprotecter.com
btc4u.ru
btnativenav.com
buehne-fuer-menschenrechte.de
cah.io.community
cakesplus.com.au
calc-for-credit.ru
camdolls.com
candycrushshop.com candycrushshop.com
capsderfudd.tk canyougethighofftizanidine.blogspot.com
carloans.com cb.iphantom.com
cartierlovestore.com cdnnetwok.xyz
casinos4dummies.co.uk centraletermice.us
cbb1smartlist12.click cercacamion.it
cdncash.org cheap-trusted-backlinks.com
cellfun.mobi cheapmarmot.online
cenokos.ru check-this-out-now.online
centrumcoachingu.com chinacheapelitejerseys.com
ceotrk.com chocolateslim-u-srbiji.com
christianlouboutinreplica.pw chorus.terakeet.com
christianlouboutinreplica.win cjmc.info
chuckguilford.com clickbank.net
cialis-samples.com clicksotrk.com
clothesforcash.com clips.ua.ac.be
compliance-fred.top clubfashionista.com
compliance-ivan.xyz communisave.co.za
compliance-alexa.xyz
compliance-andrew.xyz
compliance-checker-7.info
compliance-checker.info
compliance-fred.xyz
compliance-george.xyz
compliance-mary.top compliance-mary.top
compliance-viktor.top connectingsingles.com
conocer-sanabria.com connectionstrenth.com
coprofam.org cookie-law-enforcement-hh.xyz
credit-online.ws coolgramgoods.com
credit-respect.ru cottageofgrace.com
culmimg.pw cougfan.info
d2jsp.org creditnation.ru
dailystrength.org crest-poloski.ru
daneshetabiat.com cutt.us
data1.scopich.com dairyindia.in
decenttools.com damasarenai.info
depositfiles-porn.ga daptravel.com
detskie-konstruktory.ru darmebel.com.ua
dfwu1013.info db.speedup.gdn
diminishedvalueoforegon.com dekorkeramik.ru
discovertreasure-a.akamaihd.net dengi-pod-zalog-nedvizhimosti.ru
dktr.ru descargar-musica-gratis.net
doctormakarova.ru dispo.de
dolohen.com djihispano.com
domainanalyzing.xyz dnepr-avtospar.com.ua
dosug-lux.ru dodlive.mil
domoysshop.ru
doublepimp.com
doyouknowtheword-flummox.ml doyouknowtheword-flummox.ml
drupa.com earn-from-articles.com
easyukraine.com easync.io
ebonyporn.site easytuningshop.ru
ecommerce-seo.org editmedios.com
eets.net elektrischezigarette2.devhub.com
ege-essay.ru elektrozigaretten2.yn.lt
electricwheelchairsarea.com eloxal.ru
elektrischezi.canalblog.com enpolis.ru
elektrischezigarette1.blog.pl ero-advertising.com
elektronischezigarette2.mex.tl erotikstories.ru
elektronischezigarettekaufen1.beeplog.com erotische-geschichten-xxl.com
elektrozigarette1.dreamwidth.org event-tracking.com
elektrozigarettekaufen1.devhub.com ewebarticle.info
elektrozigaretten1.tumblr.com
eorogo.top
erotikchat-24.com
everflora.ru
exhibitionplus.eu exhibitionplus.eu
exonline.info ezigaretteshop.webs.com
extractorandburner.com famix.xyz
ezigaretteshop2.vefblog.net fastfixing.tech
f00kclan.de feel-planet.com
fakehandbags.xyz femdom.twiclub.in
familyholiday.ml ferretsoft.com
fast-torrent.ru findthe.pet
fatmaelgarny.com firstsiteguide.com
fickenbumsen.net
film-one.ru
filmi-onlain.info
findanysex.com
flagcounter.me flagcounter.me
fok.nl footballfarrago.com
folowsite.com fotopop.club
forex.osobye.ru freelotto.com
forodvd.com freshwallpapers.info
foto-weinberger.at freza-sverlo.ru
fototravel.eu fun-mobi.pl
funtoonez.com fungamelands.com
fxund.us fungirlsgames.net
gael-s.ru funponsel.com
gallerylisting.com fyl.com.ru
gamblingnerd.com gamblingnerd.com
gaming-journal.com game-top.su
gateway.zscalerone.net game300.ru
gavuer.ru ge0ip.org
ge0ip.net geile-lelly.eu
gg.zzyjxs.com geileweiber.tk
ghostvisitor.com germetiki.com.ua
girlspicsa.com getoutofdebtfree.org
globatur.ru given2.com
golden-praga.ru goforexvps.com
gorodservis.ru gogps.me
greendream.com.ua goldenggames.com
groupmoney.ru googlepositions.com
grupografico-pilar.com.ar gotwebsite1.com
gsasearchengineranker.pw graphid.com
gsmlab.pl gribkovye-zabolevaniya.com
gta-top.ru guge.io
guidefs.ru hasshe.com
guitar-master.org haveinc.xyz
gwebtools.com.br hdfreeporno.net
gz2.bbsoldes.fr hdimagegallery.net
hamilton.ca hdimagelib.com
harmonyglen.us headpharmacy.com
hccoder.info healgastro.com
healthcarestore.info hermesbelts.xyz
help.tpu.ru hifidesign.ru
high-speed1.net hitsbox.info
highland-homes.com hoholikik.club
historichometeam.com host-protection.com
hit-men.men hoste.octopis.com
hledejvshopech.cz
hollywoodactress.info
home.myplaycity.com
hostnow.men
hotsocialz.com hotsocialz.com
huhn.altervista.org houtings.xyz
hunterboots.online i-service.kz
hustoon.over-blog.com iccornacircri.cf
i-midias.net.br ictizanidinehcl4mg.blogspot.com
ideibiznesa2015.ru ideoworld.org
ie.57883.net ilmexico.com
iflycapetown.co.za ilovevitaly.xyz
iideaidekonkatu.info imagine-ex.co
ilovevitaly.com imperiafilm.ru
imperia31.ru interesnie-faktu.ru
import-sales.com investyb.com
in-tandem.co invitefashion.com
incanto.in.ua irkutsk.zrus.org
intellego.info iscblog.info
investsuccess.org jimmychoosale.online
ivoiretechnocom.ci kchaxton.com
james13prix.info keyhantercume.com
jeremyeaton.co keywordbasket.com
job.icivil.ir keywords-monitoring-success.com
jobgirl24.ru
jofucipiku.tk
joy-penguin.com
kalandranis.gr
kareliatobacco.ru
kartiniresto.com
kenaba.su
keyword-suggestions.com
kidd.reunionwatch.com
kinocccp.net kinocccp.net
kndxbkdx.bloger.index.hr kiwi237au.tk
kollekcioner.ru kolotiloff.ru
kostenlos-sexvideos.com konoplisemena.com
kostenloser-sex.com kung-fu-ru.com
krasnodar.zrus.org kustanay.kz
kupit-adenu.ru labplus.ru
landinez.co lacapilla.info
lescinq.com ladov.ru
letmacworkfaster.site lalalove.ru
lider-zhaluzi.kiev.ua lancheck.net
lifehacĸer.com law-check-seven.xyz
liffa.ru letsrepair.in
limtu.ifmo.ru lexaprogeneric.link
linkdebrideur.xyz lida-ru.com
lion.bolegapakistan.com lifebyleese.com
lion.playtap.us loadopia.com
lockerz.com locationdesaison.com
losangeles-ads.com lsex.xyz
louboutinbooties.xyz lunamedia.co
lubetube.com m-google.xyz
luckyday.world macdamaged.tech
m0r0zk0-krava.ru macotool.com
mafa-free.com madot.onlinewebshop.net
mail.allnews24.in mailemedicinals.com
make-money-online.com mainhp.net
maladot.com makenahartlin.com
mamasuper.prom.ua mantramusic.ru
mansiondelrio.co mapquestz.us
manualterap.roleforum.ru maridan.com.ua
manyresultshub-a.akamaihd.net marketingvici.com
massage-info.nl massage-info.nl
masterseek.com masterseek.com
medispainstitute.com.au masturbate.co.uk
menhealed.net matchpal-a.akamaihd.net
michellblog.online mebel-ekb.com
medicines-choice.com
mere.host.sk
mesbuta.info
message-warning.net
meteocast.net
middlerush-a.akamaihd.net
militarysale.pro militarysale.pro
minharevisao.com millionare.com
mobstarr.com mobifunapp.weebly.com
moi-glazki.ru mobilemedia.md
monclercoats.xyz moesexy.com
monsterdivx.tv monclerboots.xyz
msk.afora.ru monclervests.xyz
musezone.ru mowser.com
mustat.com moz.com
myonigroup.com mrcsa.com.au
myperiod.club muschisexbilder.com
myplaycity.com mydearest.co
myra.top mydownlodablefiles.com
myshopmatemac.com myfreecams.com
mzdish.site mylesosibirsk.ru
nalogovyy-kodeks.ru nelc.edu.eg
nalogovyykodeks.ru nerudlogistik.ru
narkologiya-belgorod.ru
netvouz.com
new-apps.ru new-apps.ru
new7ob.com newfilmsonline.ru
nikkiewart.ru njkmznnb.ru
nomuos.it no-rx.info
nottyu.xyz nodding-passion.tk
novgorod.xrus.org nodup.ru
nvformula.ru nofreezingmac.click
nw-servis.ru notebook-pro.ru
ofanda.com nsatc.net
office-windows.ru nudepatch.net
okel.co obesidadealgarve.com
okout.ru obiavo.ru
oksrv.com oconto.ru
olgacvetmet.com offtopic.biz
omoikiri-japan.ru oneminutesite.it
onefilms.net onlainbesplatno.ru
onemactrckr.com online.ktc45.ru
online-hd.pl onlinefilmz.net
online-x.ru onlineserialy.ru
onlyforemont.ru openfrost.net
orel-reshka.net oralsexfilme.net
orhonit.com orenburg-gsm.ru
orsonet.ru orsonet.ru
outclicks.net ostroike.org
outrageousdeal-a.akamaihd.net outrageousdeal-a.akamaihd.net
outshop.ru ownshop.win
p-business.ru palocco.it
paceform.com palvira.com.ua
paramountmarble.co.uk parajumpersstore.online
partner-cdn.men pateaswing.com
partner-host.men pc4download.co
patol01.pw peekyou.com
paydayloanslocal.com pelfind.me
paydayonlinecom.com petrovka-online.com
pdns.download picquery.com
pekori.to pistonclasico.com
perl.dp.ua piulatte.cz
picphotos.net pizda.lol
picsearch.com pk-pomosch.ru
pix-hd.com pl.id-forex.com
placid-rounded-coast.glitch.me placid-rounded-coast.glitch.me
playboyfiles.xblog.in playboyfiles.xblog.in
plusnetwork.com poem-paying.gq
pobeiranie.pl pogodnyyeavarii.gq
poisk-zakona.ru pornofiljmi.com
poligon.com pornoforadult.com
pooleroadmedicalcentre.co.uk pornosmola.info
poptool.net poshiv-chehol.ru
pornobrazzers.biz postclass.com
pornogad.com pozdrawleniya.ru
pornotubs.com pr-ten.de
portnoff.od.ua pravoholding.ru
preconnubial.usuby.site preparevideosafesystem4unow.space
printie.com prizesbook.online
privat-girl.net prlog.ru
progress-upakovka.ru progress-upakovka.ru
promgirldresses.xyz
promoheads.com
prostitutki-belgoroda.org
pulse33.ru
puteshestvennik.com
pyramidlitho.webs.com
pyrodesigns.com.au pyrodesigns.com.au
qcstrtvt.bloger.index.hr q-moto.ru
quebec-bin.com rangoman.date
quick-offer.com rank-checker.online
quit-smoking.ga rasteniya-vs-zombi.ru
rankingchart.de ratemodels.net
rcb101.ru rcpmda.ikan1080.xyz
relatodelpresente.com.ar real-time-analytics.com
restaurantlescampi.com reeyanaturopathy.com
rewardpoll.com registrydomainservices.com
rezeptiblud.ru relayblog.com
ricorsogiustizia.org remontgruzovik.ru
ringporno.com responsive-test.net
robertefuller.com retailwith.com
rockprogblog.com retreatia.com
rogervivierforsale.com rightenergysolutions.com.au
rome2rio.com risparmiocasa.bz.it
roznica.com.ua rn-to-bsn.com
rucrypt.com robot-forex.biz
ruex.org.ua romhacking.ru
rukino.org rossmark.ru
ruscoininvest.company rubbed.us
rusexy.xyz runofilms.ru
russintv.fr rutor.group
ryetaw.com rvzr-a.akamaihd.net
saddiechoua.com sashagreyblog.ga
saecsa.co savetubevideo.com
sanatorrii.ru sax-sex.com
sankt-peterburg.nodup.ru scanner-george.top
satellite.maps.ilovevitaly.com scenarii-1-sentyabrya.uroki.org.ua
sbdl.no scrapinghub.com
sbwealthsolutions.ca seadragonherbery.com
sc-specialhost.com search-goo.com
scanner-mark.top search.pch.com
searchencrypt.com searchencrypt.com
searchwebknow-a.akamaihd.net
see-your-website-here.com see-your-website-here.com
serving.adbetclickin.pink segol.tv
sell-fb-group-here.com
seo-tools-optimizing.com
seoexperimenty.ru
serdcenebolit.com
service.adtech.us
sex-foto.pw
sex.hotblog.top
sexfreepornoxxx.com
sexkvartal.com
sexvideo-sex.com
sexyteens.hol.es sexyteens.hol.es
sherlock.se sexytrend.ru
shillyourcoins.com shinikiev.com.ua
shoesonlinebuy.cn
shopfishing.com.ua shopfishing.com.ua
shymkent.xkaz.org simple-image.com.ua
sims-sims.ru simplepooltips.com
sitebeam.net site-analyzer.com
sitopreferito.it skylta.com
smailik.org slim.sellany.ru
smartpet.ru slimcdn.com
snsdeainavi.info smartshoppymac.com
snts.shell-pmr.ru snip.to
social-buttons.com social-buttons.xyz
socialbookmarksubmission.org socialtrade.biz
softxaker.ru sophang8.com
sotechco.co space4update.pw
spb.ru spammen.de
speechfoodie.com sports-supplements.us
sptslmtrafms.com stanthonyscatholicchurch.org
spywareit.com stauga.altervista.org
ssconstruction.co staynplay.net
steelmaster.lv
sticken.co sticken.co
stmassage.ru strv.se
stpicks.com success-seo.com
streetfooduncovered.com sunflowerdrawingpaintings.blogspot.com
sugarlyflex.pw superkanpo.com
surgut.zrus.org supernew.org
taaaak.com svetlotorg.ru
tam-gde-more.ru taxi-v-eisk.ru
tech4master.com the-trader.net
testbotprocessor44.com thedownloadfreeonlinegames.blogspot.com
textads.men thfox.com
thaismartloan.com tizanidine6mg.blogspot.com
theallgirlarcade.com tizanidineandhydrocodone.blogspot.com
thegioixekhach.com tizanidineforopiatewithdrawal.blogspot.com
timdreby.com tizanidinehcl2mgtablet.blogspot.com
tizanidinehclsideeffects.blogspot.com tmearegion26.com
tizanidineorflexeril.blogspot.com tomatis.gospartner.com
tizanidinesideeffectsweightloss.blogspot.com toon-families.com
tizanidinesleepaid.blogspot.com toonfamilies.net
tmm-kurs.ru topanasex.com
top-l2.com torrnada.ru
torrent-newgames.com totu.info
tracfone.com track.deriv.com
trafficjunky.net traffic100.com
trafficmp.com triplepanda.xyz
traffictrade.life trkdf.com
trucri.me trucri.me
trudogolik.net
trustedmaccleaner.com
tuberkulezanet.ru tuberkulezanet.ru
turbodsp.com tubo360.com
ua-company.ru turizmus.us
ublaze.ru tvory.predmety.in.ua
ukkelberg.no udayavani.com
ukr-lit.com ultramart.biz
uni.me umityangin.net
upupa.net universals.com.ua
ussearche.cf urccvfmc.bloger.index.hr
uytmaster.ru urlopener.com
uzungil.com urzedowski.eu
v24s.net usacasino.com
vduplo.ru vbabule.net
vedomstvo.net vbikse.com
venta-prom.ru veerotech.com
vietimgy.pw velpanex.ru
vigrx-original.ru via-energy-cumpara.com
vip2ch.com video-woman.com
vipromoffers.com videochat.life
volume-pills.biz videojam.tv
wallpapers-best.com videonsk.com
watch-movies.ru vikistars.com
watchinf.com vipsexfinders.com
weclipart.com vipsiterip.org
wemedinc.com visa-pasport.ru
wesharepics.info vkmusics.ru
whatistizanidinehclusedfor.blogspot.com vtc.pw
wholesalecheapjerseysfree.com vvpg.ru
wholinkstome.com wait3sec.org
wineitudes.wordpress.com warningwar.ru
witherrom55.eklablog.fr waterpurifier.club
wowas31.ucoz.ru webs.com
www.888.com westum.se
www.event-tracking.com whiteelephantwellington.com
wholesalejerseys-cheapest.com
wholesalejerseyscheapjerseys.us.com
winx-play.ru
works.if.ua
worldoffiles.ru
wpsecurity.website
writersgroup580.web.fc2.com
ww1943.ru
www.ehscloud.cn
www.get-free-traffic-now.com www.get-free-traffic-now.com
xblog.in x-diesel.com
xblognetwork.com x-lime.com
xboxster.ru x-mix.info
xaijo.com
xchangetrak.com xchangetrak.com
xcombear.ru xgames-04.com
xmronta.com xkaz.org
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn----7sbifcamovvfggw9d.xn--p1ai
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
xn----9sbebi2bvzr7h.xn--p1ai xn----9sbebi2bvzr7h.xn--p1ai
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai xn----dtbndd4ae7eub.top
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai xn--d1abj0abs9d.in.ua
xn--b1agm2d.net xn--h1aakne2ba.xn--p1ai
xn--l1aengat.xn--p1ai xtube.com
xportvusbdriver8i.snack.ws yellowads.men
xtrafficplus.com yottos.com
xwatt.ru yourporngay.com
yellowfootprints.com
yellowstonevisitortours.com
yogamatsexpert.com
youresponsive.com
youthreaders.com youthreaders.com
ypmuseum.ru ypmuseum.ru
yun56.co zeleznobeton.ru
yur-p.ru zhacker.net
zarepta.com zophim.me
zazagames.org zryydi.com
zdesoboi.com zscalertwo.net
zetmaster.ru
zmoda.hostreo.com
znakomstva-piter78.ru
zrus.org
zskdla.site
zvetki.ru
zvuker.net

478
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1314dh.com 101flag.ru
34.gs 1kdailyprofit.me
4rent.ru 3th.co.in
5u.com 72-news.com
91abcw.com 777-club.ru
abiente.ru abcdefh.xyz
actulite.com academiacsmendoza.org
acunetix-referrer.com adktrailmap.com
ads-cool.pro aero2.ru
adultmeetonline.info ahrefs.com
aibolita.com alf-img.com
alta-realestate.com allcredits.su
amateurgalls.com animalia-life.club
amazingpic.net anonymousfox.co
android-systems.ru
api.stathat.com api.stathat.com
applicationg29.com apiadanaknet-a.akamaihd.net
appsaurus.com apiholdingmypage-a.akamaihd.net
aquarium-pro.ru apiwoodensealcom-a.akamaihd.net
arius.tech appearance-cool.com
asiavirtualsolutions.com asrv-a.akamaihd.net
atelielembrancaqueencanta.com.br australia-opening-times.com
atley.eu.pn auto.rusvile.lt
autorn.ru automobile-spec.com
balkanfarma.ru autotop.com.ua
belstaffstore.online autowebmarket.com.ua
bgviagrachrx.com avtolombard-krasnodar.ru
b00kmarks.com
baksman.com
bankmib.ru
beatifullandscape.co
bezlimitko.xyz
bioca.org bioca.org
bookmaker-bet.com blogsfunky672.weebly.com
brateg.xyz braip.com.br
breget74.ru brandedleadgeneration.com
brokergid.ru brandov.ru
brus.city buron.pw
btvn.ru buyscabiescream.com
burn-fat.ga cakesplus.com.au
businesxxl.com callmd5map.com
butstrap.space canrole.com
buyantiviralwp.com catalogs-parts.com
buyessaynow.biz cbcseward.com
buzzonclick.com cdncash.com
bwlx.prepedu.cn chatroulette.online
cascadelink.org cheapmoncler.pw
chatroulette.world cheapwebsitehoster.com
chiptuninger.com cheatcode-lita12.rhcloud.com
christianlouboutinsaleoutletonline.us checkpagerank.net
cialisndbrx.com choice-credit.ru
click2pawn.com cinemaflix.website
classicakuhni.ru
clickintext.net
club-musics.ru club-musics.ru
coinsspb.com compliance-andrew.xyz
compliance-checker.info compliance-julia.top
compliance-elena.top czat.wp.pl
compliance-george.xyz ddospanel.com
counterbot.com decorationspcs.com
covadhosting.biz dikqlyremy.info
crafthubs.com dumuelave.xyz
creams.makeforum.eu dvd-famille.com
creativehutindia.com e-biznes.info
cutalltheshit.com eaplay.ru
cxpromote.com education-cz.ru
daooda.com elvenmachine.com
decorazilla.com energydiet24.ru
delayreferat.ru enews.tech
dentfidemountpreach.tk englate.com
detoxmed24.ru erotik-kostenlos.net
dichvuvesinhhanoi.com erotische-geschichten-xxl.com
digitalassetmanagement.site estelight.ru
diusyawiga.tk exchanges-bet.com
dnepr-avtospar.com.ua f1nder.org
download-wallpaper.net famix.xyz
dustyorate.com fickenbumsen.net
ebonyporn.site filmgo.ru
econom.co findacheaplawyers.com
ednorxmed.com findanysex.com
efkt.jp fishingwholesale.us
elektronischezigarette2.mex.tl floating-share-buttons.com
elektronischezigarettekaufen1.beeplog.com forodvd.com
exct.net forpackningsutveckling.se
expertblog.info free-laptop-reward.com
eyes-on-you.ga gabeshop.ru
family1st.ca galaxys6manual.info
fanpagerobot.com gambarxkata.co
feargames.ru gentamicineyedrops.blogspot.com
fickluder69.com getpopunder.com
filmci.pro googst2.ru
firma-legion.ru gopro-online.info
freshdz.com gpirate.com
gaytube.com herokuapp.com
geileweiber.tk hetmanship.xyz
girlsfuckdick.com hobbyhuren-datenbank.com
gne8.com host-protection.com
gotomontenegro.net hotcore.info
greendream.com.ua houdom.net
greenshop.su huhn.altervista.org
gwebtools.com iccornacircri.cf
hausfrauensex18.com imediadesk.com
hdseriale.pl invest-pamm.ru
healbio.ru invitefashion.com
hentaiheroes.com iqbazar.ru
home-task.com
ibb.com.ua
iblogpress.xyz
indiakino.net
indianmedicaltourismshop.com
isistaylorporn.info
ix20.ru
jabimgo.pw
james13prix.info
javcoast.com javcoast.com
jrpmakati.com juliaworld.net
kerwinandcariza.com kartiniresto.com
kfon.eu katjimej.blog.fc2.com
kollekcioner.ru kaz.kz
kovrenok.ru keywordspay.com
labafydjxa.su kihi.gdn
lapitec.eu kochanelli.com
laptoper.net lacave.ntic.fr
ldrtrack.com lafriore.ru
liffa.ru lescinq.com
likrot.com lietaer.com
littleberry.ru loginduepunti.it
liupis.com magazintiande.ru
lkbennettoutlet.online mamasuper.prom.ua
lodki-pvh.dp.ua
lombardfinder.ru
lostaruban.com
lyrics.home-task.com
magnetic-bracelets.ru
mantramusic.ru
manve.info manve.info
mebelcomplekt.ru mediawhirl.net
micasainvest.com medicines-choice.com
mikrobiologies.ru medosmotr-ufa.ru
mejoresfotos.eu
menstennisforums.com
middlerush-a.akamaihd.net
migente.com
mmgq.ru mmgq.ru
moesen-ficken.com mmofreegames.online
moneyteam24.com mobot.site
most.gov.iq monclercheap.xyz
mozello.ru mrmoneymustache.com
mrsdalloways.com music7s.me
mvpicton.co.uk muznachas-service.ru
myiptest.com mwtpludn.review
netvouz.com myblogregistercm.tk
nikhilbahl.com mycaf.it
novodigs.com mysexpics.ru
offer.camp nacap.ru
ok-ua.info naj-filmy24.pl
onlineslotmaschine.com nash-krym.info
optom-deshevo.ru needtosellmyhousefast.com
orgasmatrix.com newfilmsonline.ru
ownshop.win no-fuel.org
nufaq.com
obnal.org
okmedia.sk
old-rock.com
onemantrip.com
onlinemeetingnow.com
onlinetvseries.me
ostroike.org
ozas.net ozas.net
pagesense.com park.above.com
partnerads.men pastaleads.com
partnersafe.men perso.wanadoo.es
popugaychiki.com plaff-go.ru
popunder.ru plastgran.com
pornoforadult.com pod-muzyku.club
porno-home365.com
pp-budpostach.com.ua
pr0fit-b0x.com pr0fit-b0x.com
predmety.in.ua professionaldieselcare.com
privatefx-in.ru promodj.com
prodess.ru proposal-engine.com
profitsport.club rank-checker.online
prosmibank.ru rasteniya-vs-zombi.ru
rapidokbrain.com ratemodels.net
razyboard.com rentehno.ru
real-time-analytics.com ruspdd.com
recipedays.com russian-postindex.ru
reklamuss.ru safe-app.net
remorcicomerciale.ro sammlungfotos.online
rezeptiblud.ru scanner-willy.top
robot-forex.biz scmor.ilxc.cc
rossmark.ru se-welding.ru
royalvegascasino.com searchengineranker.email
rozalli.com seksvideoonlain.com
rukino.org semxiu.com
russintv.fr
samo-soznanie.ru
samoiedo.it
schoolfiles.net
searchlock.com
security60-e.com
seeingmeerkat.com
selectads.men
seoboxes.com seoboxes.com
sexpornotales.net seogadget.ru
sexyali.com seorussian.ru
shemale-sex.net sexobzor.info
skypasss.com sibtest.ru
slkrm.ru siha.de
socialsignals24.com sk.golden-praga.ru
socialtrade.biz skladvaz.ru
solmarket.by socialseet.ru
soochi.co soda.media
sotkal.lark.ru softtor.com
spidtest.space sosdepotdebilan.com
spravka-medosmotr.ru sotechco.co
specialfinanceoffers.com
spy-sts.com
stanthonyscatholicchurch.org
stardevine.com
startufa.ru startufa.ru
stauga.altervista.org suchenindeutschland.com
stoki.ru sucsesofinspiration.com
strv.se takeflyte.com
studiokamyk.com.pl teastory.co
superstarfloraluk.com testbotprocessor44.com
tarad.com theplacetoupdating.pw
tattoo33.ru tizanidinehydrochloride2mg.blogspot.com
technopellet.gr
thefarmergame.com
thepantonpractice.co.uk
ticketsys.inetwd.com
titangel-vietnam.com
tizanidineinfo.blogspot.com
tizanidinerecreationaluse.blogspot.com
tizanidinerestlesslegsyndrome.blogspot.com
tk-assortiment.ru tk-assortiment.ru
trainoffend.ml topdownloads.ru
tri-slona.org tradgardspartner.se
triumf-realty.ru trafficfactory.biz
truck-addzilla.life trubywriting.com
trucri.me ublaze.ru
ttrraacckkrr.com ukrup.com
twelvevisionspartyofcolorado.com ultimateclassicrock.com
ukr-lit.com ultramart.biz
ukrobstep.com ural-buldozer.ru
unblocksit.es urdoot.win
upstore.me ustion.ru
uptime-as.net valoresito.com
urlopener.com vchulkax.com
usdx.us veerotech.com
vavilone.com via-energy-order.com
venerologiya.com viddyoze.com
vtcdns.com video-production.com
webalan.ru videochat.mx
wechatdownload10.com videooko.weebly.com
wedding-salon.net vip2ch.com
westum.se virtuagirl.com
wholesalejerseysgaa.com webnode.me
wildnatureimages.com webpromotion.ae
x-diesel.info website-analytics.online
xep.info weprik.ru
xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai white-truck.life
xn--80aaafbn2bc2ahdfrfkln6l.xn--p1ai worldhistory.biz
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai wovis.site
xn--b1agm2d.net wzgyyq.com
xsfetish.org x-true.info
xxxdatinglocal.us x5market.ru
xxxmania.top xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
yeartwit.com xn--e1afanlbnfckd7c3d.xn--p1ai
youporn-ru.com xxxguitars.com
zatjmuzu.info yebocasino.co.za
zeg-distribution.com youandcredit.ru
zocaparj.kz yougetsignal.com
zreloeporno.tv youraticles.pl
yubikk.info
yugk.net
yugo-star.ru
zeleznobeton.ru
zetmaster.ru
zoogdisany.com
zophim.me

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.32 0; 10.1.0.48 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2908 ### Version: V4.2022.02.2909
### Updated: Wed Feb 9 22:01:12 UTC 2022 ### Updated: Thu Feb 10 10:03:40 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2908 ### Version: V4.2022.02.2909
### Updated: Wed Feb 9 22:01:12 UTC 2022 ### Updated: Thu Feb 10 10:03:40 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##