vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-05 12:09:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2996 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-23 10:10:33 +00:00
parent de9de5e300
commit e383b7e475
46 changed files with 97448 additions and 97448 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2995 #### Version: V4.2022.03.2996
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2995 #### Version: V4.2022.03.2996
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2995 #### Version: V4.2022.03.2996
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12048
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2995 #### Version: V4.2022.03.2996
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12052
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12052
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12052
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12052
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2995 2996

12052
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12052
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.231.52.238 0; 13.88.4.161 0;

12052
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

12052
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.231.52.238 0; 13.88.4.161 0;

12052
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.231.52.238 0; 13.88.4.161 0;

12052
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 1; 10.1.0.170 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AiHitBot AfD-Verbotsverfahren
Ecxi Image Fetch
MolokaiBot LeechFTP
Nikto Meanpathbot
OutfoxBot MicroMessenger
Pixray NetZIP
Sociscraper Panscient
Typhoeus Spanner
domainsproject.org WebWhacker
meanpathbot gopher

298
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404enemy 404enemy
80legs
AIBOT
ASPSeek
Abonti Abonti
Aboundex Aboundex
AiHitBot Acunetix
Alexibot Aipbot
AlphaBot
Anarchie Anarchie
Atomseobot Ankit
Attach Apexoo
BBBike Asterias
BDCbot AwarioRssBot
AwarioSmartBot
BDFetch BDFetch
BLEXBot BLEXBot
BackDoorBot Battleztar Bazinga
BackWeb BetaBot
BlackWidow BlackWidow
Blow
BlowFish BlowFish
Boardreader
Bolt
Brandprotect
Buddy Buddy
BuiltBotTough BuiltWith
Bullseye CCBot
CATExplorador
CODE87 CODE87
CSHttp
Calculon Calculon
CheTeam CazoodleBot
CherryPicker CensysInspect
Chlooe ChinaClaw
Cogentbot Cloud mapping
Collector Copier
CopyRightCheck CopyRightCheck
Cosmos Crescent
CrazyWebCrawler
CrunchBot CrunchBot
Curious Curious
CyotekWebCopy
DBLBot DBLBot
DSearch DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon
Deusu Deusu
DigitalPebble DigitalPebble
Disco Disco
DittoSpyder DittoSpyder
DnyzBot DomainStatsBot
DomainCrawler Drip
Download Wonder EMail Siphon
Dragonfly
ECCP/1.0
EMail Wolf EMail Wolf
EasyDL
Ebingbong
Ecxi
Exabot Exabot
ExtLinksBot
Extractor
EyeNetIE EyeNetIE
FDM FDM
Fimap FHscan
Flunky
Fuzz Fuzz
FyberSpider Fyrebot
G-i-g-a-b-o-t GT::WWW
GalaxyBot GalaxyBot
GetRight Genieo
GetWeb GermCrawler
Getintent
Gigabot Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It
Grabber Grabber
Grafula HTMLparser
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite HTTP::Lite
HTTrack HaosouSpider
Harvest Heritrix
Havij
Hloader Hloader
HonoluluBot
Humanlinks
HybridBot
IDBot
Iblog
Id-search Id-search
IlseBot
IndeedBot IndeedBot
Indy Library InfoNaviRobot
Iria Internet Ninja
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz
JennyBot JennyBot
Jetty Jetty
Jorgee Keybot Translation-Search-Machine
Jyxobot Keyword Density
LWP::Simple LNSpiderguy
Larbin LeechGet
Leap
LeechFTP
Libwhisker
LieBaoFast LieBaoFast
Likse Likse
LinkWalker LinkWalker
Linkdexbot LinkextractorPro
LinksManager
LinqiaRSSBot LinqiaRSSBot
Lipperhey Lipperhey
Litemage_walker Litemage_walker
Lmspider Ltx71
MFC_Tear_Sample
MIDown tool MIDown tool
MSFrontPage MIIxpc
MJ12bot
MQQBrowser
MTRobot
Magnet Magnet
Mail.RU_Bot
Majestic-SEO Majestic-SEO
Majestic12
MarkMonitor MarkMonitor
MarkWatch Mass Downloader
Masscan
Mata Hari Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
MeanPath Bot
Mediatoolkitbot Mediatoolkitbot
Microsoft Data Access Microsoft Data Access
Mister PiX
Moblie Safari Moblie Safari
MolokaiBot MolokaiBot
Morfeus Fucking Scanner Msrabot
Nameprotect Musobot
Navroad NICErsPRO
Net Vampire Name Intelligence
NetLyzer NearSite
NetSpider Needle
Nessus
NetAnts
NetMechanic
NetZIP NetZIP
Nettrack
Netvibes Netvibes
NextGenSearchBot
Nibbler Nibbler
Nikto
Nimbostratus
Nmap Nmap
Nutch
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind Openvas
OrangeBot OrangeBot
OrangeSpider OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Panscient
Papa Foto
Picscout
Picsearch Picsearch
Piepmatz PleaseCrawl
Pixray Probethenet
Pu_iN Pu_iN
Pump PxBroker
PyCurl PyCurl
RankActive QueryN Metasearch
RankActiveLinkBot Quick-Crawler
RankFlex
RankingBot
RankingBot2 RankingBot2
Re-re RankurBot
RebelMouse ReGet
Recorder RealDownload
RedesScrapy RedesScrapy
Ripper
RocketCrawler RocketCrawler
SBIder SBIder
SEOkicks-Robot SEOkicks
SEOprofiler
SEOstats
SMTBot SMTBot
ScanAlert ScreenerBot
ScoutJet
Screaming
Seekport
Semrush Semrush
SemrushBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz
Siphon Siphon
SiteSucker SiteCheckerBotCrawler
Sitebeam SiteExplorer
Siteimprove SiteSnagger
Sitevigil SlySearch
Snapbot SmartDownload
Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen Spammen
SpankBot Spanner
Spinn3r Spinn3r
Sqlworm Sqlworm
Sucker Sucker
Sucuri
SuperBot
SuperHTTP SuperHTTP
Suzuran SurveyBot
Telesphorep T8Abot
Thumbor TeleportPro
Toata Telesoft
Telesphoreo
TightTwatBot
Titan
Tracemyfile Tracemyfile
Trendiction
Turingos Turingos
Turnitin
TurnitinBot
Twice Twice
UnisterBot UnisterBot
Upflow Upflow
VB Project
VCI VCI
VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Virusdie Virusdie
WASALive-Bot VoidEYE
WEBDAV
WPScan WPScan
WWW-Collector-E WWW-Mechanize
Wallpapers WWWOFFLE
WallpapersHD Wallpapers/3.0
Web Auto WeSEE
Web Collage Web Fetch
Web Sucker
WebBandit WebBandit
WebCollage WebCopier
WebFetch WebFetch
WebFuck WebFuck
WebGo IS WebStripper
WebImageCollector
WebLeacher
WebSucker
WebWhacker WebWhacker
WebmasterWorldForumBot WebZIP
Webshag Whack
Webster Whacker
Whatweb Widow
Who.is Bot Wonderbot
WinHTTrack Xaldon WebSpider
YoudaoBot
Zermelo Zermelo
ZumBot ZoominfoBot
ZyBorg
adscanner
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
coccocbot check1.exe
crawler.feedback clark-crawler
cognitiveseo
com.plumanalytics
crawler4j crawler4j
domainsproject.org facebookscraper
evc-batch
gopher gopher
ips-agent
isitwp.com isitwp.com
meanpathbot lwp-trivial
mediawords magpie-crawler
muhstik-scan muhstik-scan
netEstate NE Crawler
oBot oBot
page scorer pcBrowser
polaris version s1z.ru
probe-image-size seocompany.store
ripz
scalaj-http
scan.lol
seoscanners
sitechecker.pro sitechecker.pro
siteripz sp_auditbot
trendiction.com spyfu
webgains-bot xpymep1.exe
webprosbot
zgrab

280
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
ADmantX 404enemy
ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundexbot
Acunetix Aipbot
AhrefsBot
Alexibot Alexibot
AllSubmitter Alligator
Ankit Anarchie
Anarchy
Anthill Anthill
Aspiegel AwarioRssBot
Atomseobot AwarioSmartBot
Attach
BBBike BBBike
BDCbot
BDFetch BDFetch
BLEXBot BLEXBot
BackStreet BackDoorBot
Backlink-Ceck Backlink-Ceck
Badass Bandit
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bitacle Blackboard
Blow
BlowFish
Boardreader
Bolt
BotALot BotALot
Brandwatch Brandprotect
Buddy Buck
BuiltWith Bullseye
BunnySlippers
CATExplorador CATExplorador
CCBot CCBot
CazoodleBot Calculon
CensysInspect CheTeam
CheeseBot CheeseBot
CherryPicker
ChinaClaw
Chlooe Chlooe
Cocolyzebot Claritybot
Collector Cloud mapping
Copyscape Cosmos
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent
CrunchBot CrunchBot
Custo Curious
CyotekWebCopy
DBLBot
DTS Agent DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli
Demon Demon
Devil
Digincore Digincore
Dirbuster DigitalPebble
Discobot Dispatch
DittoSpyder
DomainAppender DomainAppender
ECCP/1.0 DomainCrawler
DomainSigmaCrawler
Drip
EMail Wolf EMail Wolf
EirGrabber Ebingbong
EroCrawler EroCrawler
ExtLinksBot Evil
Extractor Exabot
FHscan Express WebPictures
Fimap Extreme Picture Finder
Firefox/7.0 Flunky
FlashGet
Fuzz Fuzz
Fyrebot Fyrebot
GT::WWW GalaxyBot
GetRight GetRight
Getintent
Go!Zilla Go!Zilla
Gotit GoZilla
Grabber
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HTMLparser
HTTrack HTTrack
Haansoft Haansoft
HaosouSpider Humanlinks
IRLbot IRLbot
Indy Library Iblog
InfoTekies Image Fetch
InterGET Image Sucker
Internet Ninja
InternetSeer
Iskanie Iskanie
IstellaBot JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider JikeSpider
LWP::Simple JustView
Lanshanbot Jyxobot
Larbin Kenjin Spider
Leap Keybot Translation-Search-Machine
Lftp LNSpiderguy
LeechFTP
LexiBot
LibWeb LibWeb
LieBaoFast Libwhisker
LinkWalker Lightspeedsystems
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Litemage_walker Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MJ12bot MJ12bot
MTRobot MSIECrawler
Mag-Net Mag-Net
Majestic12 Magnet
Majestic-SEO
MarkMonitor
MarkWatch MarkWatch
MauiBot Microsoft Data Access
MeanPath Bot Mojeek
Mediatoolkitbot Mozlila
MegaIndex.ru NearSite
Metauri NetAnts
NPbot
Nameprotect
Nessus
NetSpider
NetZIP NetZIP
Netcraft
Netvibes Netvibes
Nibbler NextGenSearchBot
Ninja Nutch
Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler OnCrawl
Openfind Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot PageGrabber
POE-Component-Client-HTTP
PageScorer PageScorer
Panscient PageThing.com
PeoplePal Pandalytics
Petalbot Pavuk
Picscout
Pimonster Pimonster
Psbot Pixray
ProPowerBot
Pu_iN
PyCurl PyCurl
QueryN Metasearch RSSingBot
RankActive RankActiveLinkBot
RankFlex RankingBot2
RankingBot
Rankivabot Rankivabot
RankurBot RankurBot
Re-re ReGet
RealDownload
Recorder
RepoMonkey RepoMonkey
SEOkicks-Robot RocketCrawler
SBIder
SEOkicks
SMTBot SMTBot
ScanAlert SalesIntelligent
Scanbot
ScrepyBot ScrepyBot
SemanticJuice Seekport
SeobilityBot Semrush
Seomoz SentiBot
SeoSiteCheckup
Shodan Shodan
Siphon
SiteLockSpider
SiteSnagger
Site Sucker Site Sucker
Sitebeam Sitebeam
Siteimprove
Sitevigil Sitevigil
SlySearch SlySearch
Snake SmartDownload
Snapbot Snapbot
SocialRankIOBot SocialRankIOBot
Sociscraper
Sosospider Sosospider
Sottopop
SpaceBison SpaceBison
Spanner SpankBot
Spbot Spbot
Spinn3r
Sqlmap Sqlmap
Sqworm Sqworm
Steeler Steeler
Stripper Stripper
Sucker Sucker
Sucuri
SuperBot SuperBot
Surfbot Surfbot
Swiftbot SurveyBot
Suzuran
T8Abot
Telesoft Telesoft
Telesphorep
The Intraformant The Intraformant
TheNomad
Thumbor Thumbor
Toata Titan
Trendiction Tracemyfile
Trendictionbot True_Robot
Turingos
Turnitin Turnitin
TurnitinBot Twice
Typhoeus Typhoeus
VCI URLy Warning
VoidEYE VoidEYE
Voil Voil
Voltron
WASALive-Bot
WBSearchBot WBSearchBot
Wallpapers/3.0 WWWOFFLE
WallpapersHD
WeSEE WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sauger Web Sauger
Web Sucker WebFetch
WebCopier WebStripper
WebFuck Website Quester
WebGo IS
WebLeacher
WebReaper
WebSauger
WebWhacker
Webshag
WebsiteQuester WebsiteQuester
Webster
Whack Whack
Whacker
Whatweb
WinHTTrack WinHTTrack
WiseGuys Robot WiseGuys Robot
Woobot
Xaldon WebSpider Xaldon WebSpider
Zade YoudaoBot
Zauba Zauba
Zermelo Zermelo
Zeus
ZmEu
ZumBot ZumBot
ZyBorg
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
crawler.feedback check1.exe
crawl.sogou.com
crawler4j crawler4j
eCatch
facebookscraper
heritrix heritrix
instabid
internetVista monitor internetVista monitor
ips-agent
isitwp.com isitwp.com
lwp-request
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
meanpathbot meanpathbot
mediawords mediawords
oBot oBot
plumanalytics plumanalytics
polaris version
s1z.ru
satoristudio.net
scalaj-http scalaj-http
seostar scan.lol
serpstatbot seoscanners
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot sp_auditbot
spyfu
sysscan sysscan
trendiction.com trendiction.com
voyagerx.com trendiction.de
x09Mozilla webpros.com
zgrab x22Mozilla
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
3dracergames.com bimmerpost.com
cracksplanet.com cheapestjerseys-wholesale.com
directivepub.com elektronischezi.livejournal.com
iqupdatetmz.win erotiktreff24.info
ku6.com healbio.ru
mansiondelrio.co pochtovyi-index.ru
mmgq.ru pokerniydom.ru
mmstat.com seojokes.net
prointer.net.ua valkiria-tk.ru
tamada69.com xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai

916
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-free-share-buttons.com 00go.com
1688.com 00webcams.com
178evakuator178.ru 08800.top
2daytrendingnews.com 13tabs.com
2x2fan.ru 18ps.ru
4rent.ru 1hwy.com
8xv8.com 1pamm.ru
DomainStatsBot 2000k.ru
a.frcls.fr 24x7-server-support.site
aa625d84f1587749c1ab011d6f269f7d64.com 300richmond.co.nz
aab94f698f36684c5a852a2ef272e031bb.com 4kplayer.pl
accessoires-mode.in 51.la
adtech.us 51unlim.ru
adtology.com 7zap.com
adultactioncam.com 83net.jp
adultwebhosting.info 888.com
ageofclones.com 8si.ru
aktobe.xkaz.org aa9bd78f328a6a41279d0fad0a88df1901.com
alfabot.xyz aaa38852e886ac4af1a3cff9b47cab6272.com
allblogroll.com aad1f4acb0a373420d9b0c4202d38d94fa.com
alldubai.biz absolute-s.ru
allornamenti.com acgs.tk
allpdfmags.net addtoadd.men
alltheviews.com adf.ly
alphahoverboards.com adloads.com
amyfoxfitness.com adprotect.net
analytics-ads.xyz ads.tremorhub.com
adultfullhd.com
advancedcleaner.com
adzpower.com
aerogo.com
ahrntal.verymes.xyz
akama.com
aksonural.ru
algerianembassy.co.in
alienwheels.de
allsilver925.co.il
alveris.ru
amehdaily.com
android-vsem.org android-vsem.org
antons-transporte.de api.stathat.com
apiholdingmypage-a.akamaihd.net applicationg29.com
apioasisspacenet-a.akamaihd.net appmsr.org
app-ready.xyz approved.su
apper.de apps-analytics.net
applyneedy.xyz arendakvartir.kz
approvedlocal.co.za
arcadeplayhouse.com
arraty.altervista.org
artefakct.com artefakct.com
artparquet.ru asacopaco.tk
asmxsatadriverin.aircus.com astana.xxxkaz.org
asscenihotosidea.blogspot.com avirasecureserver.com
atlasvkusov.ru
auto-moto-elektronika.cz
autoloans.com
autolombard-krasnodar.ru
avon-severozapad.ru avon-severozapad.ru
avon-ukraine.com avtochehli.by
avtovolop.ru avtocredit-legko.ru
axbocz.net awaybird.ru
b2b-lounge.com ayodhya.co
bag77.ru backlinkwatch.com
balois.worldbreak.com balois.worldbreak.com
bannerbank.ru bannerconnect.net
barnfurnituremart.com battleforupdating.site
battlecarnival.su
bayareaaeroclub.org bayareaaeroclub.org
bbtec.net belinka.com.ua
beachdriveblog.com
beatifullandscape.co
beget.tech
best-coupon-offer.com
best-deals-products.com
best-seo-solution.com
bestadbid.com
bestfortraders.com bestfortraders.com
bestkfiledxd.cf bidr.trellian.com
bio.trade-jp.net bioinnovate.co
bird1.ru biznesrealnost.ru
bizcheapjerseyswholesalechina.com blackbabesporn.com
bjetjt.com blogrankers.com
blogporn.in blogs.rediff.com
bnt-team.com bmsco.co
bombla.org boazpower.com
book-bets.com bochemit.com.ua
brainboosting.club boeuklad.com
brainxs.us bolezniorganov.ru
browserprotecter.com boobsimge.com
buntube.net bookmark4you.com
buqyxa.rincian.info bradleylive.xyz
buy-loft.ru brendbutik.ru
buynorxx.com brewdom.ru
buypanicdisorderpill.com brus-vsem.ru
cah.io.community btnativenav.com
candiceloves.us butstrap.space
candytiner.com buyessayonline19.blogspot.ru
cartierjusteunclou.xyz bvlgaribracelet.xyz
cartierlovebraceletreplica.xyz bytimedance.ru
cartierring.xyz calc-for-credit.ru
cashonads.com callstevens.com
castingbank.ru candlehandmade.com
chatroulette.si cartierreplica.top
cejewelry.xyz
cgi2.nintendo.co.jp
chatroulette.online
chatseo.com
chcu.net
cheap-trusted-backlinks.com cheap-trusted-backlinks.com
cheapjerseysa.com cheapcigarettesc.info
ci.ua cheapmarmot.online
ciceros.co chinajerseyswholesalecoupons.com
clayvasedesigns.tk chocoslim.pro
clickpapa.com cialis-samples.com
com-onlinesupport.host clickaider.com
com-onlinesupport.site clips.ua.ac.be
compliance-andrew.xyz clothesforcash.com
compliance-willy.top cobaltpro.ru
consorzioilmosaico.org companies-catalog.com
cookie-law-enforcement-aa.xyz compliance-ivan.top
cookie-law-enforcement-hh.xyz compliance-viktor.top
connectionstrenth.com
contextualyield.com
continent-e.tv
coolgramgoods.com coolgramgoods.com
coolwallpapers-hd.com coop-gamers.ru
corta.co corta.co
countbertwistdisp26.soup.io coslab.club
counterbot.com counter.bloke.com
creditnation.ru courtshipgift.com
cs-passion.pl crirussian.ru
culturevie.info customerpromos-a.akamaihd.net
customsua.com.ua cutalltheshit.com
cutt.us d2jsp.org
daisye.top
daretodonate.co
dayibiao.com dayibiao.com
dellalimov.com ddsoldes.fr
demian.kz deda-moroza-zakaz.ru
dentfidemountpreach.tk dentfidemountpreach.tk
deshevo-nedorogo.ru detmebel.su
dev78.dioniqlabb.se detoxmed24.ru
digitalfaq.com digest-project.ru
dimfour.com discovertreasure-a.akamaihd.net
discovertreasurenow.com diusyawiga.tk
dispo.de domaincdn.xyz
dlya-android.org dostavimvdom.ru
dojki-hd.com dostavka-v-krym.com
dolohen.com dotmass.top
downloadmefiranaratb1972.xpg.com.br
driving.kiev.ua
drugspowerstore.com drugspowerstore.com
drunkmoms.net druzhbany.ru
dverimegapolis.ru dstroy.su
dyshagi.ru dwomlink.info
easytuningshop.ru e-avon.ru
ecommerce-seo.com e-buyeasy.com
edwinkonijn.com.au ed-shop01.ru
elektrischezigarette2.onsugar.com editmedios.com
emediate.eu edudocs.net
empirepoker.com efkt.jp
englate.com ege-essay.ru
eredijovon.com ege-russian.ru
ereko.ru ekspertmed.com
erotische-geschichten-xxl.com elektronischezigarette2.mex.tl
es5.com elektrozigarettekaufen1.devhub.com
en.home-task.com
enge-fotzen.info
enginebay.ru
enthuse.computernetworksonline.com
eshop.md
eshop4u.jp
eurosamodelki.ru
excitacao.com excitacao.com
expertnaya-ocenka.ru excitacion.info
ezigarettenkaufen2.dreamwidth.org extstat.com
face.hostingx.eu ezigarettenkaufen1.pagina.gr
falopicm.pw fdzone.org
fast-wordpress-start.com fealq.com
feeriaclub.ru fidelityfunding.com
femmesdenudees.com
fetlifeblog.com
fikasound.tk
film-one.ru
filmi-onlain.info filmi-onlain.info
financehint.eu financepoints.eu
fishingwholesale.us financetip.eu
floridahuntingfishingadventures.com firstdrugmall.ru
floridamhca.org flagcounter.me
fortevidyoze.net flooringinstallation-edmonton.com
forum-engineering.ru folowsite.com
foto-telok.net footbalive.org
fotoxxxru.com footballfarrago.com
fordsonmajbor.cf
fortwosmartcar.pw
foxydeal.com
franklinfire.co franklinfire.co
freakycheats.com free411games.com
free-social-buttons.com freelotto.com
freshberry.com.ua freemaintenancesysforpcandmac.top
frequiry.com
freshdz.com freshdz.com
front.to front.to
frustrated-favorable.gq fungamelands.com
fuckbuddybestgilf.info fungirlsgames.net
funnymama.com funnel.co.za
g33.org fyxabomiw.ru
gabeshop.ru gamblingnerd.com
gael-s.ru gameonasia.com
gallerylisting.com ge0ip.com
gambarkatabaru.com gearcraft.us
gamebackyard.com gepezz.info
gaytube.com germes-trans.com
gaz-voshod.ru gilsonchiro.xyz
ge0ip.org goblacked.com
genericlowlatencyasiodriverhq.aircus.com golden-praga.ru
generousdeal-a.akamaihd.net goodly.pro
get-free-social-traffic.com gratuitxblcodes.com
getlaid-xxxhookupdirect.com greatgrace.ru
gettpromos.com
ghernnqr.skyrock.com
gk170.ru
goldandcard.ru
goldpanningtools.com
googst2.ru
greenzaim.ru greenzaim.ru
gribokstop.com growshop.es
gsasearchengineranker.xyz grtyi.com
h2monline.com guardlink.com
hd-film.pl gwhwpxbw.bloger.index.hr
headpress.ru gz2.bbsoldes.fr
hetmanship.xyz hdpixent.com
hildinghr.se heartofpayne.xyz
hit-kino.ru helicalpile.us
hitmuzik.ru hermesbirkinhandbagoutlets.com
hollywoodactress.info heroz.fr
hotel-mkad.ru high-speed1.net
hoverboard360.se hikesearch.net
hotcore.info
housekuba.org
hoverboard360.de
huhn.altervista.org
huimin764128.com
hyiphunter.org
ictizanidinehcl4mg.blogspot.com ictizanidinehcl4mg.blogspot.com
idealtits.net ideibiznesa2015.ru
ideoworld.org iflycapetown.co.za
ilmen.net
imabase.com imabase.com
imagecoolpub.com images-free.net
imagerydatabase.com imediadesk.com
imfamous.info
imk.com.ua
import-sales.com
interesnie-faktu.ru interesnie-faktu.ru
interior-stickers.ru internet-apteka.ru
internetartfair.com iomoio.net
investmac.com ipchicken.com
iqupdatetmz.win iskalko.ru
isotoner.com ivanovo.zrus.org
ixora.pro jerseychinabizwholesale.us
jav-way.site jerseyswholesalechinalimited.com
javidol.site jestr.org
jerseywholesalechinabiz.com jyrxd.com
jolic2.com karpun-iris.ru
jpcycles.com kaz.kz
kaac.ru kemerovo.zrus.org
kareliatobacco.ru kevblog.top
kellyonline.xyz keyword-suggestions.com
kerei.ru keywords-monitoring-success.com
keywordblocks.com khafre.us
keywordteam.net kiskinhouse.com
kichenaid.ru konkursowo-24.pl
kino-rating.ru konteiner24.com
kinosed.net kustanay.kz
kit-opt.ru kutikomi.net
kladrus.ru kuzinsp.ru
klitimg.pw lanasshop.ru
kmd-pto.ru landmania.ru
knigonosha.net landscaping.center
kosmetyki.tm.pl law-check-nine.xyz
kretpicf.pw lazy-z.com
kvartir-remont.biz ledis.top
kw21.org letmacworkfaster.site
labafydjxa.su likrot.com
ladsup.com lineshops.biz
languagecode.com linkbux.ru
larchik.net
ledpolice.ru
letslowbefast.today
libertybilisim.com
lion.conboy.us
lionking-1994.blogspot.com
live-sexchat.ru live-sexchat.ru
lkbennettoutlet.online lkbennettstore.online
lsex.xyz localmatchbook.com
lubetube.com locationdesaison.com
lunamedia.co lol-smurfs.com
lunchrock.co lombia.com
luxmagazine.cf lsp-awak-perikanan.com
lyngdalhudterapi.no m5home.ru
lyrics.home-task.com mac-shield.com
macnewtech.com machicon-ueno.info
madot.onlinewebshop.net mackeeper-center.club
magiadinamibia.blogspot.com mailemedicinals.com
managerpak204.weebly.com make-money-online.com
mantramusic.ru makemoneyonline.com
manuscript.su makis.nu
marcogrup.com marinetraffic.com
massage-info.nl marketland.ml
matchpal-a.akamaihd.net
max-eclat.men
mebel-vstroika.ru
medanestesia.ru
medicines-choice.com medicines-choice.com
medicovi.com medosmotr-ufa.ru
memberty.com michaelkorssaleoutletonline.net
mere.host.sk middlerush-a.akamaihd.net
message-warning.net militarysale.pro
mezaruk.info mmofreegames.online
michaelkorsoutletstore.net moetomnenie.com
microstatic.pl
mikrobiologies.ru
mirtorrent.net
mobilierland.com
mobsfun.net
monarhs.info monarhs.info
monclerjacketsoutlet.pw
monclervests.xyz monclervests.xyz
monetizationking.net monetizationking.net
money-every-day.com
monitorwebsitespeed.com monitorwebsitespeed.com
muizre.ru mp3ringtone.info
myfreetutorials.com mrsdalloways.com
mylida.org mydoctorok.ru
mywallpaper.top nationalbreakdown.com
net-profits.xyz
netallergy.ru
netfacet.net netfacet.net
networkcheck.xyz newfilmsonline.ru
nootrino.com nextbackgroundcheck.gq
northfacestore.online ningessaybe.me
nudepatch.net no-fuel.org
o-o-6-o-o.ru nomuos.it
obiavo.com online.ktc45.ru
offtime.ru online247.ml
olgacvetmet.com ooo-gotovie.ru
onemantrip.com openmultipleurl.com
oneshotdate.com osnova3.ru
onlyforemont.ru ostroike.org
optibuymac.com pandarastore.top
orion-code-access.net pepperstyle.ru
ossmalta.com percin.biz.ly
ostrovtaxi.ru physfunc.ru
ourville.info picquery.com
owathemes.com picturesboss.com
paintingplanet.ru pila.pl
panicatack.com pinstake.com
paparazzistudios.com.au piulatte.cz
paydayonlinecom.com pizza-tycoon.com
pdns.cz pk-pomosch.ru
pdns.download pochemychka.net
perl.dp.ua pogosh.com
pestomou.info pons-presse.com
petrovka-online.com popander.mobi
phobia.us porndl.org
phormchina.com
photo.houseofgaga.ru
photochki.com
phuketscreen.com
pics-group.com
pihl.se
pinkduck.ga
pipki.r.acdnpro.com
plugingeorgia.com
podshipniki-nsk.ru
polska-poezja.com
poptool.net
popugaychiki.com
popup-fdm.xyz
pornhive.org pornhive.org
pornogad.com
pornolook.net
pornowarp.info
pornstartits.xblog.in
pornzone.tv pornzone.tv
porto.abuilder.net
posible.net
pr-ten.de
preconnubial.usuby.site preconnubial.usuby.site
preparevideosafesystem4unow.space pregnant.guru
privatbank46.ru presleycollectibles.com
prize44.com preventheadacheguide.info
profolan.pl privatefx.all4invest.info
promover.org privatov-zapisi.ru
pronorm.fr pro-tec.kz
prostitutki-astana.org prostitutki-belgoroda.org
proxyradar.com puteshestvennik.com
psvita.ru putevka24.ru
qitt.ru pwwysydh.com
quit-smoking.ga q-moto.ru
rankia.com quick-offer.com
rankings-analytics.com raisedseo.com
ranksignals.com realitykings.com
ranksonic.org realizmobi.com
rasteniya-vs-zombi.ru redhotfreebies.co.uk
reklama-i-rabota.ru redirlock.com
replica-watch.ru refudiatethissarah.info
reversing.cc registrysweeper.com
revistaindustria.com remont-mobile-phones.ru
richinvestmonitor.com rep-am.com
royal-betting.net ringporno.com
ringtonepartner.com
rockprogblog.com
rogervivierforsale.com
rucrypt.com rucrypt.com
ruex.org.ua rukino.org
russia-today-video.ru rvtv.ru
ryetaw.com saitevpatorii.com
sack.net saletool.ru
sady-urala.ru santechnik.jimdo.com
salmonfishingsacramentoriver.com saratov.xrus.org
sankt-peterburg.nodup.ru satoristudio.net
sarm.tk scanner-barak.top
savememoney.co.za school-diplomat.ru
scalerite.co.za sdi-pme.com
scanner-alexa.top
scanner-brian.top
scanner-viktor.top
sdsjweb.com
se-welding.ru se-welding.ru
searchimage.co searchmywindow-a.akamaihd.net
selectads.men securesmrt-dt.com
seo-2-0.com securityallianceservices.com
semp.net
seo-platform.com
seobility.net seobility.net
sexobzor.info seocheckupx.com
sextracker.com seocheki.net
sexy-pings.com service.adtech.us
shariki-zuma-lines.ru sex.hotblog.top
shemalegalls.blogporn.in sexcamamateurchat.com
shodanhq.com sexkontakte-seite.com
shopperifymac.com sexs-foto.com
sibecoprom.ru sibdevice.ru
sibtest.ru sigmund-freud.co.uk
sildenafil-tadalafil.info signx.info
simul.co sisiynas.ru
siteripz.net site5.com
sizeplus.work snow.nvr163.com
slavia.info softwaretrend.net
smallseotools.com
sofit-dmd.ru
sortthemesitesby.com
soserfis.com soserfis.com
spabali.org souvenir.cc
spasswelt.xyz space4updating.win
spb.afora.ru spinnerco.ca
specialfinanceoffers.com sprttrack.com
spl63.fr ssconstruction.co
spywarebegone.com starpages.net
stauga.altervista.org stauga.altervista.org
steame.ru stevemonsen.com
stoki.ru sukirgenk.dvrlists.com
stop-gepatit.te.ua supermama.top
stroicol.net supermodni.com.ua
stroiminsk.org superstarfloraluk.com
suchenindeutschland.com surflinksmedical.com
sundrugstore.com svensk-poesi.com
taihouse.ru szamponrevita.pl
tampabaywatch.org tackletarts.co
tdsing.ru tagil.zrus.org
templates.radiodigital.co tandvardshuset.net
thecoral.com.br taraz.xkaz.org
thexart.club tds-advert002.info
thfox.com teastory.co
tilido.com tech4master.com
time-japan.ru teletype.in
tizanidine4mgtablets.blogspot.com thaisamkok.com
tizanidineandgabapentin.blogspot.com thebestphotos.eu
tizanidinecost.blogspot.com thegalerie.eu
tizanidinedruginteractions.blogspot.com thegolfclub.info
tizanidineduringpregnancy.blogspot.com theplacetoupdating.pw
tizanidinenarcotic.blogspot.com tizanidine4mgstreetvalue.blogspot.com
toolsky.com tizanidinefibromyalgia.blogspot.com
toon-families.com tmearegion26.com
tootoo.to tnaionline.org
trafficnetzwerk.de tomatis.gospartner.com
trkur.com topappspro.com
turizmus.us torrent-newgames.com
torrent-to-magnet.com
torrnada.ru
tourcroatia.co.uk
trk-4.net
trucri.me
trumpetedextremes.com
tula.mdverey.ru
tupper-posuda.ru
turist-strani.ru
turvgori.ru
twinderbella.com
twittrading.com
txxx.com
u555u.info
ublaze.ru
ugogo.info
uk-zheu20.ru uk-zheu20.ru
ukr-lit.com umnovocaminho.com
ukrtvory.in.ua
ultimateclassicrock.com
underthesite.com underthesite.com
unisexjewelry.org ustion.ru
unitexindia.com v720hd.ru
unpredictable.ga vbtracker.net
uptime-alpha.net vesnatehno.ru
uptimebot.net
ural-buldozer.ru
url-img.link
vacuumcleanerguru.com
vegan-foods.us
venerologiya.com
viandpet.com
viddyoze.com
videochat.ph videochat.ph
vip-file.com vietimgy.pw
vitoriacabos.com vip2ch.com
vksaver-all.ru
vodaodessa.com
voditeltrezviy.ru
volgograd.xrus.org volgograd.xrus.org
voloo.ru voluumtrk.com
vse-pesni.com voronezh.xrus.org
vseigru.one vroze.com
vzlomfb.com vvon.co.uk
w3data.co w3data.co
we-are-gamers.com wardreapptokone.tk
web.cvut.cz wcb.su
websitevaluebot.com webix.biz
wejdz-tu.pl weboptimizes.com
westen-v.life website-stealer.nufaq.com
westum.se webtherapy.ru
while.cheapwebsitehoster.com weprik.ru
whipme.yopoint.in wheelchairliftsarea.com
wholesalecheapjerseysfree.com whos.amung.us
wholesalenfljerseys.us.com williamrobsonproperty.com
wineitudes.wordpress.com withstandingheartwarming.com
wjgony.com wladimirpayen.com
wordkeyhelper.com wordpresscore.com
worst-sites.online worldhistory.biz
wufak.com woweb.com.ua
www.arenda-yeisk.ru ws.ampower.me
www.wohnkabinen-shop.de wtsindia.in
wyniki-lista.pl ww1943.ru
x-musics.com xlolitka.com
xmladserver.com xmladserver.com
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai xn-----6kccaibs5cb8afhjrfmix2n.xn--p1ai
xn--1-8sbcpb0bdm8k6a.xn--p1ai xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--h1ahbi.com.ua xn--80aikhbrhr.net
xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai xn--b1addnj3cah.xn--p1ai
xpresscare.ru xn--lifehacer-1rb.com
yebocasino.com xnxxandxvideos.com
yginekologa.com xolodremont.ru
youandcredit.ru xtremeeagles.net
zdesformula.ru xxxrus.org
zeg-distribution.com yaoguangdj.com
zeroredirect10.com youdao.com
zeroredirect11.com youdesigner.kz
zone-kev717.info youradexchange.com
zoogdinsney.com youresponsive.com
zscalerone.net yourporn.com
yousense.info
zebramart.ru
zigarettenonlinekaufen.tumblr.com
zigarettenonlinekaufen1.blox.pl
zigzog.ru
zoominfo.com
zrelaya.pw
zrizvtrnpale.tk
zrus.org

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1bet.com 4kpics.rocks
23kw.ru 7yue.org
4kepics.com 83net.jp
7a2rnuey1tw9ar.ru 888.com
7fon.ru 991mostfm.co.id
8lufu.com adf.ly
aarbur.com adminshop.com
absolutelyanalog.com aerogo.com
adservme.com agroeconom.kz
adtech.us ahmedabadwebs.com
advokateg.ru akvamaster.dp.ua
afftrack001.com albamargroup.com
albumsuper.info allboard.xobor.de
alice.it amehdaily.com
allpdfmags.net anonymizeme.pro
alphaforum.ru anonymousfox.co
ananumous.ru apartment.ru
anatomiy.com asdfg.pro
apelsinnik.website asseenontvonline.ru
apimossnetinfo-a.akamaihd.net atley.eu.pn
apimountainbikei-a.akamaihd.net aviav.org
apishops.ru avon-severozapad.ru
appiq.mobi awency.com
appmsr.org bank.uz
arcadepages.com bausparen.bz.it
arenda-avtoprokat-krasnodar.ru bensbargains.net
asia-forum.ru best-games.today
asseenontv.ru bestcurs.org
atmagroup.ru bestpornuha.com
autochoixspinelli.com bestwebsitesawards.com
autoua.top beta.hotkeys.com
avtovolop.ru beztuberkuleza.ru
babyfactory.fr bio-market.kz
baersaratov.ru bkgr.se
banki76.ru blackle.com
banksrf.ru blagovest-med.ru
bannerpower.com board.f00d.de
beauty-b0x.pl bonzbuddy.com
blockety.co bravegirlsclub.com
blog.axant.it buzzurl.jp
boazpower.com byme.se
brewdom.ru candelluxsklep.pl
bristolhotel.com.ua cars-modification.net
brokergid.ru carsplate.com
bronzeaid-a.akamaihd.net cartiertrinity.xyz
bwlx.prepedu.cn cenoval.ru
cartierjusteunclou.xyz cheapestjerseysonwholesale.com
cartierreplica.top cheapmarmot.online
casinos4dummies.co.uk ci.ua
cfacarrosserie74.com cialgenisrx.com
chatroulette.si clash-clans.ru
chcu.net coccoc.com
cognitiveseo.com coolyarddecorations.com
compliance-irvin.top costablue.xyz
compliance-ivan.top creditmoney.com.ua
compliance-julia.top customchocolate.business-for-home.com
contextualyield.com
copenergo.ru
craftinsta.ru
cwetochki.ru
cyclobenzaprinevstizanidine.blogspot.com
data1.scopich.com data1.scopich.com
delfin-aqua.com.ua davebestdeals.com
demian.kz dbmkfhqk.bloger.index.hr
depositfiles-porn.ga ddospanel.com
detalizaciya-tut.biz demenageur.com
dgfitness.co design-lands.ru
digilander.libero.it dfiles.me
dolohen.com dstroy.su
eets.net duplicashapp.com
empathica.com e705.net
erotag.com earncash.com.ua
evrotekhservis.ru ecommerce-seo.com
exhibitionplus.eu ege-russian.ru
exlarseva.webblog.es elektrozigaretten1.postbit.com
f5mtrack.com emerson-rus.ru
fable.in.ua empis.magix.net
famix.xyz enews.tech
farm26.ru enge-fotzen.info
feeriaclub.ru ereko.ru
felizporno.com escortplius.com
fickluder69.com escortslet.net
europages.com.ru
extads.net
ezigaretteshop.webs.com
farmprofi.net
fidelityfunding.com
findpik.com
finteks.ru finteks.ru
foxinsocks.ru flirt4free.com
fuckmill.com floridamobilebillboards.com
fullfileaccess.com fodelsedagspresenter.nu
funcrushgames.com forex-indextop20.ru
fx-brokers-review.com fyl.com.ru
g33.org gheus.altervista.org
gamewrath.com gigapeta.com
ge0ip.net girlsfuckdick.com
ghernnqr.skyrock.com gk-atlant.info
gombita.info golaya.pw
gomusix.com golden-praga.ru
goodhousekeeping.com greatfind-a.akamaihd.net
gotomontenegro.net hacktougroup.ru
gribokstop.com haikuware.com
growboxbl.ru hard-porn.mobi
guardlink.com hdpixion.com
guildebzh.info hit-men.men
hamilton.ca hiwibyh.bugs3.com
happy.new.yeartwit.com hoholikik.club
heartofpayne.xyz hostnow.men
hostingclub.lk hoztorg-opt.ru
hotcore.info hplaserjetpdriver8y.pen.io
i-service.kz imediadesk.com
ido3.com incep.imagine-ex.co
igithab.com int.search.tb.ask.com
ilbe.club internet-apteka.ru
infobanks.ru inzn.ru
inspiring-desperate.tk keywords-monitoring-your-success.com
intim-uslugi.info kinohit1.ru
izoll.ru kmgamex.cf
karting196.ru komputers-best.ru
kino-ecran.ru lapitec.eu
la-fa.ru laserpen.club
labelwater.se lexiangwan.com
lankarns.com li-er.ru
letmacworkfaster.world lider-zhaluzi.kiev.ua
lifeinsurancekb.com lmrauction.com
mactechinfo.info lostfilm-online.ru
lowephotos.info
maju.bluesalt.co
mansparskats.com
med-zdorovie.com.ua
mediaoffers.click mediaoffers.click
mesbuta.info medispainstitute.com.au
message-warning.net megaindex.ru
metaxalonevstizanidine.blogspot.com meteocast.net
miniature.io milblueprint.com
missclub.info minecraft-rus.org
mmoguider.ru miniads.ca
mobsfun.net mmgq.ru
moomi-daeri.com mobile-appster.ru
mossmesi.com moncleroutletonline.win
movpod.in moonci.ru
moyaterapiya.ru mustat.com
mrmoneymustache.com mybackgroundlandscape.blogspot.com
mrvideospornogratis.xxx mydownloadengine.com
mwtpludn.review myiptest.com
mygameplus.com news-speaker.com
na15.ru nikitabuch.com
newsperuse.com nippon-bearings.ru
nl.netlog.com no-fuel.org
nvformula.ru notasprensa.info
nyfinance.ml nuup.info
o.light.d0t.ru o-o-6-o-o.com
o00.in offergroup.info
obesidadealgarve.com onclickpredictiv.com
office2web.com onlinemegax.com
old-rock.com onstrapon.purplesphere.in
onlywoman.org openfrost.com
ooomeru.ru ownshop.win
ororodnik.goodbb.ru pdn-4.com
paphoselectricianandplumber.com pics-group.com
par-fallen.ga pinup-casino1.ru
parajumpersstore.online pizdopletka.club
pc-services.ru pokemongooo.ml
picture-group.com pony-business.com
picurams.pw pornhub-forum.ga
pirateday.ru pornoklad.net
plaff-go.ru pornoted.com
pogodnyyeavarii.gq prchecker.info
pokemon-go-play.online prefersurvey.net
porndairy.in privatbank46.ru
pornoblood.com prizestohandle.club
pornoreino.com progress-upakovka.ru
powenlite24.ru pron.pro
predmety.in.ua prostitutki-novgoroda.org
privatefx.all4invest.info prostitutki-tyumeni.org
producm.ru puteshestvennik.com
prodvigator.ua rankscanner.com
rankia.com rarbg.to
rapidgator-porn.ga razvratnoe.org
rebuildermedical.com recipedays.ru
remont-ustanovka-tehniki.ru renewablewealth.com
resellerclub.com replicaclub.ru
rewardpoll.com rethinkwasteni.info
rfd-split.hr rfd-split.hr
rockingclicks.com richinvestmonitor.com
ros-ctm.ru ros-ctm.ru
ruclicks.com rustic-quiver.win
rusvideos.su searchaddis.com
safe-app.net semxiu.com
salut-camp.ru seo-2-0.com
scanner-ivan.top seolab.top
scanner-nelson.top sexgalleries.top
sdsjweb.com sexphoto.site
semalt.com sheerseo.com
seocheki.net site5.com
service.adtech.fr
sevenstars7.com
sex-pr.net
sexreliz.com
sextracker.de
shakhtar-doneck.ru
shtaketniki.ru
silktide.com
siteonomy.com siteonomy.com
skypasss.com sms2x2.ru
slavic-magic.ru snow.nvr163.com
smartbalanceworld.com sobecjvuwa.com.ru
sohoindia.net softomix.net
spabali.org stoki.ru
spin2016.cf superiends.org
stretchmate.net superstats.com
students-cheapskate.ml surffoundation.nl
studworks.org susanholtphotography.com
supernew.org
surintech.ac.th
t-bygg.com
td-33.ru
tds-advert005.info tds-advert005.info
teguh.info teguh.info
telegraf.by telesvoboda.ru
ticketsys.inetwd.com thetattoohut.com
tizanidinedruginteractions.blogspot.com tizanidinecapsules.blogspot.com
tizanidinesleepaid.blogspot.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
topcasinoratings.ru tizanidineusedfor.blogspot.com
torrentdownloadhub.com tmm-kurs.ru
torrentred.games torrents-tracker.com
tracxn.com toxicwap.com
tradgardspartner.se trafficjunky.com
trafficmonetize.org treasuretrack-a.akamaihd.net
traffictrade.life trubywriting.com
truck-addzilla.life turkeyreport.tk
trudogolik.net u-cheats.ru
tv-spoty.info u17795.netangels.ru
twittruth.com uasb.ru
umnovocaminho.com ucoz.ru
unmaroll.ya.ru uggbootsoutletsale.us
vandrie-ict.nl ukrtextbook.com
ultramart.biz
vegan-foods.us
vektorpress.ru vektorpress.ru
vezuviy.su vezuviy.su
vielporno.net videochat.mx
vodkoved.ru videojam.tv
warezkeeper.com vipms.ru
watchmygf.net vmnmvzsmn.over-blog.com
webmasters.stackexchange.com wahicbefa31.soup.io
webpromotion.ae wanker.us
webshoppermac.com wapsite.me
wholesalejerseysgaa.com website-analytics.online
wholinkstome.com wfb.hatedriveapart.com
womensplay.net wholesalejerseychinaoutlet.com
worldlovers.ru wholesalejerseys-cheapest.com
www.labves.ru wildnatureimages.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai wowcasinoonline.ooo
xn----itbeirbjbi7bc6bh2d.xn--p1ai xaylapdiendanang.com
youbrainboost.asia xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
zapatosenventa.info xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
zebradudka.com xn--80aodinpgi.xn--p1ai
zeroredirect2.com xn--b1ag5cfn.xn--p1ai
zone-kev717.info yadro.ru
zvetki.ru yebocasino.com
yhit.press
yourmovies.pl
ytmnd.com
yugk.net
zastroyka.org

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.9 0; 10.1.0.170 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2995 ### Version: V4.2022.03.2996
### Updated: Tue Mar 22 22:01:21 UTC 2022 ### Updated: Wed Mar 23 10:04:43 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2995 ### Version: V4.2022.03.2996
### Updated: Tue Mar 22 22:01:21 UTC 2022 ### Updated: Wed Mar 23 10:04:43 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##