vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2998 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-24 10:09:15 +00:00
parent 296c62d82b
commit 1a22de00ba
46 changed files with 97353 additions and 97353 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2997 #### Version: V4.2022.03.2998
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2997 #### Version: V4.2022.03.2998
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2997 #### Version: V4.2022.03.2998
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12034
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2997 #### Version: V4.2022.03.2998
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12038
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12038
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12038
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12038
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2997 2998

12038
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12038
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.173.189.165 0; 52.165.229.217 0;

12038
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

12038
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.173.189.165 0; 52.165.229.217 0;

12038
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.173.189.165 0; 52.165.229.217 0;

12038
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 1; 10.1.0.47 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
360Spider PHPCrawl
EasyDL RepoMonkey
FrontPage SemrushBot
IndeedBot SeoSiteCheckup
OpenVAS T0PHackTeam
OrangeBot Thumbor
SalesIntelligent Titan
Steeler Twice
Woobot gopher
lwp-request seostar

290
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
ADmantX 404checker
404enemy
Aboundex Aboundex
Aboundexbot AfD-Verbotsverfahren
Acunetix AhrefsBot
Alexibot AiHitBot
AllSubmitter Aipbot
AlphaBot
Anarchy Anarchy
Anarchy99
Ankit Ankit
Apexoo Anthill
Atomseobot AwarioRssBot
BDCbot BackStreet
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
Barkrowler Barkrowler
BatchFTP BatchFTP
BetaBot Bigfoot
Blackboard
Blow Blow
Boardreader
Brandprotect Brandprotect
Brandwatch Buck
BunnySlippers BuzzSumo
CATExplorador CATExplorador
CCBot CCBot
CODE87
CensysInspect CensysInspect
CheeseBot CheeseBot
ChinaClaw ChinaClaw
Claritybot Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot Cocolyzebot
Collector Collector
CopyRightCheck
Cosmos
Craftbot Craftbot
DBLBot CrazyWebCrawler
Devil DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
DigitalPebble DigitalPebble
Discoverybot Dirbuster
DomainCrawler Disco
DnBCrawler-Analytics
DomCopBot
Download Wonder
EasyDL EasyDL
Ebingbong Ebingbong
EroCrawler
Evil Evil
Extractor Extreme Picture Finder
ExtractorPro Ezooms
EyeNetIE
FDM FDM
FlashGet FlashGet
Fyrebot Fuzz
FyberSpider
GalaxyBot GalaxyBot
GetRight GetRight
Getintent Getintent
Gigabot
Go!Zilla Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit Gotit
GrabNet GrabNet
Grabber
Grafula
GrapeFX GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
HaosouSpider HaosouSpider
Havij Hloader
Heritrix HybridBot
Humanlinks
IDBot IDBot
Iblog Iblog
IlseBot
Image Fetch Image Fetch
IndeedBot Image Sucker
Indy Library InfoNaviRobot
InfoTekies InfoTekies
Intelliseek InternetSeer
Iskanie Iria
Jbrofuzz
JennyBot JennyBot
JetCar JetCar
JikeSpider Jetty
Jyxobot JustView
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Kinza Kinza
Lanshanbot Kozmosbot
Leap LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
LieBaoFast LieBaoFast
LinkScan Linkbot
LinkWalker LinqiaMetadataDownloaderBot
LinkpadBot LinqiaRSSBot
LinksManager Lipperhey Spider
LinqiaScrapeBot Litemage_walker
MIDown tool MSFrontPage
MJ12bot Magnet
MSIECrawler MarkMonitor
Mass Downloader Mass Downloader
Mata Hari Masscan
Mb2345Browser MauiBot
Mediatoolkitbot MegaIndex.ru
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari Moblie Safari
NICErsPRO Mojeek
Mojolicious
Name Intelligence Name Intelligence
Nameprotect NearSite
Navroad
Needle
Net Vampire Net Vampire
NetAnts
NetLyzer NetLyzer
NetMechanic
NetZIP NetZIP
Nikto Niki-bot
Nimbostratus
Nuclei Nuclei
Octopus Nutch
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas Openvas
OrangeBot OutclicksBot
POE-Component-Client-HTTP PHPCrawl
PageGrabber Pandalytics
Panscient Panscient
Papa Foto Papa Foto
Pavuk
Picscout
Picsearch Picsearch
PictureFinder PictureFinder
Piepmatz
Pimonster Pimonster
Pockey Pixray
Psbot PleaseCrawl
Pu_iN ProPowerBot
PyCurl PxBroker
QueryN Metasearch
RSSingBot RSSingBot
RankActiveLinkBot
Rankivabot
Re-re
ReGet
RebelMouse
Recorder Recorder
RedesScrapy SEOkicks
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SEOstats
SalesIntelligent SMTBot
ScanAlert Scanbot
Screaming
ScreenerBot ScreenerBot
ScrepyBot ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport Seekport
Semrush Semrush
SemrushBot SemrushBot
SeobilityBot SentiBot
Shodan
Siphon Siphon
Sitebeam SiteLockSpider
Siteimprove SiteSnagger
Sitevigil Snake
SmartDownload Snapbot
Snoopy
Sogou web spider Sogou web spider
Sosospider
Sottopop Sottopop
Spammen SpaceBison
SpankBot
Sqlmap Sqlmap
Sqworm Sqlworm
Steeler Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
T8Abot Teleport
TeleportPro TeleportPro
Telesoft Telesphorep
The Intraformant The Intraformant
Toata Thumbor
Tracemyfile
Trendiction Trendiction
Turnitin Turingos
TurnitinBot
Twice Twice
Typhoeus Typhoeus
Upflow URLy Warning
Vagabondo URLy.Warning
VeriCiteCrawler V-BOT
VoidEYE
Voil
WASALive-Bot WASALive-Bot
WEBDAV WEBDAV
WISENutbot WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize Wallpapers
WWWOFFLE Wallpapers/3.0
WeSEE WallpapersHD
Web Collage Web Auto
Web Enhancer Web Enhancer
Web Sucker Web Fuck
WebAuto Web Sauger
WebBandit WebBandit
WebCollage
WebImageCollector WebImageCollector
WebPix WebPix
WebReaper WebReaper
WebZIP WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor WebsiteExtractor
Whack WebsiteQuester
Whatweb Webster
Who.is Bot Who.is Bot
Widow Widow
WinHTTrack WiseGuys Robot
Woobot Woobot
Wprecon Wprecon
Xaldon WebSpider YoudaoBot
Zade Zauba
Zermelo
Zitebot Zitebot
ZmEu
ZoomBot
ZoominfoBot ZoominfoBot
ZyBorg
adscanner
archive.org_bot archive.org_bot
arquivo.pt
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler coccocbot
com.plumanalytics cognitiveseo
crawler.feedback crawl.sogou.com
dataforseo.com demandbase-bot
domainsproject.org
eCatch eCatch
evc-batch
heritrix
internetVista monitor internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
lwp-request
magpie-crawler magpie-crawler
meanpathbot mediawords
muhstik-scan pcBrowser
netEstate NE Crawler
page scorer
plumanalytics plumanalytics
polaris version probe-image-size
ripz
scan.lol
seobility
seocompany.store seocompany.store
seostar seostar
serpstatbot serpstatbot
sexsearcher sexsearcher
sitechecker.pro
sogouspider
sp_auditbot sp_auditbot
spyfu
trendiction.de
voyagerx.com voyagerx.com
webmeup-crawler webgains-bot
webpros.com webpros.com
x09Mozilla x09Mozilla
xpymep1.exe
zgrab

302
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
80legs ADmantX
ALittle Client ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundex
Aboundexbot Aboundexbot
Acunetix AiHitBot
AfD-Verbotsverfahren AlphaBot
AhrefsBot Anarchy
Aipbot
Alexibot
Anarchie
Anarchy99 Anarchy99
Aspiegel Ankit
AwarioSmartBot Atomseobot
BBBike
BDFetch
BLEXBot BLEXBot
Badass
Bandit Bandit
Barkrowler
BatchFTP BatchFTP
BetaBot Battleztar Bazinga
Bitacle
BlackWidow BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Buck Buck
BuiltBotTough
BuiltWith BuiltWith
Bullseye
BuzzSumo
CCBot
CODE87 CODE87
CSHttp Cegbfeieh
CazoodleBot CheeseBot
Chlooe
Citoid Citoid
Claritybot
Cliqzbot Cliqzbot
Collector
Copier Copier
Craftbot CrazyWebCrawler
CrunchBot Curious
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Devil
Digincore Digincore
Dirbuster
Disco Disco
Dispatch Dispatch
DomainCrawler DittoSpyder
DomainSigmaCrawler DnyzBot
DomainAppender
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Download Wonder
Dragonfly Dragonfly
Drip
ECCP/1.0 ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong Ebingbong
EirGrabber
EroCrawler EroCrawler
Evil Evil
Extractor Express WebPictures
Extreme Picture Finder ExtLinksBot
FlashGet EyeNetIE
Flunky Ezooms
GalaxyBot FemtosearchBot
Genieo Foobot
Getintent FrontPage
Go-Ahead-Got-It G-i-g-a-b-o-t
GetWeb
Gotit Gotit
Grafula Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
Haansoft
HaosouSpider HaosouSpider
Humanlinks Harvest
HybridBot HonoluluBot
IDBTE4M
IDBot
IRLbot IRLbot
Id-search Image Sucker
IlseBot
Indy Library Indy Library
InfoNaviRobot
Internet Ninja Internet Ninja
InternetSeer Iria
IstellaBot Iskanie
JOC Web Spider
JamesBOT JamesBOT
JetCar JennyBot
Joomla JikeSpider
Jorgee
Jyxobot Jyxobot
Lanshanbot Keybot Translation-Search-Machine
Larbin Larbin
LeechFTP Libwhisker
Lftp
LieBaoFast LieBaoFast
LinkWalker LinkWalker
Linkbot Linkbot
Linkdexbot Linkdexbot
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot LinksManager
LinqiaRSSBot LinqiaScrapeBot
Lmspider Lmspider
Ltx71 MJ12bot
MSFrontPage
MSIECrawler
Mag-Net Mag-Net
Mail.RU_Bot Majestic SEO
Meanpathbot MarkMonitor
Mata Hari
Mb2345Browser
Mediatoolkitbot Mediatoolkitbot
Metauri MegaIndex.ru
Microsoft Data Access Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Mojolicious Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot Msrabot
Musobot Nameprotect
NPbot Navroad
NetLyzer Needle
NetAnts
NetMechanic
Nettrack Nettrack
NextGenSearchBot
Nibbler Nibbler
NimbleCrawler Niki-bot
Octopus Nimbostratus
Offline Explorer Nuclei
Offline Navigator Nutch
OnCrawl
OpenLinkProfiler
Openfind
Openvas Openvas
OrangeBot
OrangeSpider OrangeSpider
OutclicksBot
OutfoxBot OutfoxBot
PageScorer PECL::HTTP
Papa Foto PageThing.com
PeoplePal Pandalytics
Panscient
Petalbot Petalbot
Picsearch
PictureFinder
Piepmatz Piepmatz
Pimonster
Pixray Pixray
PleaseCrawl PleaseCrawl
ProWebWalker Psbot
Probethenet Pu_iN
PyCurl Pump
QueryN Metasearch PxBroker
Quick-Crawler Re-re
ReGet Reaper
RebelMouse
Recorder
RepoMonkey
Ripper Ripper
RocketCrawler
SBIder SBIder
SEOkicks SEOprofiler
SEOlyticsCrawler SEOstats
SISTRIX SalesIntelligent
SMTBot Scanbot
ScanAlert
ScoutJet ScoutJet
ScreenerBot ScrepyBot
Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot SemrushBot
SentiBot SeobilityBot
SeoSiteCheckup Seomoz
SiteCheckerBotCrawler Siphon
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
SlySearch Snake
Snapbot Snoopy
SocialRankIOBot
Sociscraper Sociscraper
Sosospider Sogou web spider
Sottopop Sottopop
SpaceBison Spammen
Spanner
Spbot Spbot
SputnikBot
Sqlmap Sqlmap
Sqlworm
Sqworm Sqworm
Sucuri Stripper
Szukacz Sucker
SuperHTTP
Surfbot
Suzuran
T0PHackTeam T0PHackTeam
TheNomad The Intraformant
TightTwatBot TightTwatBot
Titan Toweyabot
Tracemyfile Tracemyfile
True_Robot Trendiction
Trendictionbot
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
TwengaBot TwengaBot
URLy Warning Twice
VB Project URLy.Warning
Virusdie Upflow
VCI
Vacuum
VidibleScraper
Voil Voil
WASALive-Bot Voltron
WBSearchBot WBSearchBot
WISENutbot
WPScan
WWW-Collector-E WWW-Collector-E
WeSEE WWW-Mechanize
Web Auto Web Fuck
Web Sauger WebBandit
WebCollage WebCollage
WebCopier
WebGo IS WebGo IS
WebPix WebImageCollector
WebLeacher
WebSauger WebSauger
WebStripper WebStripper
WebSucker WebSucker
WebWhacker
WebZIP WebZIP
Website Quester WebmasterWorldForumBot
WebsiteExtractor Webshag
WebsiteQuester WebsiteQuester
Whatweb Webster
Who.is Bot Who.is Bot
WiseGuys Robot Widow
WinHTTrack
Wonderbot
Woobot Woobot
Wotbox Wprecon
Xaldon WebSpider Zade
Xaldon_WebSpider ZmEu
Xenu ZoomBot
Zauba ZoominfoBot
Zeus
ZumBot ZumBot
archive.org_bot
arquivo.pt arquivo.pt
clark-crawler clark-crawler
coccocbot
cognitiveseo
com.plumanalytics com.plumanalytics
crawl.sogou.com
crawler.feedback crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org domainsproject.org
eCatch instabid
internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
magpie-crawler magpie-crawler
meanpathbot
mediawords mediawords
seostar muhstik-scan
sexsearcher plumanalytics
sp_auditbot polaris version
sysscan ripz
trendiction.com satoristudio.net
trendiction.de scalaj-http
scan.lol
sitechecker.pro
siteripz
sogouspider
tAkeOut
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler webprosbot
x09Mozilla
x22Mozilla x22Mozilla
xpymep1.exe xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
cheapmoncler.pw cartierlove2u.xyz
daptravel.com dairyindia.in
etm-consult.de day-news.info
glcomputers.ru docsportal.net
homeart.space evehemming.blogspot.com.au
kidskunst.info sbornik-zakonov.ru
seoboxes.com seo-traffic-ranking.info
shivafurnishings.com taqywu51.soup.io
vksex.ru theporndude.com
voditeltrezviy.ru video-chat.cn

938
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
100dollars-seo.com 1-99seo.com
11235813.webzdarma.cz 100searchengines.com
13tabs.com 10bet.com
1flag.co.za 123movies.love
2345.com 18ps.ru
2kata.ru 2ads.co.uk
6hopping.com 4kplayer.pl
7a2rnuey1tw9ar.ru 57883.net
a1security.com.ua 5ws.dating-app.ru
aa08daf7e13b6345e09e92f771507fa5f4.com 7search.com
aa81bf391151884adfa3dd677e41f94be1.com 8558l.jobs.net
aa8b68101d388c446389283820863176e7.com 999webdesign.com
aaronabel.com aanapa.ru
aasoldes.fr adcash.com
abcdeg.xyz adobereader-free.ru
abcguru.xyz adtech.us
acc.eu.org adverster.com
accessoires-mode.in adviceforum.info
ad-words.ru agardomains.com
adclickthru.net agreda.pluto.ro
addbin.men aimayangzhi.com
addblueoff.com.ua alfabot.xyz
admeasures.com allcredits.su
adpremium.org allnews24.in
afora.ru alt-servis.ru
airlandsea.info amateurmatch.com
alfa-medosmotr.ru amazingpic.net
alfapro.ru amazon-adsystem.com
alibestsale.com amehdaily.com
alkoravto.ru amyfoxfitness.com
all4invest.info animebox.com.ua
altamayoztourism.com apessay.com
aludecor.info api.stathat.com
am15.net
apiadanaknet-a.akamaihd.net apiadanaknet-a.akamaihd.net
apibetweenlinesn-a.akamaihd.net apifasterlightin-a.akamaihd.net
apiluckyleapnet-a.akamaihd.net apiitsthirteende-a.akamaihd.net
appleid-verification.com app5.letmacworkfaster.world
aramaicmedia.org appfastplay.com
arate.ru apxeo.info
arenda-avtoprokat-krasnodar.ru arendakvartir.kz
arkartex.ru arkartex.ru
ascat.porn artparquet.ru
asdfg.pro asrv-a.akamoihd.net
asophoto.com asseenontv.ru
atmagroup.ru atovh.local-finders.com
atmovs.com auto-moto-elektronika.cz
autoloans.com autoblogger24.info
avirasecureserver.com autorn.ru
avon-ukraine.com avitocars.ru
avtointeres.ru avtochehli.by
azbukadiets.ru azartclub.org
azlex.uz back.dog
azte.ch balitouroffice.com
bablonow.ru balook.com
bankiem.pl bangla-chat-uk-paralud.ga
bazaronline24.ru banksrf.ru
bedandbreakfast.com batanga.net
belsetirehafi.tk beachdriveblog.com
best-businessman.ru beachtoday.ru
bestcoin.cc beremenyashka.com
bestmouthwash.club bestempresas.es
bestprofits-there.com bestofupload.info
beta.hotkeys.com bestwaystogetpaid.us
betune.onlinewebshop.net bezlimitko.xyz
bif-ru.info biketank.ga
bizcheapjerseyswholesalechina.com bimatoprost-careprost.com.ua
bkgr.se bingoporno.com
blog.koreadaily.com bizfly.info
bloglag.com biznesrealnost.ru
blpmovies.com bobinoz.com
blue-square.biz boeuklad.com
bochemit.com.ua boo-arts.com
bosefux.esy.es bookmark4you.com.biz
browsepulse-a.akamaihd.net brandbucket.com
browserprotecter.com breastaugmentation.co.za
bugof.gq brg8.com
burger-imperia.com btnativenav.com
businesxxl.com budpost.com.ua
buttons-for-your-website.com buy-loft.ru
buy-meds24.com buyantiviralwp.com
buyparajumpers.online buytizanidineonline.blogspot.com
c-gainsbourg.com byme.se
capsderfudd.tk calc-for-credit.ru
carina-sy.de californianews.cf
carrauterie.be call-of-duty.info
cartierbraceletsreplica.pw callawaygolfstore.online
centre-indigo.org.ua cand.jp
cezartabac.ro candlewooddentalcentre.com.au
cheapestjerseys-wholesale.com candycrushshop.com
cheapmarmot.online cdncash.com
cheapmoncler.win certifywebsite.win
cheapwebsitehoster.com changde.58.com
checkm8.com cheapestjerseysonwholesale.com
checkpagerank.net cheapsergiorossi.online
checktext.org
children-learningreading.info
chinaelitecheapjerseys.com
chocolateslim-en-espana.com
chuckguilford.com chuckguilford.com
clean-start.net cialgenisrx.com
clipartnew.com ciceros.co
cocyq.inwtrade.com club-lukojl.ru
compliance-alex.top coaching-netz.info
compliance-don.xyz coldfilm.ru
compliance-jess.top cometorussia.net
compliance-mark.top communisave.co.za
compliance-barak.xyz
compliance-donald.xyz
compliance-fred.top
compliance-irvin.xyz
compliance-josh.top
compucelunlock.net compucelunlock.net
conocer-sanabria.com computernetworksonline.com
creatives.adbetclickin.pink conboy.us
cscwtalkto.site connectionstrenth.com
coolyarddecorations.com
covetnica.com
crackzplanet.com
crd.clan.su
customergrowthsystems.com customergrowthsystems.com
customerpromos-a.akamaihd.net d0t.ru
cutalltheshit.com dealwifi.com
dailyrank.net decenttools.com
danceuniverse.ru defenderxtactical.com
dandiyabeats.in delta-line.men
danschawbel.com den-noch24.ru
ddpills.com
delfin-aqua.com.ua
dellalimov.com
dentalpearls.com.au dentalpearls.com.au
derevesendeco.com diegolopezcastan.com
design-ideas.info diffbot.com
designdevise.com dignitasdata.se
detsky-nabytek.info djstools.com
dev78.dioniqlabb.se docs4all.com
digilander.libero.it domainsphoto.com
dipstar.org doublepimp.com
djihispano.com downloadmefiranaratb1972.xpg.com.br
domain-submit.info downloads-whatsapp.com
domain.webkeyit.com drhomes.biz
doyouknowtheword-flummox.ml drivotracker.com
draniki.org dstroy.su
droidlook.net eager-nash.188-93-233-196.plesk.page
dverimegapolis.ru earl-brown.info
dvervmoskvu.ru ebooknovel.club
easync.io ekspertmed.com
ednorxmed.com electrik-avenue.com
el-nation.com emailaccountlogin.co
elektrischezigarette1.blog.pl ero-advertising.com
elektronischezigarettekaufen2.tumblr.com eshop.md
elektrozigarettekaufen2.blogse.nl
englate.com
erotiktreff24.info
es5.com
etenininrade.ga
etotupo.ru etotupo.ru
eu-cookie-law.blogspot.com
eupornstar.info eupornstar.info
event-tracking.com
everypony.ru
evogarage.com evogarage.com
excaliburfilms.com exoclick.com
excitacao.com expertnaya-ocenka.ru
exlarseva.webblog.es extremal-blog.com
expresstoplivo.ru extremepornos.net
extener.org extstat.com
ezigarettenshop2.postbit.com ezigarettekaufen2.blox.pl
ezofest.sk ezigarettenkaufen1.deviantart.com
fanoboi.com falcon-images.blogspot.com
fermersovet.ru fast-torrent.ru
fertilitetsradgivningen.se fdzone.org
fickkontakte.org feargames.ru
fidelityfunding.com feorina.ru
filmbokep69.com ff30236ddef1465f88547e760973d70a.com
fickluder69.com
filmidivx.com
financepoints.eu
financetip.eu
fishingwholesale.us
fitness-video.net
flagcounter.me
floating-share-buttons.com floating-share-buttons.com
foto-basa.com forex-procto.ru
foto-sisek.porngalleries.top forpackningsutveckling.se
freecamdollars.com forzeronly.com
freeuploader.com foxweber.com
frivgame250.com franch.info
frvo.alptandem.ru freegamesplay.online
fsakhalin.ru ftns.ru
fusoradio.info fungamelands.com
gamebackyard.com fyl.com.ru
gamevalue7.weebly.com gallery.rennlist.com
gaming-journal.com
gamingspark.com
gardene.ru gardene.ru
gearsadspromo.club gaz-voshod.ru
geoads.com generic-pills-online.com
get-free-traffic-now.com genericviagrasildenafiled.net
getmyads24.com germes-trans.com
getpopunder.com
gifspics.com
globalsurfari.com globalsurfari.com
goforexvps.com go2album.com
gosreg.amchs.ru goatse.ru
gq-catalog.gq good-mummy.ru
graphics8.info goodhousekeeping.com
growboxbl.ru googst2.ru
gymi.name gotwebsite1.com
haikuware.com gribokstop.com
handicapvantoday.com gz2.bbsoldes.fr
hatdc.org hanwei.us
hcate.com hd-film.pl
hdpixion.com heartofpayne.xyz
hdseriale.pl heatpower.ru
healthcarestore.info hesteel.pl
herokuapp.com hetmanship.xyz
hmmm.cz hit-kino.ru
hmywwogw.bloger.index.hr hit-men.men
hobbyhuren-datenbank.com hledejvshopech.cz
horoshieokna.com hostsshop.ru
hothot.ru hotcore.info
houdom.net hotelcrocenzi.sm
hoverboard360.nl hotxnights.info
hydropump.su house.sieraddns.com
iklysha.ml hoverboard360.se
ilmen.net howlongdoestizanidinestayinyoursystem.blogspot.com
ilte.info hplaserjetpdriver8y.pen.io
impresagaia.it hscsscotland.com
inboundlinks.win hvd-store.com
indo-export.ru iccornacircri.cf
insta-add.pro iflycapetown.co.za
interesnie-faktu.ru ihtec2019.org
imagine-ex.co
imagui.eu
inet-traffic.com
internet-apteka.ru
intimshop-fantasy.ru
investpamm.ru
iptool.xyz iptool.xyz
iqbazar.ru ispac.org
iradiology.ru itservicesthatworkforyou.com
itbc.kiev.ua izismile.com
ivearchenceinflu.cf jbl-charge.info
iweblist.info jerseychinabizwholesale.us
jabimgo.pw jyrxd.com
jacago.com kam-dom.ru
jerseyswholesalechinalimited.com kaz.kz
jjbabskoe.ru kerwinandcariza.com
jongose.ninja kimcurlrvsms.com
junketjuice.blogspot.com
kaac.ru
kakadu-interior.com.ua
kaliningrad.zrus.org
kareliatobacco.ru
keenoutlet.online
keywordglobal.co.za
kino-fun.ru
kino2018.cc
kinohit1.ru
kiwi237au.tk
kletkimehan.ru
kmd-pto.ru
knowyournextmove.com knowyournextmove.com
konturkrasoty.ru koronirealestate.gr
krasnodar.xrus.org kotaku.com
krassh.ru labplus.ru
kustanay.kz laexotic.com
lapitec.eu larchik.net
lapolis.it leboard.ru
laptoper.net ledpolice.ru
larutti.ru levaquin750mg.blogspot.com
laserpen.club lflash.ru
law-check-two.xyz life-instyle.com
leadwayau.com lightinghomes.net
liffa.ru linkbux.ru
likesuccess.com linkredirect.biz
lineavabit.it lion.playtap.us
livefixer.com liverpool.gsofootball.com
livejasmin.com llastbuy.ru
ljusihus.se loftdigital.eu
lol-smurfs.com love-baby.cz
lomza.info low-format.ru
lonely-mature.com macrotek.ru
lonfon.xyz mafa-free.com
lookingglassemb.com magazin-pics.ru
lost-alpha.ru mainhp.net
macdamaged.space maladot.com
macresource.co.uk marketland.ml
mainlinehobby.net martlinker.com
manipulyator-peterburg.ru marwer.info
mantramusic.ru mastershef.club
massage-info.nl masturbate.co.uk
matsdale.com mcar.in.ua
mature.free-websites.com medicinacom.ru
max-p.men medosmotr-ufa.ru
maxxtor.eu
medispainstitute.com.au
mega-polis.biz.ua mega-polis.biz.ua
mejoresfotos.eu megagrabber.ru
member-quiz.com megaindex.ru
metafilter.com meget.co.za
metaxalonevstizanidine.blogspot.com message-warning.net
middlerush-a.akamaihd.net metabar.ru
miniature.io micasainvest.com
mir-limuzinov.ru minegam.com
mirzonru.net mirobuvi.com.ua
modabutik.ru mmog-play.ru
mobsfun.net
modnie-futbolki.net
moesen-ficken.com moesen-ficken.com
money-every-day.com mojaocena.com
moomi-daeri.com monarhs.info
morf.snn.gr moneyviking-a.akamaihd.net
morocco-nomad-excursions.com
moscow-clining.ru moscow-clining.ru
mozello.ru mosdverka.ru
msk-diplomat.com mrwhite.biz
mturkcontent.com multgo.ru
muz-tracker.net muschisexbilder.com
mydearest.co musezone.ru
mydownlodablefiles.com musflashtv.com
myfreecams.com musicas.baixar-musicas-gratis.com
mylida.org musicpro.monster
mymobilemoneypages.com musicstock.me
mygameplus.ru
mysexpics.ru
naperehresti.info naperehresti.info
natali-forex.com naphukete.ru
national-today-winning-winner.club netfacet.net
naturalpharm.com.ua newfilmsonline.ru
naturtreenspicerx.pw nextconseil.com
networkcheck.xyz nikitsyringedrivelg.pen.io
newsperuse.com nordstar.pro
nextlnk12.com nordvpn.com
nisuturnetdgu.tk noscrapleftbehind.co
njkmznnb.ru novgorod.xrus.org
njpalletremoval.com nsatc.net
nmrk.ru obiavo.net
nonews.co offer.camp
nosecret.com.ua oivcvx.website
november-lax.com okmusic.jp
ntic.fr oneminutesite.it
obesidadealgarve.com open-odyssey.org
obiavo.com ops.picscout.com
offers.bycontext.com optom-deshevo.ru
offtopic.biz outpersonals.com
oktube.ru panamaforbeginners.com
oneshotdate.com papasdelivery.ru
onetravelguides.com parlament.biz
onlinetvseries.me partnerads.men
optibuymac.com pertlocogasilk.tk
osb.se11.ru photosaga.info
otbelivanie-zubov.com picturesify.com
ourville.info pinwallpaper.xyz
outshop.ru pipki.r.acdnpro.com
paceform.com pizdopletka.club
paclitor.com plaff-go.ru
parajumpersstore.online platezhka.net
photo-clip.ru polska-poezja.com
pigrafix.at pons-presse.com
pillscheap24h.com pontiacsolstice.info
pio.polytopesexempt.com porno-transsexuals.ru
pixgood.com pornogad.com
pixshark.com pornzone.tv
plastgran.com powitania.pl
pokemon-go-play.online predmety.in.ua
polybuild.ru pretty-mart.com
poptool.net pricheski-video.com
popugaychiki.com pro-poly.ru
pornokajf.com productarium.com
pornoklad.ru prokotov.com
pornolook.net pyramidlitho.webs.com
pornosemki.info randki-sex.com
preconnubial.usuby.site ranksonic.org
pregnant.guru
privatefx.all4invest.info
producm.ru
professionalwritingservices15.blogspot.ru
promoforum.ru
queerspace.com
quelle.ru
radiodigital.co
rating-bestcasino.com
realmonte.net realmonte.net
reckonstat.info registry-cleaner.net
rednise.com reining.lovasszovetseg.hu
remont-comp-pomosh.ru remontgruzovik.ru
remont-fridge-tv.ru renewablewealth.com
rentaremotecomputer.com replicalouboutin.xyz
rfd-split.hr research.ifmo.ru
rff-cfal.info
rialp.getenjoyment.net rialp.getenjoyment.net
ritlweb.com rixpix.ru
robertefuller.com rockingclicks.com
rubanners.com roofers.org.uk
ruclicks.com rootandroid.org
roznica.com.ua
ruf777.com
rukino.org rukino.org
rumamba.com russkoe-zdorovie.ru
russia-today-video.ru rvzr-a.akamaihd.net
saletool.ru saletool.ru
sawin.beth.webd.pl sarahmilne.top
scanner-marwin.top satellite.maps.ilovevitaly.com
scottbywater.com scanner-nelson.top
sdi-pme.com sdrescher.net
secret.xn--oogle-wmc.com search-goo.com
semprofile.com sel-hoz.com
seomarketings.online semalt.com
serw.clicksor.com semaltmedia.com
sexflirtbook.com semxiu.com
shijian.ac.cn seorankinglinks.com
shitmovs.com sexcamamateurchat.com
shohanb.com sexsaoy.com
shopfishing.com.ua sfd-chess.ru
shopwme.ru shemale-sex.net
siteimprove.com sherlock.se
sizeplus.work sideeffectsoftizanidine.blogspot.com
slavia.info sierraapps.com
smadihome.com silvercash.com
smartpet.ru sispe.com.br
sms2x2.ru siteexpress.co.il
skutecznetabletkinaporostwlosow.pl
slim.sellany.ru
slutloadlive.com
smallseotools.com
snjack.info
snjatie-geroinovoy-lomki.ru
snyatie-lomki-v-stacionare.ru snyatie-lomki-v-stacionare.ru
soblaznu.net soc-proof.su
socialbuttons.xyz social-s-ggg.xyz
sstroy44.ru sohoindia.net
startufa.ru solution4u.com
stats-collector.org songplanet.ru
staynplay.net spin2016.cf
sticken.co sribno.net
store-rx.com start.myplaycity.com
streha-metalko.si steamoff.net
subj.ukr-lit.com stevemonsen.com
suhanpacktech.com stillmiracle.com
superinterstitial.com strangeduckfilms.com
surgut.zrus.org stroimajor.ru
suture.co stroydetali.ru
swinon.site stroyhelp-dv.ru
t-bygg.com stuff-about-money.com
sugarlyflex.pw
sugvant.ru
sukarame.net
sundrugstore.com
supermodni.com.ua
support.nopeas.sk
tam-gde-more.ru tam-gde-more.ru
taraz.xkaz.org tedxrj.com
tattooreligion.ru tedy.su
telefonsexsofort.tk teslathemes.com
telegramdownload10.com tgtclick.com
tfxiq.com thedownloadfreeonlinegames.blogspot.com
thecoolimages.net thesmartsearch.net
thegalerie.eu titelhelden.eu
theheroes.ru tizanidinedruginteractions.blogspot.com
thepornsex.org tizanidinehcl4mgisitanarcotic.blogspot.com
tizanidinedrugtest.blogspot.com tizanidinevscyclobenzaprine.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com top10-way.com
tizanidinemusclerelaxant.blogspot.com torrent-to-magnet.com
tnctrx.com torrents-tracker.com
tracklead.net tourismvictoria.com
trafficshaper.com trackmedia101.com
traxdom.ru traffictrade.life
traffmonster.info
tramadolandtizanidine.blogspot.com
tri-slona.org
trkdf.com trkdf.com
truck-rece.life
tryrating.com tryrating.com
twiclub.in tupper-posuda.ru
twittruth.com turbo-suslik.org
twodollarshows.com twittrading.com
tzritel.tk uchetunet.su
uac.net.au ugguk.online
unlimitdocs.net uhodzalijami.ru
urccvfmc.bloger.index.hr umaseh.com
url-img.link umityangin.net
urldelivery.com uogonline.com
usdx.us uptime-gamma.net
utrolive.ru uptimebot.net
v720hd.ru ussearche.cf
vchulkax.com uytmaster.ru
vduplo.ru valoresito.com
vekzdorov.ru vancleefreplica.pw
veselokloun.ru vapeface.club
vids18.site vapomnoncri.tk
vikistars.com varikozdok.ru
vintontech.info vezuviy.su
vitanail.ru viagroid.ru
viven.host.sk video-chat.love
viveresaniesnelli.it videochat.mx
vksex.ru videogamesecrets.com
vseigry.fun vizitki.net
wahicbefa31.soup.io vkontarkte.com
watch-movies.ru vladhistory.com
waterefficiency.co vladimir.zrus.org
webads.co.nz vltai.com
webkeyit.com voloomoney.com
weboptimizes.com vucms.com
webpromotion.ae vzlomtw.com
website-analytics.online watchmygf.net
website-datenbank.de webextract.profound.net
wedding0venues.tk webix.me
westen-z.life webmasters.stackexchange.com
whatistizanidine2mg.blogspot.com wfb.hatedriveapart.com
white-truck.life where-toget.com
woman-tampon.ru wineitudes.wordpress.com
word-vorlagen.xyz wineration.com
workle.website wpthemedetector.co.uk
writersgroup580.web.fc2.com
wsgames.ru
wtsindia.in wtsindia.in
www.888.com xfire.com
www.kabbalah-red-bracelets.com
www.souvenirua.com
x-stars.ru
xbaboon.com
xboxster.ru
xchangetrak.com
xmladserver.com
xn----9sbubg3ambdfl1j.xn--p1ai xn----9sbubg3ambdfl1j.xn--p1ai
xn----dtbndd4ae7eub.top xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--80ahvj9e.xn--p1ai xxxsiterips.xyz
xn--b1ag5cfn.xn--p1ai yeartwit.com
xn--d1abj0abs9d.in.ua
xn--d1aifoe0a9a.top
xportvusbdriver8i.snack.ws
xxlargepop.com
xz618.com
yellowads.men yellowads.men
yottos.com yellowstonesafaritours.com
youdao.com youdesigner.kz
yougotanewdomain.com youradulthosting.com
yourads.website zacreditom.ru
yourothersite.com zagadki.in.ua
youtubedownload.org zakonobosago.ru
yugk.net zapatosenventa.info
yur-p.ru zarabiaj-dzis.pl
zaidia.xhost.ro zarabotat-na-sajte.ru
zdesoboi.com zdesoboi.com
zeleznobeton.ru znakom.sibtest.ru
zeroredirect7.com zolotoy-lis.ru
zeroredirect9.com zrelaya.pw
zhuravlev.info
zmoda.hostreo.com
znaturaloriginal.com
zs2vm.top
zx6.ru zx6.ru

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123cha.com 100dollars-seo.com
2daytrendingnews.com 123any.com
3rbseyes.com 123locker.com
4istoshop.com 1bet.com
5u.com 4kpics.rocks
a1security.com.ua 7minuteworkout.com
absolute-s.ru abiente.ru
absolutelyanalog.com academiacsmendoza.org
acmebtn.ml adconscious.com
activepr.ru admitad.com
admanaerofoil.com
adzpower.com
ahhjf.com ahhjf.com
alfa-medosmotr.ru akuhni.by
alkoravto.ru albumsuper.info
alloysteel.ru alice.it
allstatesugarbowl.org android-systems.ru
alvtank.se anlimebel.kiev.ua
amazingninja.com appsaurus.com
ample-awards-today.us arendakvartir.kz
amung.us arendovalka.xyz
apimegabrowsebiz-a.akamaihd.net asiavirtualsolutions.com
appearance-cool.com atelielembrancaqueencanta.com.br
apper.de auto.rusvile.lt
autogrep.ru autoloans.com
avirasecureserver.com autoseo-traffic.com
avitocars.ru babs.com.ua
ayeartoforget.com balkanfarma.ru
beachtoday.ru bankofthewext.com
bestmobilityscooterstoday.com bashtime.ru
betterscooter.com bdsmgalls.net
beyan.host.sk beachdriveblog.com
bimatoprost-careprost.com belsetirehafi.tk
blog.koreadaily.com bestwrinklecreamnow.com
bluerobot.info betteroffers.review
bigcities.org
bingoporno.com
birzha-truda.eu
bitporno.sx
bjanshee.ru
blog.yam.com
bloggen.be
bmw-ark.ru
boostmyppc.com
brandov.ru brandov.ru
bronzeaid-a.akamaihd.net bronzeaid-a.akamaihd.net
btnativenav.com btnativenav.com
buqayy0.livejournal.com buyhoverboard.com
c-gainsbourg.com cakesplus.com.au
cardsdumps.com cete.ru
carrauterie.be chimiver.info
cartierwatch.xyz cinemaflix.website
cezartabac.ro clickaider.com
chatroulette.video clickso.com
cheapjerseysfootballshop.com cobaltpro.ru
checkhit.com compliance-fred.top
chelnytruck.ru compliance-willy.top
chocolateslim-en-france.com cornerstone-countertops.com
chocolateslim-u-srbiji.com dating-time-now.com
christianlouboutinshoes.xyz db.speedup.gdn
cialis-samples.com demon-tweeks.com
circlesl.com depositfiles-porn.ga
clean-start.net download-walpaperhd.blogspot.com
clothesforcash.com e-buyeasy.com
compliance-alexa.xyz easytuningshop.ru
coolgramgoods.com ebooknovel.club
creditwell.ru ecommerce-seo.org
cubs-jerseys.us egovaleo.it
cwetochki.ru elektrischezigarette1.onsugar.com
cyprusbuyproperties.com elidelcream.weebly.com
damedingel.ya.ru essay-writing.work
decenttools.com etotupo.ru
den-noch24.ru excitacao.com
diarioaconcagua.com ezigarettekaufen2.blox.pl
disruptingdinnerparties.com ezigaretteshop2.vefblog.net
drillsaw.ru f00kclan.de
e-avon.ru facebook-mobile.xyz
ekaterinburg.xrus.org falcon-images.blogspot.com
elexies.info ferrotodo.com
elitesportsadvisor.com ff30236ddef1465f88547e760973d70a.com
eng-lyrics.com filmci.pro
enthuse.computernetworksonline.com floridahuntingfishingadventures.com
erot.co franch.info
erotik-kostenlos.net frustrated-favorable.gq
eupornstar.info fuckmill.com
expresstoplivo.ru galaxyflowers.ru
ezigarettenshop2.myblog.de galeria-zdjec.com
ezigaretteshop.webs.com gay-site.store
f1nder.org gazobeton-p.com.ua
feargames.ru gcup.ru
fitness-video.net ge0ip.org
forex.osobye.ru germes-trans.com
forums.toucharcade.com gnuetella.com
fotopop.club gomusix.com
gallery.rennlist.com gta-top.ru
gamerscorps.com hccoder.info
gdebestkupit.ru hchha.com
gdzkurokam.ru healthcarestore.info
getlaid-xxxhookupdirect.com herokuapp.com
gktt.ru highstairs-a.akamaihd.net
glavprofit.ru hikesearch.net
glavtral.ru holidaypics.org
goodly.pro hotel-mkad.ru
google-liar.ru ihc2015.info
gungamesz.com ilikevitaly.com
gwebtools.com ilo134uloh.com
gwhwpxbw.bloger.index.hr
handsandlegs.ru
homedecorpicture.us
hotshoppymac.com
hotxnights.info
houseofgaga.ru
hundejo.com
ideibiznesa2015.ru
imagui.eu imagui.eu
immigrational.info img.wallpaperstock.net
importchinacoach-teach.com incanto.in.ua
infokonkurs.ru infobanks.ru
ivanstroi.ru infowarcraft.ru
jackwolfskinoutlet.online instasexyblog.com
job.icivil.ir itronics.ca
jrcigars.com johnrobertsoninc.com
juliadiets.com jwcialislrt.com
kakablog.net jyrxd.com
keywordsuggest.org ketoanhanoi.info
kino2018.club kfon.eu
kinohall.ru kinoduh.ru
klejonka.info kinoflux.net
klumba55.ru konkursowo-24.pl
knigonosha.net konteiner24.com
krasnodar.xrus.org lafourmiliaire.com
kupit-adenu.ru ldrtrack.com
larchik.net life-instyle.com
laxob.com lockerz.com
lazy-z.com lodki-pvh.dp.ua
levaquin750mg.blogspot.com m.b00kmarks.com
linkbuddies.com
linksharingt.com
lion.playtap.us
locksmith.jp
machicon-ueno.info machicon-ueno.info
mactechinfo.info magda-gadalka.ru
marcoislandvacations.net makedo.ru
marketland.ml map028.com
master-muznachas.ru mhtr.be
mnimmigrantrights.net militarysale.pro
moesen-ficken.com mindeyegames.com
moje-recenze.cz mirobuvi.com.ua
monclerboots.xyz mmofreegames.online
monsterdivx.tv morefastermac.trade
most.gov.iq most-kerch.org
moxo.com music7s.me
mrsdalloways.com mustwineblog.com
muschisexbilder.com nacap.ru
mylesosibirsk.ru nibbler.silktide.com
mymercy.info nomuos.it
nac-bearings.ru o-o-11-o-o.com
najaden.no offf.info
nastydollars.com okmusic.jp
nbsproject.ru
neobux-bg.info
nfljerseysforsalewholesaler.com
nikkiewart.ru
noscrapleftbehind.co
oklogistic.ru
olvanto.ru
online-sbank.ru online-sbank.ru
onlinedomains.ru onlyforemont.ru
ooo-gotovie.ru openstat.com
openmediasoft.com ops.picscout.com
ordernorxx.com oxford-book.com.ua
ownshop.cf palocco.it
pay2me.pl par-fallen.ga
petedrummond.com partybunny.ru
pinup-casino1.ru pcimforum.com
playboyfiles.xblog.in pics-group.com
picture-group.com
pix24x7.com
pl.id-forex.com
platezhka.net
pogodnyyeavarii.gq
poisk-zakona.ru
popander.mobi popander.mobi
popup-jdh.xyz popup.matchmaker.com
pornoxxx.com.mx pornoslive.net
praisong.net pornzone.tv
producm.ru porto.abuilder.net
py100.ru printdirectforless.com
questionmarque.ch privacyassistant.net
quickloanbank.com proekt-gaz.ru
qwertty.net prostitutki-rostova.org
rankings-analytics.com pufip.com
rcb101.ru puserving.com
responsive-test.net q-moto.ru
respublica-otel.ru quit-smoking.ga
retreatia.com rabotaetvse.ru
robertefuller.com rangjued.com
rus-teh.narod.ru rangoman.date
russkoe-zdorovie.ru razleton.com
rutor.vip ritlweb.com
s-forum.biz rn-to-bsn.com
sampleletters.net rome2rio.com
searchinterneat-a.akamaihd.net sabaapress.com
sexad.net safe-app.net
sexvporno.ru sbt-aqua.ru
sfd-chess.ru scalerite.co.za
si-unique.com scripted.com
siha.de sexuria.net
sirpornogratis.xxx sharebutton.to
siteexpress.co.il ship-marvel.co.ua
slimcdn.com sispe.com.br
social-s-ggg.xyz sitebeam.net
socialmadesimple.com skutecznetabletkinaporostwlosow.pl
softomix.net slujbauborki.ru
softwaretrend.net smichovbike.cz
spidtest.space soaksoak.ru
stard.shop social-buttons.xyz
stardevine.com solicita.info
tandvardshuset.net souvenirua.com
teenforporn.com statoutlook.info
tetracsaudi.com svetodiodoff.ru
thefds.net taboola.com
thin.me.pn tarad.com
tizanidinehcl2mg.blogspot.com thetattoohut.com
tizanidinevssoma.blogspot.com thewebsitetemplate.info
tonerbox.kz tizanidineshowupondrugtest.blogspot.com
topdownloads.ru tizanidineusedfor.blogspot.com
torrents.cd toolsky.com
tuberkulezanet.ru tozup.com
tuckpointingmasonrysystems.com traffictrade.life
turist-strani.ru try-rx.com
ucsol.ru tversvet.ru
uggbootsoutletsale.us twodollarshows.com
umekana.ru typimga.pw
usadacha.net ukrobstep.com
vbabule.net ultimateclassicrock.com
veles.shop unrealcommander.biz
via-energy-cumpara.com uptime-alpha.net
videochaty.ru ural-buldozer.ru
vietimgy.pw uroki.net
vilingstore.net ussearche.cf
vip-parfumeria.ru usswrite.com
visa-china.ru uytmaster.ru
voditeltrezviy.ru video--production.com
website-audit.com.ua video-camer.com
website-speed-check.site videtubs.pl
wechatdownload10.com virtuagirl.com
westen-z.life vkontarkte.com
wma-x.com vykup-avto-krasnodar.ru
wnoz.de vykupavto-krasnodar.ru
wowas31.ucoz.ru wallpapers-best.com
watch-movies.ru
websiteaccountant.de
whatsupinfoley.com
whengirlsgowild.com
windowssearch-exp.com
winterclassichockeyjerseys.com
writersgroup580.web.fc2.com writersgroup580.web.fc2.com
wyniki-lista.pl www.888.com
x-mix.info xboxster.ru
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai xmlinde.com
xn----dtbndd4ae7eub.top xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xn--80aaaks3bbhabgbigamdr2h.xn--p1ai
yeartwit.com xn--80ahvj9e.xn--p1ai
zarabotok--doma.ru xz618.com
zastenchivosti.net yuarra.pluto.ro
zatjmuzu.info yugk.net
zoompegs.com zeroredirect1.com
zscalertwo.net zoogdinsney.com
zvetki.ru zreloeporno.tv
zynax.ua

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.2.0 0; 10.1.0.47 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2997 ### Version: V4.2022.03.2998
### Updated: Wed Mar 23 22:01:21 UTC 2022 ### Updated: Thu Mar 24 10:03:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2997 ### Version: V4.2022.03.2998
### Updated: Wed Mar 23 22:01:21 UTC 2022 ### Updated: Thu Mar 24 10:03:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##