vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 02:29:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2906 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-08 22:07:19 +00:00
parent 74aaabcf2e
commit b9791bd791
47 changed files with 92721 additions and 92711 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2905 #### Version: V4.2022.02.2906
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2905 #### Version: V4.2022.02.2906
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2905 #### Version: V4.2022.02.2906
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11452
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2905 #### Version: V4.2022.02.2906
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11456
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11456
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11456
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11456
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2905 2906

11456
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11456
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.165.229.237 0; 13.66.244.148 0;

11456
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

11456
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.165.229.237 0; 13.66.244.148 0;

11456
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.165.229.237 0; 13.66.244.148 0;

11456
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 1; 10.1.1.183 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BBBike 01h4x.com
BuiltBotTough Alexibot
CODE87 ChinaClaw
IlseBot Lipperhey
Meanpathbot NetZIP
Metauri Snapbot
Openvas Spammen
PeoplePal WASALive-Bot
Toata WWWOFFLE
sexsearcher heritrix

314
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker 404enemy
80legs AIBOT
ASPSeek Acunetix
Aboundexbot Anarchie
Aipbot Aspiegel
Anthill Atomseobot
Asterias
Attach Attach
AwarioRssBot AwarioRssBot
BBBike BDCbot
BDFetch BackStreet
BLEXBot Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Badass Badass
Bigfoot Bandit
Bitacle BatchFTP
Black Hole BlowFish
Blow Boardreader
Bolt
Brandprotect
Buck Buck
BuiltWith Buddy
BuiltBotTough
Bullseye Bullseye
BunnySlippers
CODE87
CSHttp
CazoodleBot CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot CheeseBot
Chlooe
Claritybot
Cliqzbot
Cloud mapping Cloud mapping
Collector Cocolyzebot
CopyRightCheck Copyscape
Craftbot Crawling at Home Project
Crescent CrazyWebCrawler
CrunchBot
Curious
DSearch DSearch
DTS Agent DataCha0s
Deusu DatabaseDriverMysqli
Devil
Digincore Digincore
Discoverybot Dirbuster
DomCopBot Disco
DomainAppender DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainSigmaCrawler
Download Wonder Download Wonder
EMail Siphon
EroCrawler EroCrawler
Evil Evil
ExtLinksBot Express WebPictures
Extractor
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms Ezooms
FHscan
FemtosearchBot FemtosearchBot
Fimap Fimap
FlashGet Firefox/7.0
Flunky Foobot
Freeuploader Freeuploader
FrontPage FrontPage
Fyrebot
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW GT::WWW
Genieo
GermCrawler GermCrawler
GetWeb GetWeb
Grafula Gigabot
GoZilla
Gotit
GrapeshotCrawler
HMView
HTTP::Lite
HTTrack HTTrack
Haansoft Haansoft
Heritrix
Hloader
Humanlinks Humanlinks
HybridBot IDBTE4M
Iblog IDBot
Intelliseek Id-search
Iria IlseBot
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
InternetSeer
Iskanie
IstellaBot IstellaBot
JamesBOT
Jbrofuzz Jbrofuzz
Kenjin Spider JetCar
Kinza Jorgee
JustView
Kozmosbot Kozmosbot
Leap LNSpiderguy
LeechFTP Lanshanbot
LeechGet LeechGet
LexiBot
Lftp Lftp
Libwhisker
LieBaoFast LieBaoFast
Lightspeedsystems
Likse
LinkScan
Linkbot Linkbot
LinkextractorPro LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
MIDown tool Litemage_walker
Lmspider
Ltx71
MIIxpc MIIxpc
MQQBrowser MJ12bot
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
MTRobot MarkWatch
Mass Downloader Mass Downloader
Mata Hari Masscan
Meanpathbot MauiBot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Microsoft URL Control Minefield
Mister PiX Mojeek
Morfeus Fucking Scanner Mojolicious
Mozlila
Mr.4x3 Mr.4x3
Msrabot
Musobot Musobot
Nameprotect Nameprotect
Navroad
NearSite NearSite
Needle Nessus
NetMechanic NetAnts
Netcraft NetLyzer
Nettrack Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Ninja Ninja
Nmap
Not
Nuclei Nuclei
Octopus
Offline Explorer Offline Explorer
OnCrawl OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openvas Openfind
PECL::HTTP PageAnalyzer
POE-Component-Client-HTTP PageGrabber
PageScorer PageThing.com
Pandalytics PeoplePal
Panscient
Papa Foto
Petalbot Petalbot
Pi-Monster Pi-Monster
Picsearch
PictureFinder PictureFinder
Piepmatz Pimonster
Pockey PleaseCrawl
ProPowerBot ProPowerBot
ProWebWalker PyCurl
Probethenet Quick-Crawler
Pump RSSingBot
RankActive RankActive
RankActiveLinkBot RankActiveLinkBot
RankurBot RankFlex
Recorder RankingBot
RankingBot2
Re-re
ReGet
RealDownload
Reaper
Ripper Ripper
RocketCrawler
SEOkicks SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX SISTRIX
SalesIntelligent ScanAlert
Screaming ScoutJet
ScreenerBot
ScrepyBot
Searchestate Searchestate
Semrush SemanticJuice
Seomoz SemrushBot
Siphon SeoSiteCheckup
SeobilityBot
Site Sucker
SiteSucker SiteSucker
Sitebeam
Siteimprove Siteimprove
SlySearch
Snake Snake
Snapbot Sogou web spider
Sociscraper Sosospider
Sottopop Sottopop
SpaceBison Spbot
SputnikBot SputnikBot
Sqlmap Sqlworm
Sqworm Stripper
Surfbot Surfbot
Suzuran
Swiftbot
Szukacz Szukacz
T0PHackTeam T0PHackTeam
T8Abot T8Abot
Teleport Telesoft
Telesphorep Toata
Titan Trendiction
Toweyabot
Tracemyfile
Trendictionbot
True_Robot True_Robot
Turingos Turingos
TurnitinBot
Twice
Typhoeus
URLy Warning URLy Warning
V-BOT URLy.Warning
VB Project VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper VidibleScraper
Voil
WPScan
WWW::Mechanize WWW::Mechanize
WWWOFFLE Web Sauger
Wallpapers WebCollage
WallpapersHD WebCopier
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebAuto
WebBandit
WebEnhancer WebEnhancer
WebFetch WebFuck
WebImageCollector WebLeacher
WebPix WebPix
WebStripper WebZIP
WebSucker WebmasterWorldForumBot
WebWhacker
Webshag
WebsiteExtractor WebsiteExtractor
Who.is Bot WebsiteQuester
Whack
Whatweb
Widow Widow
WinHTTrack
WiseGuys Robot WiseGuys Robot
Wonderbot Wotbox
Wprecon
Xenu
Zade
Zauba Zauba
ZoominfoBot Zitebot
ZyBorg ZmEu
adscanner adscanner
arquivo-web-crawler backlink-check
arquivo.pt cah.io.community
check1.exe com.plumanalytics
clark-crawler crawler.feedback
dataforseo.com
domainsproject.org domainsproject.org
facebookscraper eCatch
gopher instabid
internetVista monitor internetVista monitor
ips-agent isitwp.com
iubenda-radar lwp-trivial
pcBrowser meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
polaris version
probe-image-size
ripz ripz
s1z.ru
satoristudio.net satoristudio.net
seobility seobility
serpstatbot seocompany.store
sp_auditbot seoscanners
sysscan sexsearcher
tAkeOut siteripz
trendiction.com sogouspider
ubermetrics-technologies.com
webgains-bot webgains-bot
webpros.com webpros.com
x09Mozilla
x22Mozilla x22Mozilla
zauba.io

294
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404enemy
80legs 80legs
AIBOT ADmantX
ALittle Client
ASPSeek ASPSeek
Aboundexbot Abonti
Alligator Acunetix
Anarchie AiHitBot
Anarchy Aipbot
Asterias Ankit
Attach Anthill
BDCbot Apexoo
BDFetch AwarioRssBot
AwarioSmartBot
BLEXBot
BackDoorBot BackDoorBot
BackStreet BackStreet
BackWeb Bandit
Backlink-Ceck Barkrowler
BacklinkCrawler Bitacle
Battleztar Bazinga Black Hole
BetaBot
BlackWidow
BlowFish BlowFish
Bolt
BotALot BotALot
Brandprotect
Brandwatch Brandwatch
Buck BuiltWith
Bullseye BunnySlippers
CCBot CATExplorador
CODE87
CSHttp CSHttp
Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CensysInspect CensysInspect
Citoid Citoid
Cogentbot
Copier
CopyRightCheck CopyRightCheck
Cosmos Copyscape
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
CrunchBot
DBLBot DBLBot
DIIbot
DSearch DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu Deusu
DigitalPebble DigitalPebble
Disco Dirbuster
Dispatch DnyzBot
DittoSpyder
DomainAppender DomainAppender
DomainCrawler
Domains Project Domains Project
EasyDL Download Wonder
Ebingbong Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler EroCrawler
Exabot Exabot
ExtLinksBot
EyeNetIE EyeNetIE
Ezooms
FDM FDM
FHscan
Fimap
Firefox/7.0 Firefox/7.0
FlashGet
Freeuploader Freeuploader
FrontPage
Fuzz
G-i-g-a-b-o-t G-i-g-a-b-o-t
GT::WWW GT::WWW
Genieo Genieo
GermCrawler
GetRight
GetWeb
Getintent
Gigabot Gigabot
Go!Zilla Go!Zilla
GoZilla Go-Ahead-Got-It
Grafula
GrapeFX GrapeFX
HEADMasterSEO HMView
HTMLparser HTMLparser
HTTP::Lite HTTP::Lite
Haansoft
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks Humanlinks
IRLbot IDBot
Iblog
Image Fetch
IndeedBot
Indy Library Indy Library
InfoNaviRobot
InfoTekies InfoTekies
Iria InternetSeer
Iskanie JamesBOT
Jbrofuzz
JennyBot JennyBot
Jetty JetCar
Joomla Jyxobot
Kenjin Spider Kinza
Keyword Density LNSpiderguy
Kozmosbot Larbin
LWP::Simple LeechGet
LeechFTP Lftp
LexiBot Lightspeedsystems
LibWeb LinkScan
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinksManager
Litemage_walker Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool MIDown tool
MTRobot MIIxpc
MJ12bot
Mail.RU_Bot Mail.RU_Bot
Mediatoolkitbot Majestic SEO
Metauri Majestic-SEO
Masscan
MauiBot
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access Microsoft Data Access
Mister PiX Mister PiX
Moblie Safari Moblie Safari
Mojolicious Mojolicious
Morfeus Fucking Scanner MolokaiBot
Mozlila Mozlila
NPbot NICErsPRO
Name Intelligence Name Intelligence
Nameprotect Nessus
NearSite
Needle
Net Vampire
NetLyzer
NetMechanic NetMechanic
NetZIP Nettrack
Netvibes Nimbostratus
Nibbler Nuclei
Nikto Octopus
NimbleCrawler Offline Explorer
Nmap
Nutch
Offline Navigator
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
OrangeBot OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
PageAnalyzer POE-Component-Client-HTTP
PageGrabber Page Analyzer
PageThing.com PageScorer
Panscient Panscient
Pavuk
PeoplePal PeoplePal
Pi-Monster Pi-Monster
Pimonster PictureFinder
Pixray
PleaseCrawl PleaseCrawl
Psbot ProWebWalker
Probethenet
Pu_iN Pu_iN
Pump Pump
PxBroker QueryN Metasearch
PyCurl
RSSingBot RSSingBot
Rankivabot Rankivabot
ReGet
RealDownload RealDownload
Reaper
RebelMouse RebelMouse
Recorder
RepoMonkey RepoMonkey
RocketCrawler Ripper
SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOprofiler
SalesIntelligent
ScanAlert ScanAlert
ScreenerBot ScreenerBot
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
Seekport
SemanticJuice SemanticJuice
Semrush
SentiBot SentiBot
SeoSiteCheckup
Seomoz
Siphon Siphon
Site Sucker
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSnagger
Sitebeam Siteimprove
Snake SlySearch
Snapbot
Snoopy Snoopy
Sottopop SocialRankIOBot
Spinn3r Sosospider
SpankBot
Spanner
SputnikBot SputnikBot
Sqlmap Sqworm
Sqlworm
Steeler Steeler
Sucker Sucker
Sucuri SuperBot
Szukacz SuperHTTP
Suzuran
T0PHackTeam
T8Abot T8Abot
Teleport
TeleportPro TeleportPro
TheNomad Telesphoreo
The Intraformant
Thumbor Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot Trendictionbot
TurnitinBot Turingos
URLy Warning Turnitin
TwengaBot
Typhoeus
V-BOT
VCI
Vagabondo Vagabondo
VelenPublicWebCrawler VidibleScraper
VeriCiteCrawler WEBDAV
Virusdie WISENutbot
VoidEYE
Voltron
WPScan WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE Wallpapers
WeSEE WeSEE
Web Auto
WebBandit WebBandit
WebCollage WebCollage
WebCopier WebCopier
WebGo IS WebFetch
WebImageCollector
WebPix
WebWhacker
WebZIP WebZIP
WebsiteQuester WebmasterWorldForumBot
Website Quester
Webster Webster
WiseGuys Robot Whack
Woobot Whatweb
Wotbox WinHTTrack
Zade Xenu
Zermelo Zermelo
Zeus
ZmEu
ZoominfoBot ZoominfoBot
adscanner adscanner
archive.org_bot
autoemailspider autoemailspider
backlink-check
check1.exe check1.exe
coccocbot-web com.plumanalytics
crawler4j
dataforseo.com dataforseo.com
evc-batch demandbase-bot
gopher heritrix
instabid ips-agent
internetVista monitor lwp-request
mediawords magpie-crawler
oBot muhstik-scan
polaris version netEstate NE Crawler
s1z.ru pcBrowser
serpstatbot probe-image-size
ripz
satoristudio.net
seoscanners
sexsearcher
siteripz
sogouspider sogouspider
sysscan sysscan
webprosbot voyagerx.com
webpros.com
x09Mozilla x09Mozilla
xpymep1.exe zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
aa81bf391151884adfa3dd677e41f94be1.com abusora.com
amt-k.ru bannerconnect.net
bum.com.ru bard-real.com.ua
dynainbox.com eduserver.net
hd-film.pl jav-fetish.com
managerpak204.weebly.com mini.7zap.com
nfvsz.com piuminiita.com
torrentred.games search.xtconnect.com
um-razum.ru tizanidine4mgstreetvalue.blogspot.com
watch-movies.ru wejdz-tu.pl

942
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00it.com 00it.com
0n-line.tv 12u.info
1-99seo.com 14b.info
101lesbian.xyz 1kinobig.ru
1qingdao.com 1stat.ru
1webmaster.ml 2pxg8bcf.top
2itech.ru 2rich4bitches.com
40cg.com
4kepics.com 4kepics.com
7search.com 8xv8.com
7wind.ru a14download.com
7yue.org absugars.com
8jn.dating-app.ru abtasty.com
9icmzvn6.website acc.eu.org
9med.net adclickservice.com
aaa38852e886ac4af1a3cff9b47cab6272.com adinterax.com
aab94f698f36684c5a852a2ef272e031bb.com adman.se
aaronabel.com adserver-e7.com
abclauncher.com advertisingtag.net
abusora.com agecheckadult.com
actices.com alevinefesleri.com
actulite.com alfapro.ru
addblueoff.com.ua all-streaming-media.com
adultnet.in all4invest.ru
adultwebhosting.info allblogroll.com
advancedsoftwaresupport.com allwomen.info
akvamaster.dp.ua aloofly.com
alert-fjg.xyz amoi.tn
alert-jdh.xyz ample-awards-today.us
alkoravto.ru anonymizeme.pro
allboard.xobor.de apibrowsesmartne-a.akamaihd.net
alldezservice.kz app-ready.xyz
allesohnegirls.net appiq.mobi
alphaforum.ru arkkivoltti.net
alta-realestate.com ascat.porn
amung.us asiengirls.net
anabolics.shop aversis.net
android-systems.ru ayerbo.xhost.ro
animalrank.com azlex.uz
anmysite.com babosas.com
ap.senai.br babyfactory.fr
apilinkswiftco-a.akamaihd.net batanga.net
arendatora.ru beachdriveblog.com
artdestshop.eu beachpics.com
auto-zapchasti.org beachtoday.ru
automatic-seo.com beremenyashka.com
avtoarenda.by berrymall.ru
axbocz.net best-coupon-offer.com
backuperwebcam.weebly.com best-games.today
barbourjackets.online bestfortraders.com
bestbrainprod.win bestpriceninja.com
bestserials.com betune.onlinewebshop.net
bet-prognoz.com betwinservice.com
bezlimitko.xyz bin-brokers.com
beztuberkuleza.ru bio-market.kz
bigcities.org blackle.com
biglistofwebsites.com blacktwhite.com
billiard-classic.com.ua bonkers.name
binomo.com brainxs.us
bio-japan.net bristolhotel.com.ua
bizru.info bronzeaid-a.akamaihd.net
blog.koreadaily.com browserprotecter.com
bmwhighperformers.com brus.city
boobsimge.com buchananshardware.com
bookmaker-bet.com buyclomidonlaine.com
boom-celebs.com byme.se
brainboosting.club calcularpagerank.com
brainsandeggs.blogspot.com callmd5map.com
break-the-chains.com callstevens.com
bristolhostel.com candelluxsklep.pl
brus-vsem.ru canrole.com
bukleteg.xyz carabela.com.do
business-made-fun.com cardsdumps.com
buttons-for-website.com cartierjusteunclou.xyz
buyessay3.blogspot.ru catalogs-parts.com
buypanicdisorderpill.com cellfun.mobi
cablecar.us centrdebut.ru
cacheimages.com cete.ru
camdenmemorials.com cezartabac.ro
camdolls.com chcu.net
cartierreplica.xyz cherrypointplace.ca
cartiertrinity.xyz
cartierwatch.xyz
cartujano-pre.de
cfjump.com
cfsrating.sonicwall.com
cheap-trusted-backlinks.com
checkm8.com
chelyabinsk.xrus.org
chocolateslim-en-france.com
ci.ua
ciekawinki.pl ciekawinki.pl
cleansearch.net cienum.fr
clicksor.net cityadspix.com
codq.info cl.s7.exct.net
coindirect.io clickbanksites.info
com-cleaner.systems clickintext.net
commoncrawl.org clmforexeu.com
compliance-brian.xyz club-lukojl.ru
compliance-don.xyz cntravelre.com
compliance-nelson.top co.lumb.co
compliance-walter.top colehaanoutlet.store
com-onlinesupport.site
compliance-irvin.xyz
compliance-jane.top
compliance-mary.top
confib.ifmo.ru confib.ifmo.ru
connectingsingles.com contentlook.co
conocer-sanabria.com coolwallpapers-hd.com
coop-gamers.ru costablue.xyz
cornomase.win cougfan.info
coslab.club credit-online.ws
crd.clan.su crystalslot.com
daisye.top customchocolate.business-for-home.com
data1.scopich.com cutt.us
degerlund.net d2jsp.org
detsky-nabytek.info darkages.info
dichvuvesinhhanoi.com defenderxtactical.com
dikqlyremy.info demenageur.com
dimkino.ru dentalpearls.com.au
directrev.com dentfidemountpreach.tk
dispo.de detskie-zabavi.ru
divci-hry.info digitalassetmanagement.site
divku.ru dignitasdata.se
dojki365.online dimaka.info
dollartree.info discountbarbour.online
domainanalyzing.xyz doeco.ru
domaineaneblanc.com dokumentalkino.net
dominateforex.ml dolohen.com
donvito.unas.cz domaincdn.xyz
driving.kiev.ua domcran.net
ecookna.com.ua dosugrostov.site
egovaleo.it download-walpaperhd.blogspot.com
ekto.ee downloadmefiranaratb1972.xpg.com.br
elektrischezigarette2.onsugar.com dprtb.com
elvel.com.ua e-biznes.info
emerson-rus.ru e2click.com
enskedesquashclub.se eager-nash.188-93-233-196.plesk.page
eropho.net ebooknovel.club
educatemetv.com
elektrischezigarette2.devhub.com
elektrozigaretten1.webs.com
elexies.info
elidelcream.weebly.com
elkacentr.ru
ereko.ru
erotag.com erotag.com
erotik-kostenlos.net errorfixing.space
erotikstories.ru escortplius.com
eshop4u.jp eshop.md
estelight.ru essay-writing.work
euromasterclass.ru essaypro.com
exhibitionplus.eu eu-cookie-law.info
eyessurgery.ru eugenevaultstorage.com
ezigarettenkaufen1.pagina.gr evidencecleanergold.com
ezrvrentals.com evogarage.com
f012.de exchanges-bet.com
f0815.de ezigarettenkaufen2.dreamwidth.org
fashion-mk.net f1nder.org
fast-torrent.ru f5mtrack.com
face.hostingx.eu
facialporntube.com
factorynightclub.com
failingmarriege.blogspot.com
family1st.ca
fanrto.com
fantasticpixcool.com
fashion.stellaconstance.co
fastcrawl.com
favorcosmetics.com favorcosmetics.com
filmania-x.ru favornews.com
finejewelryshop.ru femdom.twiclub.in
firstdrugmall.ru fickenbumsen.net
flashlarevista.com fil.ru
flipper.top filmbokep69.com
floridahuntingfishingadventures.com filmi-onlain.info
footballfarrago.com financeloan.us
franklinfire.co findacheaplawyers.com
frankofficial.ru findpik.com
finstroy.net
forensicpsychiatry.ru
forex-procto.ru
forms-mtm.ru
formulaf1results.blogspot.com
forums.d2jsp.org
franch.info
free-fbook-traffic.com
free-share-buttons.blogspot.com free-share-buttons.blogspot.com
freeuploader.com free-share-buttons.top
fres-news.com free-traffic.xyz
frvo.alptandem.ru freejabs.com
fun2cell.net freelinkbuilding.website.tk
funponsel.com funnypica.com
galaxyflowers.ru galleryawesome.com
gambarxkata.co gambarkataku.co
game-mmorpg.net gamedayhouse.com
gamerextra.com gameplexcity.com
garciniaxt.us gazporno.com
gazobeton-p.com.ua ggiaro.com
get-free-social-traffic.com
getlamborghini.ga
getpopunder.com
gheus.altervista.org
glass-msk.ru glass-msk.ru
gok-kasten.net gne8.com
golfresa.lucania.se goatse.ru
greenzaim.ru golaya.pw
grtyi.com golden-catalog.pro
hacktougroup.ru golden-praga.ru
hayate.biz greatdealshop.com
green-tea.tv
hd-filmy.net hd-filmy.net
headpress.ru hdhc.ru
healbio.ru healmytrauma.info
help.tpu.ru heatpower.ru
herokuapp.com herokuapp.com
highland-homes.com heroz.fr
hitmuzik.ru himgaws.pw
hitsbox.info hoverboardforsaledirect.com
hoholikik.club hoztorg-opt.ru
hotshoppymac.com husky-shop.cz
https-legalrc.biz ictizanidinehcl4mg.blogspot.com
hubbble.com igadgetsworld.com
iblogpress.xyz ikritikimou.gr
ilovevitaly.ru imfamous.info
imagerydatabase.com imicrovision.com
incolors.club imitex-plus.ru
incomekey.net imk.com.ua
infodocsportal.com incest-ru.com
infogame.name investyb.com
innodgfdriverhm.aircus.com iplusbit.blogspot.co.za
innoslicon.com iqoption.com
insomniagamingfestival.com iqs.biz.ua
instasexyblog.com irkutsk.zrus.org
int.search.tb.ask.com istanbulit.com
intervsem.ru istizanidineanopiate.blogspot.com
investzalog.ru it-max.com.ua
iradiology.ru izismile.com
ivearchenceinflu.cf jackpotchances.com
iyasimasennka.com jeremyeaton.co
japan-bearings.ru jerseywholesalechinabiz.com
jjbabskoe.ru kamalsinha.com
jumptap.com karusel-market.ru
kabbalah-red-bracelets.com keywordsdoctor.com
kaz.kz keywordspay.com
kazan.xrus.org kinopolet.net
kazka.ru kinozapas.org
ketoanhanoi.info kiwe-analytics.com
keywesthideaways.co klumba55.ru
keywordsuggests.com kmd-pto.ru
kinobaks.com kosmetyki.tm.pl
kinocccp.net kunstaktien.info
kinohit1.ru kw21.org
konica.kz law-check-eight.xyz
krafte.ru lechtaczka.net
krasnodar.zrus.org leftofcentrist.com
krynica.info legalrc.biz
kurbappeal.info legionalpha.com
kvartiry-remont.ucoz.ru lesbian.xyz
lacave.ntic.fr letolove.ru
ladsblue.com letsrepair.in
lanasshop.ru life.biz.ua
landmania.ru
landoftracking.com
landscapebackgrounds.blogspot.com
laserpen.club
leboard.ru
lenvred.org
letmacworkfaster.world
lexiangwan.com
lineshops.biz lineshops.biz
linkpulse.com linkdebrideur.xyz
liveshoppersmac.com linksharingt.com
loadingpages.me lirunet.ru
locksmith.jp littlesexdolls.com
lombia.com livejasmin.com
lottospring.com lonely-mature.com
mac-shield.com lookingglassemb.com
mail.allnews24.in macnewtech.com
makenahartlin.com magento-crew.net
makis.nu mailemedicinals.com
manipulyator-peterburg.ru manyresultshub-a.akamaihd.net
marketingtechniques.info me-ke.com
maximpartnerspr.com mebel-ekb.com
mbiologi.ru medicinacom.ru
mebel-alait.ru medicineseasybuy.com
medi-fitt.hu medicovi.com
medtherapy.ru meetlocalchicks.com
meduza-consult.ru megahdporno.net
minecraft-rus.org meteostate.com
minneapoliscopiers.com microsoftportal.net
mitrasound.ru minecraft-neo.ru
mmgq.ru mirtorrent.net
mmog-play.ru misandesign.se
mnimmigrantrights.net misslike.ru
mnogabukaff.net mixed-wrestling.ru
mobot.site mobile.ok.ru
modabutik.ru mobstarr.com
mojowhois.com moncleronline.xyz
moneyteam24.com monitorwebsitespeed.com
more-letom.ru montazhnic.ru
moroccosurfadventures.com morepoweronmac.trade
mrbitsandbytes.com morocco-nomad-excursions.com
mrlmedia.net moscow-region.ru
mtmtv.info mountainstream.ms
multgo.ru mrpornogratis.xxx
musezone.ru musicktab.com
musicdaddy.net mybinaryoptionsrobot.com
muz-baza.net
muzaporn.com
muztops.ru
mydearest.co mydearest.co
mydirtystuff.com myfreemp3.eu
myperiod.club mykings.pw
mypornfree.ru mymercy.info
myseoconsultant.com mzdish.site
myxdate.info nailsimg.com
neobux-bg.info narco24.me
networkad.net naturtreenspicerx.pw
newfilmsonline.ru new-apps.ru
news-speaker.com news-readers.ru
nikitabuch.com nextrent-crimea.ru
ningessaybe.me
nodup.ru nodup.ru
northfacestore.online nonameread45.live
noumeda.com normalegal.ru
novgorod.xrus.org norththeface.store
npoet.ru nsatc.net
offers.bycontext.com obiavo.uz
offf.info oecnhs.info
office2web.com ofanda.com
officedocuments.net offer.wpsecurity.website
okel.co onetravelguides.com
okuos.com online.ktc45.ru
olvanto.ru onlinemeetingnow.com
omsk.xrus.org onlinetvseries.me
open-odyssey.org ontargetseo.us
optitrade24.com oops-cinema.ru
oz-offers.com openmultipleurl.com
paclitor.com oyster-green.com
paighambot.com pacificair.com
partner-high.men painting-planet.com
perfectplanned.com paparazzistudios.com.au
petedrummond.com paradontozanet.ru
php-market.ru partybunny.ru
pinsdaddy.com pastaleads.com
plastjulgranar.se pcimforum.com
plastweb.ru pic2fly.com
pliks.pl picmoonco.pw
pokemon-go-play.online pics-group.com
poligon.com picsforkeywordsuggestion.com
polybuild.ru picturesify.com
pons-presse.com pkr1hand.com
popcash.net platesauto.com
porngalleries.top platezhka.net
pornhub-ru.com pooleroadmedicalcentre.co.uk
porno-dojki.net popup-jdh.xyz
porno-play.net pornmania.pl
pornoforadult.com pornophoto.xyz
pornosemki.info pornoreino.com
presleycollectibles.com pornoslive.net
privatamateure.com pornoted.com
prodess.ru pro-okis.ru
producm.ru pronekut.com
profitkode.com pufip.com
progonrumarket.ru pulse33.ru
prohoster.info purplesphere.in
prom23.ru quelle.ru
proxyelite.biz quickloanbank.com
qor360.com rankia.com
quickbuck.com rankscanner.com
qwesa.ru ranksonic.info
recordpage-a.akamaihd.net realnye-otzyvy.info
registrydomainservices.com redbottomheels.xyz
remorcicomerciale.ro rednise.com
reyel1985.webnode.fr remont-fridge-tv.ru
ringporno.com resultshub-a.akamaihd.net
riralmolamsaca.tk rezeptiblud.ru
rff-cfal.info
robot-forex.biz robot-forex.biz
rome2rio.com ros-ctm.ru
rus-teh.narod.ru rucrypt.com
ruscopybook.com rutor.group
ryetaw.com s8-nowy-wygraj.comli.com
s-iwantyou.com
sa-rewards.co.za sa-rewards.co.za
saneyes.com salmonfishingsacramentoriver.com
scalerite.co.za samoiedo.it
scanner-andrew.top sc-specialhost.com
scanner-donald.top scanner-brian.top
schalke04fc.info scanner-julia.top
school-diplomat.ru scanner-margo.top
score-ads.men se-welding.ru
scrnet.biz.ua seasonvar.ru
search.1and1.com segol.tv
searchimage.co semaltmedia.com
searchinquire.com semprofile.com
securityallianceservices.com semrush.com
seo-2-0.com seo-2-0.com
seo-prof1.xyz seobility.net
seoholding.com seofied.com
seofirmreviewsus.info
seonetwizard.com seonetwizard.com
sex-foto.pw sexcamamateurchat.com
sex-sex-sex5.com sexpartygirls.net
sexkvartal.com sexpornotales.com
shama-rc.net sexy-pings.com
sexyali.com
sharebutton.org
sharebutton.to sharebutton.to
shemale-sex.net shariki-zuma-lines.ru
shillyourcoins.com sharpchallenge.com
shoppingjequiti.com.br shitmovs.com
shtora66.ru shopcheermakeup.info
site.ru shoplvlv.us
site3.free-share-buttons.com simon3.ru
sivs.ru sinestesia.host.sk
skuteczna-dieta.co.pl sispe.com.br
slowmac.tech skladvaz.ru
smartadserver.com smartadserver.com
smartpet.ru social-search.me
snegozaderzhatel.ru
snip.to
socialbookmarksubmission.org
socialbutton.xyz
socialbuttons.xyz socialbuttons.xyz
socialmonkee.com socialmediasuggest.com
soda.media socialseet.ru
solicita.info sophang8.com
sotkal.lark.ru space2019.top
sovetogorod.ru space4updating.win
spasswelt.xyz spamnuker.com
speechfoodie.com spitfiremusic.com
sport-video-obzor.ru
sports-supplements.us sports-supplements.us
startwp.org starpages.net
steame.ru stop-gepatit.te.ua
steebook.com success-seo.com
sterva.cc suggest-keywords.com
strfls.com svensk-poesi.com
stroilka.info sweepstakes.rewardit.com
studiokamyk.com.pl swingerseiten.com
stuffpride.com tandvardshuset.net
suchenindeutschland.com
svetlotorg.ru
syvertsen-da.no
tagil.zrus.org
taqplayer.info taqplayer.info
telefonsex-ohne0900.net telefonsexsofort.tk
telefonsexi.com telsis.com
teletype.in the-usa-games.blogspot.com
template-kid.com theplacetoupdating.pw
templates.franklinfire.co thetattoohut.com
thebitcoincode.com timeallnews.ru
thenews-today.info tizanidineforopiatewithdrawal.blogspot.com
time-japan.ru tizanidineingredients.blogspot.com
timecrimea.ru tizanidinemusclerelaxant.blogspot.com
tizanidine4mgprice.blogspot.com tizanidineoral.blogspot.com
tizanidine4mgtablets.blogspot.com tizanidinerecreationaluse.blogspot.com
tizanidine4mguses.blogspot.com tizanidinerestlesslegsyndrome.blogspot.com
tizanidinefibromyalgia.blogspot.com tizanidinevsvalium.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com
tkanorganizma.ru
toloka.hurtom.com
topbestgames.com
torrent-newgames.com torrent-newgames.com
torture.ml torrentdownloadhub.com
toursmaps.com
toy-shop.top toy-shop.top
trafficfactory.biz tozup.com
triplepanda.xyz track112.site
trackmedia101.com
traderzplanet.in
triumf-realty.ru
truck-land.life truck-land.life
truebeauty.cc tube8.com
trustaffs.com tyumen.xrus.org
turizm.bz uac.net.au
tytoona.com uchetunet.su
ua-company.ru ussearche.cf
uchebavchehii.ru utiblog.fr
ukkelberg.no uzungil.com
ukrtvory.in.ua valkiria-tk.ru
urlopener.blogspot.com.au vclicks.net
usdx.us versaut.xxx-cam.webcam
uzporno.mobi vertaform.com
validccseller.com veselokloun.ru
varikozdok.ru vgoloveboli.net
ventelnos.com viagengrarx.com
vesnatehno.ru viagraneggrx.com
vezuviy.su viberdownload10.com
videtubs.pl vip-file.com
vigrx-original.ru vkonche.com
vintontech.info webcamdevochka.com
voditeltrezviy.ru webenlace.com.ar
voltrknc1.com website-speed-check.site
voprosotvet24.ru website-speed-checker.site
vpnhowto.info webtherapy.ru
we-are-gamers.com weekes.biz.tc
webads.co.nz westen-v.life
webradiology.ru wholesalecheapjerseysfree.com
webscouter.net wholesalejerseychinaoutlet.com
welcomeauto.ru whosonmyserver.com
westermarkanjou.se wikes.20fr.com
whatistizanidinehclusedfor.blogspot.com wildworld.site
whipme.yopoint.in withstandingheartwarming.com
wholesalejerseyscheapjerseys.us.com wordpress-crew.net
wjgony.com workle.website
woman-h.ru woweb.com.ua
wonderfulflowers.biz ws.ampower.me
word-vorlagen.xyz wufak.com
wpsecurity.website ww1943.ru
writingservices17.blogspot.ru www.jbetting.com
wttavern.com www.souvenirua.com
www.pinnacle-bets.com x-diesel.biz
xcc24.pl x-musics.com
xev.ru x-stars.ru
xjrul.com xchat26.myfreecams.com
xep.info
xfire.com
xn----itbkqkfiq.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn--80aebbcbcdemfkhba4byaehoejh8dza3v.xn--p1ai
xn--80aodinpgi.xn--p1ai xn--80aodinpgi.xn--p1ai
xn--d1aifoe0a9a.top
xnxx-n.com xnxx-n.com
xxlargepop.com xtube.com
xxxhdvideo.site xxx-cam.webcam
yaoguangdj.com xxxkaz.org
yoluxuryevents.com yatrk.xyz
youjizz.vc you-shall-not-pass.is74.ru
youraticles.pl yourads.website
youresponsive.com z-master.ru
yourmovies.pl
yourothersite.com
youtoner.it
yubikk.info
za-fun-offer.com za-fun-offer.com
zarenica.net zaloro.com
zdesoboi.com zebradudka.com
zoodrawings.com zeikopay.com
zooggames.com zhuravlev.info
zrelaya.pw zrizvtrnpale.tk
zvetki.ru

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
101raccoon.ru 1-free-share-buttons.com
1kdailyprofit.me 1xbet4you.com
2728fb936f0.com 2pxg8bcf.top
2kata.ru 8jn.dating-app.ru
34.gs aa9d046aab36af4ff182f097f840430d51.com
4senses.co adamoads.com
abovetherivernc.com addray.pro
actulite.com advertex.info
adtology.com ageofclones.com
allblogroll.com allcredits.su
allnews24.in allkrim.com
altamayoztourism.com amazingninja.com
ampower.me ameblo.jp
amyfoxfitness.com analnoeporno.tv
an-donut.com anapa-inns.ru
apilinkswiftco-a.akamaihd.net appmsr.org
as5000.com apps-analytics.net
asiengirls.net arkkivoltti.net
asscenihotosidea.blogspot.co.za
astana.xxxkaz.org
aucoinhomes.com aucoinhomes.com
autonew.biz avtolombard-krasnodar.ru
ayakino.net balook.com
balitouroffice.com beauby.ru
bazaronline24.ru bedcapdealers.com
bestcurs.org best-mam.ru
bestimagecoollibrary.com bestdraws.com
bigcities.org bio-japan.net
blackle.com biographiya.com
blog.f00kclan.de blog.yam.com
boazpower.com bloglag.com
bonzbuddy.com bookmark4you.com
brainboosting.club
brandbucket.com brandbucket.com
brianhenry.co brandedleadgeneration.com
brothers-smaller.ru brillianty.info
browsepulse-a.akamaihd.net brus.city
buchananshardware.com buqayy0.livejournal.com
bumskontakte.org burkesales.com
bus-offer.com business-made-fun.com
business-suggested.tk c1.onedmp.com
buy-forum.ru calc-for-credit.ru
byme.se cardiosport.com.ua
cellfun.mobi cartierring.xyz
cenoval.ru casablancamanor.co.za
checkm8.com cezartabac.ro
chee-by.biz cheapmoncler.win
christianlouboutinreplica.win chocoslim.pro
country-chic.ru christianlouboutinsaleoutletonline.us
cs-passion.pl cialis-samples.com
custom-electric-guitar.com citetick.com
customergrowthsystems.com clickso.com
day-news.info clicksotrk.com
daymusam.com clubfashionista.com
diarioaconcagua.com coldfilm.ru
div.as colobit.biz
divisioncore.com consorzioilmosaico.org
djonwatch.ru countbertwistdisp26.soup.io
dlya-android.org crirussian.ru
docstoc.com cv.wallhade.co
doctissimo.fr cxpromote.com
doctormakarova.ru dalavia.ru
doktoronline.no daneshetabiat.com
domznaniy.ru davidovic.info
download-wallpaper.net ddlmega.net
downloader12.ru ddospanel.com
earncash.com.ua depositfiles-porn.ga
elektrischezigarettekaufen2.cowblog.fr designdevise.com
este-line.com.ua dev-seo.blog
eu-cookie-law.blogspot.com dogbreedspicture.net
euronis-free.com dollartree.info
european-torches.ru domain.webkeyit.com
fdzone.org drev.biz
fitnesspiks.com dscaas.website
forex21.ru dvr.biz.ua
fotosfotos.eu ecommerce-seo.com
freemaintenancesysforpcandmac.top ee77ee.com
fuckingawesome.com elektronischezigarettekaufen1.beeplog.com
fx-brokers-review.com elektrozigarettekaufen2.blogse.nl
gamebackyard.com eloconcream.blogspot.com
gamerscorps.com estelight.ru
gaypornmovie.net extractorandburner.com
gayxperience.com ezb.elvenmachine.com
gigixo.com ezigarettekaufen.myblog.de
gilbertbanda.net fastfixing.tech
girlspicsa.com floridamhca.org
guardlink.org focalink.com
guidefs.ru forums.d2jsp.org
happy.new.yeartwit.com forzeronly.com
hdfreeporno.net frcls.fr
heartofpayne.xyz fyxabomiw.ru
highland-homes.com gallerily.com
hornymatches.com girlporn.ru
hostcritique.com gk170.ru
hostingclub.lk golaya.pw
htmlcorner.com goodwriterssales.com
hulfingtonpost.com handicapvansarea.com
hydropump.su headpress.ru
ictizanidinehcl4mg.blogspot.com helpmymacfaster.trade
imgarcade.com hol.es
instakink.com homedecorpicture.us
instasexyblog.com hotshoppymac.com
int.search.mywebsearch.com hoverboard360.de
iqoption.com iccornacircri.cf
iron-age.info ilikevitaly.com
isitpaleo.info imfamous.info
iwanttodeliver.com impresagaia.it
javcoast.com indiasourcemart.in
javspace.net istmira.ru
jyvopys.com istripper.com
kamorel.com iweblist.info
keywordteam.net ixora.pro
kolotiloff.ru javatex.co.id
kotaku.com jerseychinabizwholesale.us
koversite.info jerseywholesaleelitestore.com
krasivoe-hd.com jmat.cn
lankarns.com jo24news.com
laxdrills.com kaac.ru
laxob.com kino-key.info
letto.by kinocccp.net
lflash.ru kinozapas.org
locatellicorretor.com.br klosetkitten.com
lonfon.xyz kosova.de
lotto6888.com kosynka-games.ru
louboutinreplica.pw landscapebackgrounds.blogspot.com
louboutinshoes.xyz lapolis.it
lovasszovetseg.hu larose.jb2c.me
lulea-auktionsverk.se leadwayau.com
malls.com ledpolice.ru
mebel-vstroika.ru lodki-pvh.dp.ua
medicine-4u.org lookingglassemb.com
medicovi.com lubetube.com
macresource.co.uk
madot.onlinewebshop.net
meble-bogart.info
medkletki.ru
middlerush-a.akamaihd.net
misslike.ru misslike.ru
moje-recenze.cz mmog-play.ru
monclerboots.xyz mockupui.com
moncleroutletonline.pw mokrayakiska.com
montazhnic.ru mrbitsandbytes.com
moz.com mundoaberrante.com
mp3downloadhq.com mxgetcode.com
musicstock.me myftpupload.com
muz-tracker.net myhydros.org
muznachas-service.ru nacap.ru
mydirtyhobby.com nagdak.ru
myfreemp3.eu najaden.no
mykings.pw narutonaruto.ru
myphotopipe.com nash-krym.info
mypornfree.ru obiavo.in
myprintscreen.com obiavo.ru
na-telefon.biz offers.bycontext.com
nakrutka.cc ok-ua.info
narkologiya-belgorod.ru okel.co
neks.info online7777.com
netfacet.net onlinewritingjobs17.blogspot.ru
nullrefer.com ooo-gotovie.ru
oakleyglassesonline.us oranga.host.sk
offtime.ru oren-cats.ru
oktube.ru parlament.biz
origin-my.ru pavlodar.xkaz.org
owohho.com pdns.cz
ozas.net perederni.net
patterntrader-en.com pharmacyincity.com
pdamods.ru
picsfair.com
pigrafix.at pigrafix.at
pix-hd.com pio.polytopesexempt.com
pons-presse.com platesauto.com
popunder.net pliks.pl
pornodojd.ru polytopesexempt.com
pornogratisdiario.com popads.net
pornzone.tv porno-video-chati.ru
pricheski-video.com pornosmola.info
profitkode.com powenlite24.ru
prombudpostach.com.ua prizefestival.mobi
pshare.biz promgirldresses.xyz
pukaporn.com pronekut.com
retailwith.com pulseonclick.com
retreatia.com qitt.ru
reyel1985.webnode.fr quangcaons.com
rockma.se rasteniya-vs-zombi.ru
rusenvironmental.net realtytimes.com
samo-soznanie.ru referencemoi.com
regdefense.com
reklamuss.ru
rethinkwasteni.info
ribieiendom.no
rogervivierforsale.com
roleforum.ru
rubbed.us
russia-today-video.ru
salutmontreal.com
scanner-brian.top scanner-brian.top
scmor.ilxc.cc scanner-ivan.top
searchinquire.com scenicmissouri.us
seccioncontrabajo.com schalke04fc.info
seo-smm.kz sdelatmebel.ru
seofied.com se-welding.ru
serviporno.com searchencrypt.com
sexad.net searchmywindow-a.akamaihd.net
sexkvartal.com searchtooknow-a.akamaihd.net
sexs-foto.top secret.xn--oogle-wmc.com
ship-marvel.co.ua seorussian.ru
shisha-swag.de sexpornotales.net
shodanhq.com sexsearch.com
shopwme.ru shell-pmr.ru
siteheart.net shemalegalls.blogporn.in
siteonomy.com shymkent.xkaz.org
sivs.ru similardeals.net
slavic-magic.ru site-speed-check.site
social-buttons.com siteimprove.com
socialbuttons.xyz social-s-ggg.xyz
socialmediasuggest.com soft1.ru
softtor.com spacash.com
spidtest.org stair.registrydomainservices.com
squidoo.com stefanbakosab.se
statustroll.com streetfire.net
sugarlyflex.pw susanholtphotography.com
superstats.com tehngr.ru
svarbit.com telemetryverification.net
swingerseiten.com telesvoboda.ru
swsociety.se thewomenlife.com
syndicate.fun tizanidineshowupondrugtest.blogspot.com
talant-factory.ru tjkckpytpnje.com
tarad.com trafficmania.com
theporndude.com trafficstars.com
titan-cloud.life tupper-posuda.ru
tobeyouday.win underthesite.com
topanasex.com us-america.ru
torrnada.ru v24s.net
touchmods.fr vashsvet.com
track112.site vvon.co.uk
tracxn.com watchmyfb.pl
trudogolik.net web.cvut.cz
twinderbella.com weblibrary.win
urll.eu webmasters.stackexchange.com
usdx.us webnode.me
v720hd.ru whatsappbot.flyland.ru
vavilone.com wholesalejerseychinaoutlet.com
via-energy-cumpara.com wildnatureimages.com
viagengrarx.com wineration.com
videochat.world wpthemedetector.co.uk
vitoriacabos.com
w-journal.ru
wanker.us
webalan.ru
wellcome2slovenia.ru
womensterritory.ru
wordpresscore.com
wovis.site
wttavern.com
x-porno.video
xcc24.pl xcc24.pl
xlovecam.com yourtemplatefinder.com
xn----7sbahjd3btneuw1joc.xn--p1ai z-master.ru
xxlargepop.com zeikopay.com
xxxasianporn.net zigzog.ru
yellowproxy.net znakomstva-piter78.ru
zeroredirect11.com zrus.org
zhuravlev.info zscaler.net
zoogdinsney.com zverokruh-shop.cz
zootravel.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.109 0; 10.1.1.183 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2905 ### Version: V4.2022.02.2906
### Updated: Tue Feb 8 10:03:24 UTC 2022 ### Updated: Tue Feb 8 22:01:30 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2905 ### Version: V4.2022.02.2906
### Updated: Tue Feb 8 10:03:24 UTC 2022 ### Updated: Tue Feb 8 22:01:30 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##