V4.2022.11.3457 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
 01h4x.com
-ALittle Client
-ASPSeek
+360Spider
+404enemy
+ADmantX
 Abonti
 Aboundex
-Aboundexbot
 Acunetix
-Alligator
-AlphaBot
-Anthill
+AfD-Verbotsverfahren
+AhrefsBot
+Anarchie
+Anarchy
+Ankit
 Apexoo
-BackDoorBot
-Badass
-Bandit
-BatchFTP
-Battleztar Bazinga
+Attach
+AwarioRssBot
+AwarioSmartBot
+BBBike
+BackStreet
+BacklinkCrawler
+Barkrowler
 BetaBot
-Bigfoot
-Bitacle
-BlackWidow
-Blow
+Bolt
 Brandprotect
 Brandwatch
-Buddy
-BuiltBotTough
+Buck
+BuiltWith
+BunnySlippers
 BuzzSumo
-CODE87
-Calculon
-CazoodleBot
-CensysInspect
+CCBot
+CSHttp
+CherryPicker
+ChinaClaw
 Chlooe
-Citoid
-Cogentbot
+Cliqzbot
+Cloud mapping
+Collector
 Copier
 Copyscape
-Crawling at Home Project
-Crescent
+Cosmos
+Craftbot
+CrazyWebCrawler
 CrunchBot
-Curious
-CyotekWebCopy
-DatabaseDriverMysqli
-Demon
-Devil
+DBLBot
+Deusu
+Digincore
 Disco
-Discobot
+Discoverybot
 Dispatch
-DnBCrawler-Analytics
-DnyzBot
-Download Wonder
-Dragonfly
+DittoSpyder
+DomCopBot
+DomainCrawler
 Drip
-EMail Siphon
-EasyDL
+EMail Wolf
 Ebingbong
-Ecxi
-Express WebPictures
+EroCrawler
+Evil
+ExtLinksBot
+Extractor
 Extreme Picture Finder
-FHscan
-FemtosearchBot
-Flunky
-FyberSpider
+Ezooms
+Firefox/7.0
+Foobot
+Fuzz
 Fyrebot
-GT::WWW
 GalaxyBot
-GermCrawler
-GrabNet
-Grabber
-GridBot
+GetRight
+GetWeb
+GrapeFX
 HMView
+HTMLparser
 HTTP::Lite
+Haansoft
+Havij
 Hloader
-HonoluluBot
-IDBTE4M
-IDBot
-Id-search
+Humanlinks
+IRLbot
+IlseBot
+Image Sucker
 IndeedBot
 Indy Library
-InfoTekies
-Intelliseek
-InternetSeer
+InfoNaviRobot
+InterGET
+Internet Ninja
 IstellaBot
+JOC Web Spider
+JamesBOT
 JetCar
-Jetty
+Joomla
+Jyxobot
+Kenjin Spider
 Keybot Translation-Search-Machine
 Keyword Density
-Kozmosbot
-LNSpiderguy
 Lanshanbot
-Likse
-LinkScan
-Linkbot
+Larbin
+LeechFTP
+Lftp
+LieBaoFast
+LinkWalker
+LinkextractorPro
+LinkpadBot
 LinksManager
+LinqiaRSSBot
+LinqiaScrapeBot
 Lipperhey Spider
-Lmspider
-Ltx71
 MFC_Tear_Sample
+MIDown tool
 MIIxpc
 MJ12bot
-MTRobot
-Mag-Net
-Magnet
-Mail.RU_Bot
+MSFrontPage
+Majestic SEO
+Majestic-SEO
 Majestic12
-MarkMonitor
 MarkWatch
-Mass Downloader
-Masscan
-Mediatoolkitbot
+MauiBot
+MeanPath Bot
+Meanpathbot
+MegaIndex.ru
 Metauri
-Minefield
-Morfeus Fucking Scanner
-Mr.4x3
+MicroMessenger
+Microsoft Data Access
+Mister PiX
+Moblie Safari
+Mojeek
 Musobot
-NPbot
-Name Intelligence
-Nameprotect
-Needle
+NearSite
+Net Vampire
 NetLyzer
+NetMechanic
+NetSpider
+Netcraft
 Nettrack
-Netvibes
+NextGenSearchBot
 Nibbler
+Nikto
 NimbleCrawler
-Nimbostratus
-Nuclei
-Nutch
-Offline Explorer
-OnCrawl
 OpenLinkProfiler
 OpenVAS
-Openfind
-OutclicksBot
-PECL::HTTP
-PageAnalyzer
+OrangeBot
+POE-Component-Client-HTTP
 PageScorer
 PageThing.com
-Papa Foto
-Picscout
+Panscient
+PeoplePal
 Picsearch
+Piepmatz
 Pixray
-PleaseCrawl
+Pockey
 ProPowerBot
 ProWebWalker
-PxBroker
+Probethenet
+QueryN Metasearch
+Quick-Crawler
 RSSingBot
-RankActive
 RankingBot2
 ReGet
-RocketCrawler
-SMTBot
-ScoutJet
+Reaper
+RebelMouse
+RedesScrapy
+RepoMonkey
+Ripper
+SBIder
+SEOkicks
+SEOprofiler
 Scrapy
-Searchestate
+ScrepyBot
 SearchmetricsBot
-Seekport
-Seomoz
-Site Sucker
+SemrushBot
+SentiBot
+SeoSiteCheckup
+Shodan
 SiteExplorer
-SiteLockSpider
-SiteSnagger
-Siteimprove
-Sitevigil
-SlySearch
-Snoopy
-SocialRankIOBot
-Sociscraper
-Sosospider
+Sogou web spider
 Sottopop
 SpaceBison
+Spammen
 SpankBot
+Spinn3r
 SputnikBot
-Sqlmap
-Sqlworm
 Stripper
-Sucker
+Sucuri
 SuperBot
-SuperHTTP
-Surfbot
-T8Abot
+T0PHackTeam
 Teleport
+TeleportPro
+Telesoft
+Telesphoreo
+Telesphorep
 The Intraformant
 Thumbor
-Toata
+Toweyabot
 Trendictionbot
-True_Robot
 Turingos
-Turnitin
-TwengaBot
-Typhoeus
+Twice
+URLy Warning
 UnisterBot
-Upflow
+V-BOT
+VB Project
+VCI
 Vagabondo
-VeriCiteCrawler
 VidibleScraper
-VoidEYE
-Voil
-WBSearchBot
+Virusdie
+Voltron
 WISENutbot
-WPScan
-Wallpapers
-Wallpapers/3.0
-WeSEE
-Web Collage
+WWW-Mechanize
+WWW::Mechanize
+Web Enhancer
 Web Fetch
 WebAuto
-WebCopier
 WebImageCollector
-WebLeacher
 WebPix
-WebSauger
-WebWhacker
-WebmasterWorldForumBot
+WebReaper
+WebStripper
+WebZIP
 Webshag
 WebsiteQuester
+Whack
+Whatweb
+WinHTTrack
 WiseGuys Robot
-Xenu
+Woobot
+Wotbox
+Xaldon WebSpider
+Xaldon_WebSpider
+YoudaoBot
+Zade
 Zauba
-Zeus
-Zitebot
 ZmEu
-ZoominfoBot
-cah.io.community
-clark-crawler
-crawler.feedback
-domainsproject.org
-ips-agent
+ZumBot
+ZyBorg
+adscanner
+archive.org_bot
+check1.exe
+demandbase-bot
+evc-batch
 isitwp.com
 linkdexbot
 lwp-trivial
-mediawords
+magpie-crawler
 muhstik-scan
+oBot
 pcBrowser
-plumanalytics
-s1z.ru
-satoristudio.net
+ripz
 scan.lol
-seocompany.store
-seoscanners
-seostar
-sitechecker.pro
-sp_auditbot
+sexsearcher
+sogouspider
 spyfu
-sysscan
-tAkeOut
 trendiction.com
 ubermetrics-technologies.com
-voyagerx.com
-webgains-bot
-webmeup-crawler
 webpros.com
-x22Mozilla
+zgrab