V4.2021.12.2788 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
 01h4x.com
-360Spider
 404checker
-404enemy
-80legs
-AIBOT
+ADmantX
 ASPSeek
-Aboundex
-Acunetix
-AhrefsBot
-Alligator
+AiHitBot
+AlphaBot
+Anarchie
 Anarchy99
+Anthill
 Apexoo
 Asterias
-AwarioSmartBot
-BackDoorBot
-BackStreet
-Badass
-Bandit
+AwarioRssBot
+BDCbot
+BLEXBot
+BackWeb
+BatchFTP
 BetaBot
-Bigfoot
-Bitacle
-Blackboard
-Blow
+Black Hole
 Boardreader
+Bolt
+BotALot
 Brandprotect
-Buddy
-BuiltBotTough
-BuiltWith
 Bullseye
-BunnySlippers
 BuzzSumo
 CATExplorador
-Cegbfeieh
+CODE87
+CSHttp
+CensysInspect
 CheeseBot
-CherryPicker
 ChinaClaw
-Claritybot
-Cloud mapping
-Copier
+Citoid
+Cliqzbot
+Cocolyzebot
+Collector
 CopyRightCheck
-Copyscape
+Craftbot
 Crawling at Home Project
+CrazyWebCrawler
 CrunchBot
+Custo
 DSearch
-Demon
-Deusu
-DigitalPebble
+DTS Agent
 Dirbuster
-DnBCrawler-Analytics
+Disco
+Discoverybot
+DittoSpyder
 DomainAppender
+DomainSigmaCrawler
+DomainStatsBot
+Domains Project
 Dotbot
 Dragonfly
-EMail Siphon
-Ebingbong
+ECCP/1.0
+EasyDL
+Ecxi
 EirGrabber
 EroCrawler
-ExtractorPro
-FemtosearchBot
+Express WebPictures
+ExtLinksBot
+Extractor
+EyeNetIE
+Ezooms
+FHscan
+Fimap
 Firefox/7.0
-FlashGet
+FyberSpider
 Fyrebot
-G-i-g-a-b-o-t
 GT::WWW
-GetRight
 GetWeb
-Gigabot
+Go!Zilla
+Go-Ahead-Got-It
 GoZilla
-Grafula
-GrapeshotCrawler
-GridBot
-HEADMasterSEO
-HMView
-HTTrack
-Harvest
+GrapeFX
+Haansoft
+Havij
 Humanlinks
-HybridBot
-IRLbot
-IndeedBot
-Indy Library
-InfoNaviRobot
+IDBTE4M
+IlseBot
+Image Fetch
+Image Sucker
 InterGET
-Internet Ninja
 InternetSeer
-Iria
-JOC Web Spider
-JamesBOT
-JetCar
-Joomla
+Iskanie
+IstellaBot
+JennyBot
+Jetty
 JustView
+Jyxobot
 Keyword Density
+Kinza
+LNSpiderguy
 Lanshanbot
-LexiBot
-Libwhisker
-LieBaoFast
-Lightspeedsystems
+LeechFTP
+LeechGet
+Likse
 LinkScan
 LinkWalker
-Linkdexbot
+LinksManager
 LinqiaMetadataDownloaderBot
-LinqiaScrapeBot
 Lipperhey
-Litemage_walker
-MFC_Tear_Sample
-MIDown tool
-MJ12bot
+MIIxpc
 MTRobot
+Mag-Net
 Majestic SEO
-Majestic12
-Meanpathbot
-MicroMessenger
-Mister PiX
-Mojeek
-Morfeus Fucking Scanner
-Msrabot
+Mass Downloader
+Mata Hari
+MauiBot
+Mb2345Browser
+MegaIndex.ru
+Microsoft Data Access
+Mozlila
+Mr.4x3
+Musobot
 NICErsPRO
-Name Intelligence
-Nameprotect
-Navroad
-NearSite
 Nessus
 Net Vampire
-NetAnts
-NetMechanic
-Netcraft
-Nettrack
-Nibbler
-Nimbostratus
-Not
-Nuclei
-Offline Navigator
-Openfind
-Openvas
-OrangeSpider
-OutfoxBot
-PECL::HTTP
-PHPCrawl
+NextGenSearchBot
+Niki-bot
+Nmap
+OnCrawl
+OpenVAS
 POE-Component-Client-HTTP
-Panscient
+PageAnalyzer
+PageScorer
+PageThing.com
+Pandalytics
+Papa Foto
+PeoplePal
+Pi-Monster
 Picscout
-Pimonster
-Psbot
-PxBroker
-Quick-Crawler
-RSSingBot
+PictureFinder
+Piepmatz
+Pixray
+PleaseCrawl
+ProWebWalker
+PyCurl
+RankActive
+RankActiveLinkBot
 RankFlex
+RankingBot
+RankingBot2
 ReGet
+RealDownload
+Reaper
 RocketCrawler
-SEOlyticsCrawler
-SEOprofiler
-SMTBot
-ScanAlert
+Rogerbot
+Scanbot
 ScoutJet
 Scrapy
-Searchestate
+ScreenerBot
 SearchmetricsBot
-SemanticJuice
-SemrushBot
 SentiBot
 SeobilityBot
 Seomoz
-Siphon
-SiteExplorer
+Site Sucker
 SiteLockSpider
+SiteSnagger
 SiteSucker
+Siteimprove
 Sitevigil
-SmartDownload
-Snake
-Sosospider
-Spammen
-SpankBot
+Snapbot
+SocialRankIOBot
+Sociscraper
 Spanner
-Spinn3r
-SputnikBot
-Sqlworm
-Steeler
-Sucker
-Sucuri
-Suzuran
+Spbot
+Sqlmap
+Swiftbot
+T0PHackTeam
 T8Abot
-Telesoft
+Teleport
 Telesphoreo
+Telesphorep
 TheNomad
-Titan
+Thumbor
+TightTwatBot
 Toata
-Twice
+Tracemyfile
+True_Robot
+Turingos
+TwengaBot
 Typhoeus
-VB Project
-VCI
-Vacuum
+URLy Warning
+URLy.Warning
+Upflow
+V-BOT
 Vagabondo
+VelenPublicWebCrawler
 VeriCiteCrawler
+Virusdie
+Voltron
 WASALive-Bot
+WISENutbot
 WPScan
 WWW-Collector-E
+WWW-Mechanize
+WWW::Mechanize
 WWWOFFLE
-Wallpapers
 Web Auto
 Web Enhancer
+Web Fetch
 Web Fuck
-Web Sauger
-WebAuto
+Web Sucker
+WebBandit
 WebCollage
-WebFuck
-WebGo IS
-WebReaper
-WebZIP
-Webshag
+WebImageCollector
+WebPix
+WebmasterWorldForumBot
+Website Quester
 WebsiteExtractor
 WebsiteQuester
 Whacker
-Whatweb
-Wotbox
+Widow
+WiseGuys Robot
+Wonderbot
+Woobot
+Wprecon
 Xaldon WebSpider
-Xenu
-YoudaoBot
+Xaldon_WebSpider
+Zade
+Zauba
 Zermelo
-ZoominfoBot
-arquivo-web-crawler
-arquivo.pt
-autoemailspider
+Zeus
+Zitebot
+ZmEu
+ZumBot
 backlink-check
+cah.io.community
+check1.exe
+clark-crawler
 cognitiveseo
-crawler.feedback
+com.plumanalytics
+dataforseo.com
 demandbase-bot
-domainsproject.org
 eCatch
-evc-batch
-gopher
 heritrix
+instabid
 internetVista monitor
-isitwp.com
-lwp-trivial
-meanpathbot
 mediawords
-muhstik-scan
 oBot
 pcBrowser
 plumanalytics
-ripz
-scalaj-http
-seocompany.store
-seostar
+satoristudio.net
+seobility
+seoscanners
 sogouspider
 trendiction.com
-ubermetrics-technologies.com
+voyagerx.com
+webgains-bot
 webprosbot
-x22Mozilla
-xpymep1.exe
 zauba.io