V4.2022.12.3531 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-01h4x.com
 404enemy
-ADmantX
-ALittle Client
 ASPSeek
-Aboundexbot
+Abonti
+Aboundex
 AhrefsBot
+Alexibot
 AllSubmitter
-Alligator
-Anarchie
-Aspiegel
-Atomseobot
-AwarioRssBot
+Anarchy99
+Attach
 AwarioSmartBot
-BDFetch
-BackStreet
-BackWeb
-BacklinkCrawler
+BLEXBot
+Badass
+Barkrowler
+BatchFTP
 Battleztar Bazinga
 BetaBot
-Black Hole
-Blow
+BlackWidow
+Blackboard
+Boardreader
 Bolt
 Brandwatch
-BuiltBotTough
-BuiltWith
+Buck
+BunnySlippers
 BuzzSumo
-CherryPicker
+Calculon
+CazoodleBot
+Cegbfeieh
+CheeseBot
 ChinaClaw
 Chlooe
-Cogentbot
+Citoid
+Cloud mapping
 Collector
-Crawling at Home Project
-CrazyWebCrawler
+CopyRightCheck
+Copyscape
+Curious
 Custo
-DBLBot
-DIIbot
+CyotekWebCopy
+DSearch
+DataCha0s
+DatabaseDriverMysqli
 Devil
-DigitalPebble
-Dirbuster
 Disco
+Discobot
+Discoverybot
 Dispatch
-DittoSpyder
+DnBCrawler-Analytics
+DnyzBot
+DomainAppender
 DomainCrawler
-Dragonfly
+Dotbot
+Download Wonder
 Drip
+EMail Siphon
+EMail Wolf
+EasyDL
 Ebingbong
-EirGrabber
-EroCrawler
-Extractor
-ExtractorPro
-FHscan
-Fimap
-Firefox/7.0
+ExtLinksBot
+Extreme Picture Finder
+FemtosearchBot
+FlashGet
 Flunky
-Foobot
+G-i-g-a-b-o-t
+GT::WWW
 Genieo
 GermCrawler
 GetRight
 GetWeb
-Go!Zilla
+GrabNet
 Grabber
-Grafula
-GrapeFX
-GridBot
-HTTrack
-Haansoft
+HEADMasterSEO
 HaosouSpider
-Havij
-HonoluluBot
-IDBTE4M
-IRLbot
-IlseBot
-IndeedBot
+Heritrix
+Hloader
+Id-search
+Image Fetch
 Indy Library
-InfoNaviRobot
 Intelliseek
-InternetSeer
+Iskanie
 IstellaBot
-JOC Web Spider
-JamesBOT
-JustView
-Larbin
-Lightspeedsystems
-Likse
-LinkWalker
-Linkbot
+JetCar
+Jetty
+JikeSpider
+Jorgee
+Keyword Density
+Kinza
+LNSpiderguy
+Lanshanbot
+LeechFTP
+LeechGet
+Lftp
+Libwhisker
 LinkpadBot
 LinksManager
-LinqiaScrapeBot
-Lipperhey
-Ltx71
-MFC_Tear_Sample
-MIIxpc
-MJ12bot
+Litemage_walker
 MSFrontPage
-MSIECrawler
 Mag-Net
-Majestic SEO
+Magnet
+Mail.RU_Bot
 Majestic12
-MarkMonitor
 MarkWatch
-Mass Downloader
+Masscan
+Mata Hari
 Mb2345Browser
 Meanpathbot
-Metauri
+Mediatoolkitbot
 Microsoft Data Access
-Mojeek
-Mojolicious
-MolokaiBot
-Morfeus Fucking Scanner
-Mozlila
-Musobot
+Msrabot
 NICErsPRO
-NetMechanic
-NetZIP
+Nameprotect
+Navroad
+NearSite
+NetLyzer
+NetSpider
 Netcraft
 Nettrack
-Nibbler
-Niki-bot
-Nikto
-Ninja
-Nmap
-Nutch
+Nimbostratus
+Octopus
 Offline Navigator
 OnCrawl
 OpenLinkProfiler
-OpenVAS
-Openfind
-Openvas
+OrangeSpider
 PECL::HTTP
 PHPCrawl
-POE-Component-Client-HTTP
-PageAnalyzer
 PageGrabber
-PageScorer
 PageThing.com
 Pandalytics
 Papa Foto
-Pavuk
-Pimonster
+Petalbot
+Picscout
 Pixray
-PleaseCrawl
-ProWebWalker
+Pockey
 Psbot
-Pump
-QueryN Metasearch
-Quick-Crawler
-RSSingBot
 RankActive
-RankActiveLinkBot
-RankurBot
-Recorder
+RankFlex
+RankingBot
+RankingBot2
+Re-re
+ReGet
+RealDownload
+RedesScrapy
 RepoMonkey
 RocketCrawler
+Rogerbot
+SEOkicks
+SEOlyticsCrawler
 SISTRIX
+SalesIntelligent
 ScanAlert
-Scanbot
+ScoutJet
 Scrapy
-ScrepyBot
-SearchmetricsBot
-SemanticJuice
-Semrush
+Screaming
+ScreenerBot
+Searchestate
 SemrushBot
-SentiBot
-SiteExplorer
-SiteLockSpider
-Siteimprove
+SeoSiteCheckup
+Shodan
+Siphon
+Site Sucker
+Sitebeam
 Sitevigil
 Snake
-Snapbot
 Snoopy
-SocialRankIOBot
+Sociscraper
 Sogou web spider
-Spinn3r
-Sqlworm
+SpaceBison
+Spbot
+SputnikBot
+Sqlmap
+Sqworm
 Stripper
-Sucker
+Sucuri
 SuperBot
-SurveyBot
-Swiftbot
+SuperHTTP
+Szukacz
 T0PHackTeam
-Teleport
-TeleportPro
 Telesoft
 Telesphoreo
-Telesphorep
-The Intraformant
 TightTwatBot
-Trendiction
+Tracemyfile
 Trendictionbot
-Typhoeus
+True_Robot
+TurnitinBot
+TwengaBot
+Twice
 URLy Warning
-V-BOT
-Vacuum
-Vagabondo
-VelenPublicWebCrawler
-WISENutbot
-WPScan
-WallpapersHD
-WeSEE
-Web Collage
-Web Enhancer
+URLy.Warning
+Upflow
+VeriCiteCrawler
+VidibleScraper
+WASALive-Bot
+WBSearchBot
+WEBDAV
+WWW::Mechanize
+WWWOFFLE
+Wallpapers/3.0
+Web Auto
+Web Fetch
+Web Pix
 WebAuto
-WebCopier
+WebBandit
+WebFuck
 WebImageCollector
+WebLeacher
+WebReaper
 WebSauger
-Webalta
+WebStripper
+WebSucker
+WebWhacker
 WebmasterWorldForumBot
-Website Quester
+Webster
+Who.is Bot
+WinHTTrack
 WiseGuys Robot
 Wonderbot
+Woobot
 Wprecon
-Xaldon WebSpider
-Xenu
-Zeus
+Zitebot
 ZmEu
-ZoominfoBot
+ZoomBot
+ZumBot
 adscanner
 archive.org_bot
-arquivo.pt
-cah.io.community
 cognitiveseo
-com.plumanalytics
-crawler.feedback
-crawler4j
+dataforseo.com
 demandbase-bot
-domainsproject.org
 eCatch
-instabid
+facebookscraper
+gopher
 internetVista monitor
-ips-agent
-lwp-request
-lwp-trivial
 magpie-crawler
+meanpathbot
+netEstate NE Crawler
 oBot
-page scorer
 plumanalytics
 polaris version
-ripz
-s1z.ru
-scan.lol
+seobility
 seoscanners
-serpstatbot
-sitechecker.pro
-spyfu
+seostar
+sexsearcher
+siteripz
+sp_auditbot
 tAkeOut
 voyagerx.com
+webgains-bot
+webmeup-crawler
+webprosbot
+x22Mozilla
 zauba.io
 zgrab