nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-13 10:07:07 +00:00

100 lines
1 KiB
Text

ADmantX
Abonti
Aboundex
Anarchie
Anarchy
Apexoo
Attach
BackWeb
Bandit
Blackboard
Brandprotect
Brandwatch
BunnySlippers
CCBot
Cocolyzebot
CopyRightCheck
CrunchBot
Curious
Discoverybot
Dispatch
FlashGet
Fyrebot
GPTBot
Gotit
GrapeFX
HTTrack
Heritrix
Iblog
Internet Ninja
JetCar
Jetty
LeechGet
Lftp
LibWeb
Likse
LinksManager
LinqiaScrapeBot
Lipperhey Spider
MIDown tool
MSFrontPage
MSIECrawler
Mail.RU_Bot
Moblie Safari
Nameprotect
Nettrack
Nikto
Octopus
OnCrawl
OpenVAS
PageGrabber
Papa Foto
Petalbot
Picscout
Picsearch
PleaseCrawl
Pockey
ProWebWalker
Pu_iN
QueryN Metasearch
RankingBot
Re-re
ReGet
SEOlyticsCrawler
SEOstats
Seekport
SenutoBot
Sosospider
Sottopop
SputnikBot
Sqlmap
Surfbot
Toweyabot
URLy.Warning
V-BOT
WISENutbot
Wallpapers
Web Auto
Web Enhancer
Web Fuck
Web Sucker
WebCollage
WebEnhancer
WebFuck
WebImageCollector
Webalta
WebmasterWorldForumBot
Website Quester
WiseGuys Robot
Xaldon WebSpider
ZmEu
crawler4j
domainsproject.org
facebookscraper
ips-agent
isitwp.com
linkdexbot
openai
s1z.ru
webpros.com
x22Mozilla