本地搭建DeepSeek和知识库 Dify做智能体Agent(推荐)
<h1>一、基础信息</h1><p>1、硬件环境：</p>
<p>CPU >= 2 Core</p>
<p>显存/RAM ≥ 16 GiB（推荐）</p>
<p>2、软件</p>
<p>（1）Ollama</p>
<p>Ollama 是一款跨平台的大模型管理客户端（MacOS、Windows、Linux），旨在无缝部署大型语言模型 (LLM)，例如 DeepSeek、Llama、Mistral 等。Ollama 提供大模型一键部署，所有使用数据均会保存在本地机器内，提供全方面的数据隐私和安全性。</p>
<p>（2）Dify</p>
<p>Dify 作为同样开源的 AI 应用开发平台，提供完整的私有化部署方案。通过将本地部署的 DeepSeek 服务无缝集成到 Dify 平台，企业可以在确保数据隐私的前提下，在本地服务器环境内构建功能强大的 AI 应用。</p>
<p>（3）docker</p>
<p>需要使用docker拉取镜像并运行，简化部署逻辑</p>
<h1>二、部署DeepSeek-R1</h1>
<p>1、部署Ollama</p>
<p>（1）打开官网</p>
<p>https://ollama.com/</p>
<p>（2）下载对应系统的Ollama</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208161127456-223288974.png"></p>
<p>（3）安装</p>
<p><img class="medium-zoom-image lazyload" height="245" width="199" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208161349628-1260523306.png"></p>
<p> </p>
<p>(4)验证--终端执行</p>
<p>ollama -v</p>
<p><img class="medium-zoom-image lazyload" height="101" width="351" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208161620682-14965065.png"></p>
<p>2、使用ollama安装DeepSeek-r1模型</p>
<p>（1）ollama安装DeepSeek模型</p>
<p> ollama run deepseek-r1:7b</p>
<div class="enlighter-default enlighter-v-standard enlighter-t-dracula enlighter-hover enlighter-linenumbers enlighter-overflow-scroll">
<div class="enlighter">
<div class="">
<div><span class="enlighter-text"> 越狱版-放飞自我：ollama run huihui_ai/deepseek-r1-abliterated:7b</span></div>
</div>
</div>
</div>
<p> 注：根据本机配置，选择合适的DeepSeek模型进行部署。本机推荐安装 7B 尺寸模型，大约需要拉取4.7GB数据，可以在ollama官网搜索模型，查看模型大小</p>
<p><img class="medium-zoom-image lazyload" height="153" width="516" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208162209578-1460737862.png"></p>
<p><img class="medium-zoom-image lazyload" height="359" width="397" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208163309562-1634026087.png"></p>
<p>（2）安装后验证</p>
<p>安装完成，直接输入问题即可，可以看到回复信息</p>
<p><img class="medium-zoom-image lazyload" height="314" width="706" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250208175828474-934124902.png"></p>
<h1>三、部署Dify社区版</h1>
<p>1、下载代码</p>
<p>（1）git方式下载</p>
<p>git clone https://github.com/langgenius/dify.git</p>
<p>（2）web方式下载</p>
<p>打开链接：https://github.com/langgenius/dify.git</p>
<p><img height="250" width="478" data-src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210113950466-413003741.png"></p>
<p>2、进入目录</p>
<p>cd dify/docker</p>
<p>3、复制配置文件</p>
<p>cp .env.example .env</p>
<p>4、docker配置代理（已配置的话可以忽略该步骤）</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210114249897-509258789.png"></p>
<pre class="language-json highlighter-hljs"><code>内容如下：
"registry-mirrors": [
"https://dockerpull.org",
"https://docker.1panel.dev",
"https://docker.foreverlink.love",
"https://docker.fxxk.dedyn.io",
"https://docker.xn--6oq72ry9d5zx.cn",
"https://docker.zhai.cm",
"https://docker.5z5f.com",
"https://a.ussh.net",
"https://docker.cloudlayer.icu",
"https://hub.littlediary.cn",
"https://hub.crdz.gq",
"https://docker.unsee.tech",
"https://docker.kejilion.pro",
"https://registry.dockermirror.com",
"https://hub.rat.dev",
"https://dhub.kubesre.xyz",
"https://docker.nastool.de",
"https://docker.udayun.com",
"https://docker.rainbond.cc",
"https://hub.geekery.cn",
"https://docker.1panelproxy.com",
"https://atomhub.openatom.cn",
"https://docker.m.daocloud.io",
"https://docker.1ms.run",
"https://docker.linkedbus.com"
]</code></pre>
<p>5、使用docker拉取镜像并运行</p>
<p>docker compose up -d</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210114330946-1913227719.png"></p>
<p> </p>
<h1>四、设置 DeepSeek 接入至 Dify</h1>
<p>1、浏览器打开dify，初始化管理员信息</p>
<p>http://127.0.0.1</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210114648682-1073165247.png"></p>
<p>2、设置模型</p>
<p>右上角头像==》设置==》模型供应商==》Ollama</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210115027850-1332079577.png"></p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210115112258-98445734.png"></p>
<p>3、设置模型信息</p>
<p>模型名称：deepseek-r1:7b</p>
<p>基础url：http://本机ip:11434</p>
<p>最大token:32768</p>
<p><span style="color: rgba(186, 55, 42, 1)">注：</span>容器部署dify的话：地址写host.docker.internal或本机ip，不能用127.0.0.1</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210144157602-1610439789.png"></p>
<p>4、创建知识库</p>
<p>通过拖拽文件上传，或者抓取网页内容方式获取数据</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210160702700-1252114562.png"></p>
<p>5、创建Agent智能体</p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210152634499-529341078.png"></p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210152708311-1466600190.png"></p>
<p><img src="https://img2024.cnblogs.com/blog/2350829/202502/2350829-20250210162528119-575575090.png"></p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p> </p>
<p><span style="font-family: "PingFang SC", "Smart Quotes", -apple-system, BlinkMacSystemFont, "Helvetica Neue", "Microsoft YaHei", "Source Han Sans SC", "Noto Sans CJK SC", "WenQuanYi Micro Hei", sans-serif">参考文章：</span></p>
<p><span style="font-family: "PingFang SC", "Smart Quotes", -apple-system, BlinkMacSystemFont, "Helvetica Neue", "Microsoft YaHei", "Source Han Sans SC", "Noto Sans CJK SC", "WenQuanYi Micro Hei", sans-serif">1、在MAC系统下安装Docker、Dify以及docker镜像加速</span></p>
<p><span style="font-family: "PingFang SC", "Smart Quotes", -apple-system, BlinkMacSystemFont, "Helvetica Neue", "Microsoft YaHei", "Source Han Sans SC", "Noto Sans CJK SC", "WenQuanYi Micro Hei", sans-serif">https://cloud.tencent.com/developer/article/2478585</span></p>
<p><span style="font-family: "PingFang SC", "Smart Quotes", -apple-system, BlinkMacSystemFont, "Helvetica Neue", "Microsoft YaHei", "Source Han Sans SC", "Noto Sans CJK SC", "WenQuanYi Micro Hei", sans-serif">2、本地搭建Dify</span></p>
<p><span style="font-family: "PingFang SC", "Smart Quotes", -apple-system, BlinkMacSystemFont, "Helvetica Neue", "Microsoft YaHei", "Source Han Sans SC", "Noto Sans CJK SC", "WenQuanYi Micro Hei", sans-serif">https://blog.csdn.net/piaoxue820/article/details/138191528</span></p>
<p>3、接入 Ollama 部署的本地模型</p>
<p>https://docs.dify.ai/zh-hans/development/models-integration/ollama</p>
<p>4、越狱版-无审查无限制</p>
<p>https://www.freedidi.com/18431.html</p>
<p>5、Cherry Studio调用模型</p>
<p>https://ai-bot.cn/ai-tutorials-deepseek-local-deployment/</p><br><br>
来源：https://www.cnblogs.com/robots2/p/18707552
頁:
[1]