主页 > 创业  > 

rk3576上部署deepseek

rk3576上部署deepseek
1. 部署方式

deepseek的部署方式有两种:

1.开发板内直接部署,这种方式简单快捷,但是没有用上rk芯片的npu性能,完全使用CPU来进行推理

2.使用RKLLM 软件堆栈将 AI 模型部署到 Rockchip 芯片上

2. 开发板部署Deepseek-r1模型

部署流程:

安装必要命令; 安装 ollama; 部署 deepseek 2.1 安装必要命令

安装curl

#升级软件 sudo apt-get update #安装curl sudo apt-get install curl 通过以上两条指令,完成了curl命令的安装。 2.2 安装 ollama

打开ollama

运行上图所示指令:

curl -fsSL ollama /install.sh | sh >>> Installing ollama to /usr/local >>> Downloading Linux arm64 bundle ######################################################################## 100.0% >>> Creating ollama user... >>> Adding ollama user to render group... >>> Adding ollama user to video group... >>> Adding current user to ollama group... >>> Creating ollama systemd service... >>> Enabling and starting ollama service... Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service. >>> The Ollama API is now available at 127.0.0.1:11434. >>> Install complete. Run "ollama" from the command line. WARNING: No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode. 2.3 部署 deepseek

在 ollama 的官网上,选择 "Models"

1.5B的模型大概1.1G,复制指令黏贴到命令行里,就可以自动开始下载了

$ollama run deepseek-r1:1.5b pulling manifest pulling aabd4debf0c8... 100% ▕▏ 1.1 GB pulling 369ca498f347... 100% ▕▏ 387 B pulling 6e4c38e1172f... 100% ▕▏ 1.1 KB pulling f4d24e9138dd... 100% ▕▏ 148 B pulling a85fe2a2e58e... 100% ▕▏ 487 B verifying sha256 digest writing manifest success 2.4 测试deepseek

开发板下载deepseek完成后使用命令打开:

How to earn an annual salary of millions <think> </think> To earn an annual salary of millions, the approach will depend on several factors such as your industry, work location, and level of experience. Here are some general strategies: ### 1. **High-Paying Jobs** - **Specialization:** Work in industries with high demand for specialized skills. - **Location:** Consider working remotely or in a high-demand region. - **Experience:** Look into roles that require exceptional technical expertise and strategic thinking. ### 2. **Online Courses and Training Programs** - **Specialized Training:** Enroll in online courses or certifications related to your desired field, such as data science, engineering, finance, or law. - **Skill Development:** Focus on acquiring advanced skills through platforms like Coursera, Udemy, or LinkedIn Learning. ### 3. **Consulting and High-Stakes Work** - **Consulting Services:** If you have a bac
标签:

rk3576上部署deepseek由讯客互联创业栏目发布,感谢您对讯客互联的认可,以及对我们原创作品以及文章的青睐,非常欢迎各位朋友分享到个人网站或者朋友圈,但转载请说明文章出处“rk3576上部署deepseek