deepseek本地部署

  • 下载ollma:https://ollama.com/download/windows
    https://registry.ollama.ai
    https://ollama.deepseek.com
    https://ollama.zju.edu.cn
    https://ollama.modelscope.cn
    https://www.modelscope.cn/models/ypwhsa/ollama/files
    
    //拉取镜像指令
    OLLAMA_MODELS=https://registry.ollama.ai ollama pull deepseek-r1:70b
    or
    OLLAMA_MODELS=https://registry.ollama.ai ollama run deepseek-r1:70b
    
  • 下载镜像
    ollama run deepseek-r1:7b
    
  • page assisant:https://github.com/n4ze3m/page-assist/releases/tag/v1.5.38
  • 使用GPU运行:https://blog.csdn.net/2401_86439035/article/details/149159079?utm_medium=distribute.pc_relevant.none-task-blog-2defaultbaidujs_baidulandingword~default-5-149159079-blog-145850583.235^v43^pc_blog_bottom_relevance_base3&spm=1001.2101.3001.4242.4&utm_relevant_index=7
    增加环境变量
    OLLAMA_GPU_LAYER
    cuda