「使用Docker在Orange Pi上LLM（使用GPU加速）」的评论 https://haoluobo.com/2023/09/orangepi5-rk3588-mlc-llm-docker/ to be continue.... Thu, 23 Nov 2023 06:06:17 +0000 hourly 1 https://wordpress.org/?v=6.8.2 评论者：vicalloy https://haoluobo.com/2023/09/orangepi5-rk3588-mlc-llm-docker/#comment-13075 Thu, 23 Nov 2023 06:06:17 +0000 https://haoluobo.com/?p=12465#comment-13075 回复给 kobe。

你的 Orange Pi 用的是什么操作系统。看错误是你的宿主机没有GPU驱动。

]]> 评论者：kobe https://haoluobo.com/2023/09/orangepi5-rk3588-mlc-llm-docker/#comment-13062 Thu, 23 Nov 2023 01:21:24 +0000 https://haoluobo.com/?p=12465#comment-13062 补充一下，是以mlc_chat.gradio模式运行的时候，web起来了，选择加载模型的时候报这个错误的

]]> 评论者：kobe https://haoluobo.com/2023/09/orangepi5-rk3588-mlc-llm-docker/#comment-13055 Thu, 23 Nov 2023 00:35:56 +0000 https://haoluobo.com/?p=12465#comment-13055 博主好，后台调用模型的时候爆错“ValueError: Invalid device name: mali. Please enter the device in the form ‘device_name:device_id’ or ‘device_name’, where ‘device_name’ needs to be one of ‘cuda’, ‘metal’, ‘vulkan’, ‘rocm’, ‘opencl’, ‘auto’.”，是啥情况

]]>