AI工具

FastGPT

官网部署文档

https://doc.fastgpt.cn/docs/development/docker/

计划采用中转API访问各种AI

部署版本4.99

部署

先安装好docker和docker-compose

root@home-u20:/home/rali/fastgpt# docker -v
Docker version 28.1.1, build 4eba377
root@home-u20:/home/rali/fastgpt# docker-compose -v
docker-compose version 1.29.2, build 5becea4c
root@home-u20:/home/rali/fastgpt#

下载config.json和docker-compose.yml

root@home-u20:/home/rali/fastgpt# ls -l
total 28
drwx------ 19 systemd-coredump root 4096 May 26 12:33 aiproxy_pg
-rw-rw-r--  1 rali             rali 1142 May 25 14:51 config.json
-rw-rw-r--  1 rali             rali 7652 May 26 07:35 docker-compose.yml
drwxr-xr-x  3 root             root 4096 May 25 15:16 mongo
drwxr-xr-x  3 root             root 4096 May 25 15:16 pg
drwxr-xr-x  3 root             root 4096 May 25 15:16 redis

通过docker-compose up -d拉起服务,并查看docker ps

root@home-u20:/home/rali/fastgpt# docker ps
CONTAINER ID   IMAGE                                       COMMAND                  CREATED        STATUS                    PORTS                                         NAMES
19d71fc01703   ghcr.io/labring/aiproxy:v0.1.7              "aiproxy"                22 hours ago   Up 35 minutes (healthy)   3000/tcp                                      aiproxy
9ca0cf2b575a   ghcr.io/labring/fastgpt:v4.9.9              "sh -c 'node --max-o…"   22 hours ago   Up 35 minutes             0.0.0.0:3000->3000/tcp, [::]:3000->3000/tcp   fastgpt
552714bb8d3c   ghcr.io/labring/fastgpt-sandbox:v4.9.9      "docker-entrypoint.s…"   22 hours ago   Up 35 minutes                                                           sandbox
cc90bbda1b48   ghcr.io/labring/fastgpt-mcp_server:v4.9.9   "sh -c 'node /app/pr…"   22 hours ago   Up 35 minutes             0.0.0.0:3005->3000/tcp, [::]:3005->3000/tcp   fastgpt-mcp-server
d7736e81c44f   pgvector/pgvector:0.8.0-pg15                "docker-entrypoint.s…"   22 hours ago   Up 35 minutes (healthy)   5432/tcp                                      pg
9f770ff9b6ac   redis:7.2-alpine                            "docker-entrypoint.s…"   22 hours ago   Up 35 minutes (healthy)   6379/tcp                                      redis
5a626b40290b   mongo:5.0.18                                "bash -c 'openssl ra…"   22 hours ago   Up 35 minutes             27017/tcp                                     mongo
f3bfe84984f6   pgvector/pgvector:0.8.0-pg15                "docker-entrypoint.s…"   22 hours ago   Up 35 minutes (healthy)   5432/tcp                                      aiproxy_pg
root@home-u20:/home/rali/fastgpt#

初始化设置

如果你出现这个报错,需要设置默认的索引模型和语言模型

启用gpt-4.1和text-embedding-3-large作为默认模型

同样的步骤启用其他几个模型

一个新的对话应用