Skip to content

python main_gui.py 后卡住不动 #23

@MuuuShin

Description

@MuuuShin

本地部署LLM为chatglm3-6b
python=3.9
Ubuntu20.04

修改了部分代码尝试让模型本地加载
tokenizer = AutoTokenizer.from_pretrained("~/THUDM/chatglm3-6b", trust_remote_code=True)

model = AutoModel.from_pretrained("~/THUDM/chatglm3-6b", trust_remote_code=True).half().cuda()

已填写config.cfg

python local_database.py没问题,正常执行

调用python main_gui.py后整个console卡住不动,等了至少5分钟也没有反应
debug在这个文件的第一行打断点也没用

image

ctrl+C强停后的报错

Details
^CTraceback (most recent call last):
  File "/data/bch/LLM/forSQL/ChatSQL/main_gui.py", line 14, in <module>
    from utils import obtain_sql, retrieval_related_table, execute_sql
  File "/data/bch/LLM/forSQL/ChatSQL/utils.py", line 8, in <module>
    from prompt import embedder, corpus_embeddings, table_schema, corpus, In_context_prompt
  File "/data/bch/LLM/forSQL/ChatSQL/prompt.py", line 9, in <module>
    embedder = SentenceTransformer('paraphrase-multilingual-MiniLM-L12-v2')
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/sentence_transformers/SentenceTransformer.py", line 87, in __init__
    snapshot_download(model_name_or_path,
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/sentence_transformers/util.py", line 442, in snapshot_download
    model_info = _api.model_info(repo_id=repo_id, revision=revision, token=token)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
    return fn(*args, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/hf_api.py", line 2227, in model_info
    r = get_session().get(path, headers=headers, timeout=timeout, params=params)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 68, in send
    return super().send(request, *args, **kwargs)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/requests/adapters.py", line 486, in send
    resp = conn.urlopen(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 793, in urlopen
    response = self._make_request(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 467, in _make_request
    self._validate_conn(conn)
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
    conn.connect()
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connection.py", line 616, in connect
    self.sock = sock = self._new_conn()
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/connection.py", line 198, in _new_conn
    sock = connection.create_connection(
  File "/data/bch/miniconda3/envs/chatsql/lib/python3.9/site-packages/urllib3/util/connection.py", line 73, in create_connection
    sock.connect(sa)
KeyboardInterrupt

<\details>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions