tacit/nanochat
1
0
Fork 0
mirror of https://github.com/karpathy/nanochat.git synced 2026-05-12 10:50:16 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix(chat-api): detect Modal URL by domain not path suffix

Browse Source
This commit is contained in:
Manmohan Sharma 2026-04-16 14:59:20 -07:00
parent 2dd914a69d
commit df0584b861
No known key found for this signature in database
1 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
services/chat-api/src/services/inference_client.py
View File

@ -84,10 +84,11 @@ class InferenceClient:
}
client = self._get_client()
# If the base_url already ends with a path (e.g. Modal endpoint URL),
# use it directly. Otherwise append /generate for the local service.
# Modal endpoints have the function name in the hostname
# (e.g. ...-generate.modal.run) — POST to root.
# Local inference service needs /generate appended.
url = self.base_url
if not url.endswith("/generate"):
if "modal.run" not in url:
url = f"{url}/generate"
async with client.stream(