[Feature Request] Any plans to support Github Models?

[M3chD09]

🥰 Feature Description

GitHub Models is available now. I hope this project can support it.

🧐 Proposed Solution

The api endpoint is https://models.inference.ai.azure.com/. But it can't be used directly in BASE_URL . It always return 404 Resource not found.
I think it POST to https://models.inference.ai.azure.com/v1/chat/completions, while the real url is https://models.inference.ai.azure.com/chat/completions. More flexible processing is needed here.

📝 Additional Information

No response

[rexkyng]

a workaround would be setting BASE_URL as https://models.inference.ai.azure.com/chat/completions#

[M3chD09]

According to your workaround, the POST URL becomes https://models.inference.ai.azure.com/chat/completions#/v1/chat/completions, and anything after the # has no effect, right?
Anyway it works. Thank you!