welsberr
/
GenieHive
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
GenieHive is a generative AI router, starting with presenting an OpenAI API-compatible endpoint for clients to interact with, while their requests are routed appropriately among one or more nodes that register running servers with the control host. From running multiple LLMs on a single host to doing that across a distributed cluster, GenieHive aims to make it easier to actually use local AI.
1 Commit 1 Branch 0 Tags 280 KiB
Python 95.9%
Shell 4%
Go to file
welsberr dabbebd3ba Initial commit 2026-04-07 13:10:24 -04:00
.gitignore Initial commit 2026-04-07 13:10:24 -04:00
LICENSE Initial commit 2026-04-07 13:10:24 -04:00
README.md Initial commit 2026-04-07 13:10:24 -04:00

README.md

GenieHive

GenieHive is a generative AI router, starting with presenting an OpenAI API-compatible endpoint for clients to interact with, while their requests are routed appropriately among one or more nodes that register running servers with the control host. From running multiple LLMs on a single host to doing that across a distributed cluster, GenieHive aims to make it easier to actually use local AI.