Hottest open source right now - OpenLLM.

pip install openllm - you have local LLM with rest/grpc apis.
pip commands to add/download additional llms
+much much more

Looking good - the right way of keeping ai accessible, logical

there is no terminator - we cant even cure common cold.