Torrent GPT - next big thing in open source LLMs.

Torrent GPT - next big thing in open source LLMs.

Theoretically - run any model without owning the hardware

github.com/bigscience-workshop/petals

True distributed computing for the masses.

further thoughts...

This can be a great product for companies - sharing resources across depts/verticals - in a distributed yet scalable - intranet facilities and all
one good use would be learning management for orgs/teams.
basically daisy chain cheap gaming cards to load a bigger LLM - cost of vram goes exponentially like hw does (vert scalability and all)

optimistic.