Torrent GPT - next big thing in open source LLMs.
Theoretically - run any model without owning the hardware
True distributed computing for the masses.
automated import. If something looks out of place, check the orig linkedin post
After Thoughts
Thoth:#1
This can be a great product for companies - sharing resources across depts/verticals - in a distributed yet scalable - intranet facilities and all
one good use would be learning management for orgs/teams.
basically daisy chain cheap gaming cards to load a bigger LLM - cost of vram goes exponentially like hw does (vert scalability and all)
optimistic.