This seems quite 'nice'...

i ve not tried it yet...
but would soon...

i guess 4gb Vram is the holy grail for mass deployment for ai ...
it should only get better from here...
ai - is just a tool, lets not make new hockus pockus out of it - thats the job of stock brokers
and
sales-peeps
(who never coded, just get most of their gyaan from hollywood and sales ppts)

huggingface.co/blog/lyogavin/airllm

further thoughts...

I guess even Pope acts as sales peeps for ai
...jerusalem peeps and their 'beliefs' - as fickle as $