Nice work !
#5
by
edwarddddr - opened
I am testing this model in a quantized form Q5_K_M.gguf and so far it's pretty neat.
Still tweaking, I have managed to get ~18tps on gtx1050ti, speed is not yet impressive, but the ability to call tools and manage work is !