Just updated #janai, and oh my it's improved a lot. With the Jan nano model, the token speed is at 47 tokens/sec on my mac. Pretty impressive.
#RunLLMLocally #LocalLLM #LocalAI
0
0
0
0
Latest posts tagged with #RunLLMLocally on Bluesky
Just updated #janai, and oh my it's improved a lot. With the Jan nano model, the token speed is at 47 tokens/sec on my mac. Pretty impressive.
#RunLLMLocally #LocalLLM #LocalAI