Phind’s new model beats GPT-4 at coding with 5x speed
Phind just rolled out a new coding model based on CodeLlama-34B that scores 74.7% on HumanEval, outpacing GPT-4. Powered by Nvidia TensorRT-LLM on H100 GPUs, it delivers up to 100 tokens per second with a 16k context window. Why it matters: developers get GPT-4-level code generation at GPT-3.5 speed, completely open-sourced on Hugging Face.