NVIDIA brings custom AI to your local PC
NVIDIA just released Chat with RTX, a free tech demo that lets you run customized chatbots completely offline on Windows. By connecting local files and YouTube links to open-source models like Mistral and Llama 2 via TensorRT-LLM, you can query notes and documents without sending data to the cloud. You will need a GeForce RTX 30 Series GPU or higher with at least 8GB of VRAM.