Ollama

A local, free, open source, generative AI stack for developers? Docker and friends aim to cover all the bases

Package includes Ollama, which lets you download a range of open source LLM model packages, bundling weights, configuration and data into a single portable file