bx.ee

Jeremiah Gowdy

LLM Shared Storage

In this era of downloading different LLM models, we need the vendors of different inference engines and their associated user interfaces to use a unified directory structure for downloading models. If I’m working with two different platforms that support GGUF, those two platforms should download and store models in the same default path and directory structure. I currently have terabytes of models downloaded, and the level of duplication is beyond annoying.