Tandemn

Tandemn just raised $1.7M! tandemn.com Building the missing layer between heterogeneous GPUs & huge models to end underutilization and make AI workloads effortless. Hiring cracked MLsys and networking engineers. (😉Collab w/ @lmcache & @n0computer soon, stay tuned.)

LLM inference is too slow, too expensive, and too hard to scale. 🚨 Introducing llm-d, a Kubernetes-native distributed inference framework, to change that—using vLLM (@vllm_project), smart scheduling, and disaggregated compute. Here’s how it works—and how you can use it today: