Jim Bohnslav
@jbohnslav
computer vision + machine learning. Perception at Zoox. Prev: Cobot, PhD. Arxiv every day.
Hot take: We should stop calling image+text->text models 'MLLMs' because true multimodal models like Gemini Flash 2.0 are a different beast entirely. Here's my deep dive into the naming debate with citations from 15+ recent papers (link in thread)
i used to think AI2D was a small but high quality dataset, but i actually looked today and this is the very first sample
The @huggingface Transformers ↔️ @vllm_project integration just leveled up: Vision-Language Models are now supported out of the box! If the model is integrated into Transformers, you can now run it directly with vLLM. github.com/vllm-project/v… Great work @RTurganbay 👏
Big day for Python tooling enjoyers: @modal_labs finally has first-class uv support! Use: • `uv_sync` to sync your Modal image with your local project • `uv_pip_install` to install packages lightning fast⚡️
would've been more exciting if openai had rolled out full MCP integration instead
if you havent tried the Chrome + iMessage + Apple Notes + Linear + Gmail + GCal DXT integrations in Claude you are missing out the literal LLM OS evolution Smarter Siri is here; it's just called Claude Desktop
We've simplified local MCP usage by creating something new we call Desktop Extensions (.dxt files). These package your local server, handle dependencies, and provide secure configuration so you can one-click share and install local servers on Claude Desktop and other apps.
who @OpenAI do I have to bribe to let Deep Research search over my zotero library?
glad the entire windsurf team gets an exit. very useful for Devin team to get Windsurf's data. Maybe they've realized that people still want to "take the reins", so having an IDE for any AI coding startup makes sense. Win/win!
It’s a privilege to welcome Windsurf to Cognition. Here are more details in the note I sent to our Cognition team this morning: Team, As discussed during our all-hands, we are acquiring Windsurf. We have now signed a definitive agreement and we couldn’t be more excited. Here’s…