codezero an hour ago

Are there any agentic models like this that would work for controlling input in arbitrary video games? I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious.

maartenh 30 minutes ago

How much VRAM would this require, if I would want to run this locally?

I bought a 12GB Nvidia card a year ago. In general I'm having a hard time to find the actual required hardware specs for any self hosted AI model. Any tips/suggestions/recommended resources for that?

  • nsingh2 26 minutes ago

    One quick way to estimate a lower bound is to take the number of parameters and multiply it with the bits per parameter. So a model with 7 billion parameters running with float8 types would be ~7 GB to load at a minimum. The attention mechanism would require more on top of that, and depends on the size of the context window.

    You'll also need to load inputs (images in this case) onto the GPU memory, and that depends on the image resolution and batch size.

stan_kirdey 41 minutes ago

* fine tuned Qwen-7B

  • donbox 23 minutes ago

    So.. the tables are really turning?