Local or nothing syllabus

Reading a model card for what it doesn't say

A model card is a starting point, not a deployment specification. You still need the exact licence, supported runtime format, context requirement, and memory budget on the machine that will run it.

Filter before downloading

Write four constraints before browsing models: commercial-use licence, required input modality, minimum useful context, and memory available after the operating system and your application. A candidate that fails one constraint is not a candidate.

Build a three-model shortlist

For three candidates, record parameter count, exact licence identifier, supported quantised formats, context limit, and download size. Link the original model card and licence.

What does download size tell you?

A model file is 8 GB. Can you conclude it fits comfortably in 8 GB of available memory?

Record the largest viable model

Load candidates at your required context, leaving enough headroom for the real application. Record the parameter count of the largest one that remains stable.