We released a 203M-parameter Portuguese language model — real local CPU demo and public weights

Hi r/artificial,

We recently released WARMIND-200M V2, an experimental Portuguese-first causal language model developed by WAR Enterprise in Brazil.

The attached video shows the model running locally on CPU. The waiting periods were shortened, but the prompts and outputs were not altered. We intentionally kept imperfect responses visible because this is a research checkpoint, not a production assistant.

Main specifications:

- 203,263,872 parameters

- approximately 1 billion pretraining tokens

- 23.7 million supervised SFT tokens

- 20 Transformer layers

- Grouped-Query Attention

- SwiGLU, RMSNorm and RoPE

- 1,024-token operational context

- local CPU inference

- Apache 2.0 license

The primary goal of this version was to validate the complete pipeline: dataset preparation, tokenizer training, pretraining, supervised fine-tuning, packaging and local inference.

Because the training-token budget was relatively small for a 203M-parameter model, it can still hallucinate, repeat information, make factual mistakes and produce incomplete answers.

The weights and full documentation are publicly available:

https://huggingface.co/warenterprise/WARMIND-200M-V2

We are now studying the next generation, potentially around 500M parameters, with a substantially larger training corpus and integration with external tools. The final architecture and release schedule have not yet been defined.

What would you prioritize for the next version: better data quality, more training tokens, a larger architecture or stronger tool integration?