Alpha
Contact
Assess · MORENA 1.5B

Can you own it?

Ownership levelPartialnone·limited·partial·substantial·fullAnalytical input D ยท 46.8/100

This page is a projection of the one entry record, the Use & modify and Transparency factors that Assess covers. The full verdict is set by all four factors together, floor-weighted so the weakest caps the whole.

Which domain expands which factor
  • AssessUse & modify + Transparency
  • ImplementData control + Reliability
  • UseReliability
  • SupportTransparency

Intended & out-of-scope use

Adopt MORENA as a fine-tuning starting point for twelve African languages, not as a finished assistant. The publisher says the same: the base card calls it "the recommended starting point for fine-tuning, continued pretraining and domain adaptation", and the paper states that the instruct model "is not an assistant" (ev-card-base, ev-paper). The instruct model is suited to experiments with translation into African languages, short chat in the reserved-token format, and tool-call formatting. It is out of scope for retrieval-augmented question answering, grounded summarisation, or any use where a refusal on an ordinary request is costly, and for anything safety-critical. The base checkpoint is not a chat model and has no safety evaluation.

Known limitations, bias & failure modes

All of these come from the publisher's own card and paper (ev-card-instruct, ev-paper).

Over-refusal: 41% of ordinary benign requests are not answered well, mostly by refusing. Benign answering is 58.9%, up from 47.9% in the previous version.

Comprehension is near chance. Retrieval QA accuracy is 0.325 against a 0.25 floor, Belebele is 0.309 over ten African languages, and MMLU is 0.284. African multiple choice is at chance, as it is for every model under 12B that the paper measured.

Grounding is unreliable. Fully faithful grounded paragraphs fell from 31% to 23% (22 of 96).

Output can degenerate. 1.3% of the safety set is degenerate, and about one generation in six does not emit an end-of-sequence token within 200 tokens.

Language support is uneven. isiNdebele is evaluated on speech transcripts only. Safety is weakest in Igbo (75%), Yoruba (82%), Setswana (83%) and isiXhosa (87%). Table 2 of the paper shows no machine-translated pool for Yoruba, isiNdebele or Nigerian Pidgin, and Yoruba is also the weakest language for translation into it (chrF++ 26.9).

Translation into English trails MADLAD-400-3B (48.7 against 53.6). In 59 of 1,000 into-English prompts the model echoed the instruction instead of translating.

One model, gemma-3-12b-it, wrote the safety prompts, wrote much of the training data and judged the answers. No native speaker has rated an answer.

Openness tier & components

MORENA earns open_weights (ceiling 3 on the openness dimension). Weights, tokenizer and documentation are open; the other components are partial.

ComponentGradeEvidence
WeightsopenBase and instruct safetensors, ungated (ev-hf-platform)
Training datapartialThe paper and card metadata name sources and per-source shares. The corpus is "not released", and the paper promises corpus and datasheet "once the legal review is complete". Only the Fikira SFT component (50,000 rows, MIT) is public. vamboai/morena-sft-corpus is listed but returns HTTP 401 (ev-paper, ev-fikira)
Training codepartialmodeling_morena.py is a full production trainer (FSDP2, Muon, mixture sampler, checkpointing). The configs, TRAIN_README.md and data pipeline are missing, and the card does not mention the trainer (ev-trainer)
EvaluationpartialThe paper gives results, methods and a defect log, but no harness code (ev-paper)
DocumentationopenDetailed cards and a 23-page paper with limitations (ev-card-instruct, ev-paper)
LicenceopenApache-2.0 declared (ev-licence)

The trainer file ships in the repo, so the tier turns on the missing configs and data, not on missing code. It stays below open_weights_recipe because the framework asks for runnable training code and released evaluation code, and neither is present.

Licence terms & permitted use

The declared licence is Apache-2.0 for base, instruct, GGUF, mini, mini-instruct and nano (ev-licence, ev-siblings). The card adds: "Commercial use is permitted, including fine-tuning and redistributing derivatives, under the terms of the licence." The repos are not gated. Three caveats apply.

First, no LICENSE, NOTICE or copyright-holder file exists in any repo (raw LICENSE returns 404). The licence rests on Hugging Face metadata and one card paragraph. Apache-2.0 section 4 expects recipients to receive a copy of the licence, so a redistributor must add the text (ev-apache-text).

Second, a commit on 2026-09-17 removed the licence wording and one on 2026-09-18 restored it as "Licence: Apache 2.0, commercial use permitted". The final state is consistent across all repos.

Third, the upstream terms are unresolved. The paper says the SFT corpus is "mostly synthetic" and was generated by "Gemma-family and GPT-OSS-120b models". The Gemma Terms of Use define a Model Derivative to include a model trained on synthetic Outputs of Gemma to perform similarly to Gemma, and require the Gemma use restrictions to pass on to recipients (ev-gemma-terms). Vambo does not say which Gemma versions it used and does not address the clause. This is an open question and does not show that the Apache-2.0 declaration is invalid. The base model's pretraining mixture also includes machine-translated text from an unnamed system and 1.1B tokens of synthetic passages from an unnamed generator, whose terms are unknown. The gpt-oss-120b terms are not covered.

Supply-chain & provenance

The canonical source is huggingface.co/vamboai, which Hugging Face reports as not verified, with one member (ev-hf-platform). Weights are safetensors only, there is no pickle file, a publisher-written SHA256SUMS exists and its model.safetensors value equals the host's LFS hash, and Hugging Face's scan flagged no files (ev-checksums). That is about 4 of 8 checklist boxes. The gaps are an unverified organisation, no signature, no build attestation and a custom loader. The score is 2 because the verified-organisation test for anchor 3 is not met.

"Trained from scratch" is a publisher claim, unverified by OneHill. It appears in the instruct card ("a 1.5B-parameter decoder trained from scratch"), the base card, the paper's title block and abstract ("trained from scratch, with its own tokenizer and data mixture") and the Vambo research page (ev-card-instruct, ev-paper). No document names a base model or initialisation checkpoint. config.json and the trainer carry a plain random-initialisation setting (init_std 0.02), and the paper reports 60,000 pretraining steps on 251.7B tokens.

The claim covers the 1.5B weights only. The 0.5B and 0.2B models are pruned and distilled from the 1.5B base, and the post-training data is synthetic output of other models. "From scratch" means weight initialisation, not independence from other models' outputs.

Loading the weights means running modeling_morena.py from the repo. It is a 52 KB trainer file. An outline read found no subprocess, socket or HTTP use, but the file is not audited line by line. load_example.py still describes the weights as "preview weights", although the card's pre-release wording was removed on 2026-09-18.

EU AI Act posture

MORENA is a general-purpose AI model. By the paper's own figure (6 x parameters x tokens), training took about 2.8e21 FLOPs, far under the 1e25 systemic-risk threshold, so no Article 55 duties apply (ev-paper).

Whether the Article 53 open-source exemption applies is uncertain. Apache-2.0 would normally qualify and the parameters and architecture are public. But no licence text ships, the monetisation context is not documented, and the Gemma Terms question could attach use restrictions to the instruct model.

The exemption does not cover two duties: a copyright policy (none exists) and a public training-content summary. The paper's Table 2 gives sources and shares, but it is not in the AI Office template and omits the machine-translation system and the synthetic-data generators. No code-of-practice signatory status appears in any document. A fine-tuner who places a derivative on the EU market may become a provider for it. This is guidance, not legal advice.

Benchmarks & evaluation

Every figure below is the publisher's own, from a harness it has not released and that its paper says had five defects (ev-card-instruct, ev-card-base, ev-paper). No independent re-run exists. The press repeats the publisher numbers and says they are unverified (ev-press).

MeasureResultReference points in the paper
African bits per byte, mean of 12 (base)1.408, lowest of 26 modelsLugha-Llama-8B 1.423, gemma-3-12b-it 2.159
Same, instruct1.441Second to Lugha-Llama-8B on the 12-language mean
FLORES+ chrF++, English into 5 languages, 3-shot (instruct)45.8 (45.1 to 46.5)MADLAD-400-3B 37.8, Lugha-Llama-8B 36.8
Same, 5 languages into English48.7 (47.5 to 49.7)MADLAD-400-3B 53.6, Lugha-Llama-8B 52.4
ARC-easy / ARC-challenge (base, English)0.676 / 0.412Qwen2.5-1.5B 0.668 / 0.440
MMLU (base)0.284Qwen2.5-1.5B 0.324
Belebele, ten African languages (instruct)0.309Chance 0.25
Tool calling, marker prefilled98.1% correct, 100% valid JSONUnprompted, the model almost never calls a tool

The paper compares outside models under a plain few-shot prompt without a chat template, which it says may understate instruction-tuned baselines. Translation was scored on five of the twelve languages only (Swahili, Hausa, Yoruba, isiXhosa, isiZulu), 200 sentences per direction.

The press claim that MORENA beats "a Google model eight times its size" names no model. It most likely refers to gemma-3-12b-it (12.19B against 1.485B parameters) on bits per byte, a language-modelling measure and not a task benchmark. That match is OneHill's inference, not a statement by the publisher or the press.

Score summary

Rubric 1.1, computed by scripts/score.py from the dimension scores in entry.yaml: openness 3, provenance 2, legal 3, safety 2, performance 2, operational 2, governance 2. The reasons are in each dimension rationale in entry.yaml.

Ownership verdict

Level: partial. Use and modify is strong and data control is strong, transparency is moderate, and reliability is weak because operational readiness and safety are both rated 2. The ownership block in entry.yaml holds the verdict text and the conditions that would raise it.

Contradictions and surprises

Press coverage calls the model "open-source" (Daba Finance) and says licence, data and compute were not public (Tech In Africa). The cards and paper show an Apache-2.0 declaration and named data and compute, so the second claim is wrong. The corpus and most training code are not released, so "open-weight" is the accurate term.

The card describes modeling_morena.py as a "reference implementation", while the file calls itself the "production trainer".

Page 15 of the paper says the machine-translated pool does not exist for isiNdebele and Nigerian Pidgin. Table 2 shows nine machine-translated pools and none for Yoruba.

The Hugging Face organisation is not verified and the company site states no country, so South Africa rests on three press reports.

How this scores

The ownership factors this domain covers, drawn from the one entry record.

1

Use and modify freelyCan you run, modify and adapt it with no gate and no field-of-use trap?

Strong

Apache-2.0 is declared on the cards for base and instruct, ungated, with weights downloadable and the base recommended for fine-tuning; caveat: no LICENSE file ships and the Gemma Terms question on synthetic SFT data is open (ev-licence, ev-gemma-terms).

How this scores (AOI sub-dimensions)
Openness3/5how much is released - weights, data, code, licence - and how freelyOpen weights, a detailed paper and cards, and an Apache-2.0 declaration put it at the open-weights anchor.
Legal3/5how permissive and clean the licence is for real commercial useThe declared licence is Apache-2.0 with commercial use stated and no gating, which is clear for common uses, and the paper documents mixture, compute and sources.
2

TransparencyDo you know what it is: weights, training, behaviour, and legible terms?

Moderate

Open weights with a detailed paper, but the corpus, SFT corpus, configs and evaluation harness are not released, and the machine-translation and synthetic-data generators are unnamed (ev-paper, ev-trainer).

How this scores (AOI sub-dimensions)
Provenance2/5how well we can trace and verify what went into the modelSafetensors only, a published SHA256SUMS that matches the host's LFS hash for the weights, and a clean Hugging Face malware scan give about 4 of 8 checklist boxes.
Governance2/5how accountable and well-documented the publisher isA named company (Vambo Technologies (Pty) Ltd) with named founders, a prior public dataset (Fikira, December 2025) and a post-release fix (tokenizer_config.json, 2026-10-14).
What this means for adoptionYou own the use of the weights: Apache-2.0 is declared, ungated and commercial use is stated, and your data stays on your hardware. You do not own a finished assistant. The paper says the instruct model is not one, it cannot be rebuilt without the unreleased corpus and configs, and the evaluations are the publisher's own. The level rises if Vambo ships a LICENSE file, releases its corpus and harness, and clears the Gemma Terms question on the SFT data.

Sources

The same evidence records as the entry sheet. Read means the text was verified; unverified means it is known to exist but not yet read.

Model cardread2026-11-19
The instruct card declares Apache-2.0, names twelve languages, and gives 1.485B parameters and a 4,096-token context.
Model cardread2026-11-19
The base card describes a base checkpoint beside the instruct one (vamboai/morena-1.5b-base) with the same Apache-2.0 declaration.
Licenceread2026-11-19
Every MORENA repo declares Apache-2.0 in the front matter and the card 'Licence' section ('Commercial use is permitted, including fine-tuning and redistributing derivatives').
Licenceread2026-11-19
Canonical Apache License 2.0 text, the licence the MORENA declaration points to: section 2 grants copyright, section 3 grants patent rights, and section 4 governs redistribution and requires passing on a copy of the licence.
Technical_reportread2026-11-19
Paper 'MORENA: An African Foundation Model' (23 pages, 18 September 2026, single author).
Documentationread2026-11-19
modeling_morena.py (52,103 bytes, identical in base and instruct) calls itself the 'Morena production trainer' (FSDP2, Muon, mixture sampler, checkpointing) and also defines the model.
Documentationread2026-11-19
SHA256SUMS in the repo lists five files.
Documentationread2026-11-19
Hugging Face platform metadata.
Model cardread2026-11-19
Sibling cards: morena-0.5b-mini and morena-0.2b-nano (pruned and distilled from the 1.5B base, not safety-tested, Apache-2.0) and morena-1.5b-instruct-gguf (Q4_K_M 0.92 GB, Q8_0 1.58 GB, f16 2.97 GB, 'verified for logit equivalence').
Documentationread2026-11-19
vamboai/fikira is a public, ungated MIT dataset of 50,000 synthetic reasoning examples in ten languages, copyright 'Vambo Technologies (trading as Vambo AI)', one named SFT component; vamboai/morena-sft-corpus, listed in the card metadata, returns HTTP 401 and is not public.
Vendor announcementread2026-11-19
The vambo.ai footer names Vambo Technologies (Pty) Ltd, and the site names co-founders.
Third-party analysisread2026-11-19
Three press articles (Tech In Africa 13 Oct 2026, CIO Africa 16 Oct 2026, Daba Finance 7 Oct 2026) describe a South African start-up releasing an open-weight model and say the results are the developer's own and unverified.
Terms of serviceread2026-11-19
Gemma Terms of Use (last modified April 1, 2026).