Model · bloomz-7b1
bloomz-7b1
Developer: BigScience
Availability: available · checked 2026-09-24 · source
Raw record: /data/models/bloomz-7b1.json
Fields
- id
- bloomz-7b1
- identifiers
- huggingface
- bigscience/bloomz-7b1
- developer
- BigScience
- release_date
- 2022-09-27partial · sourcenote: HF repo creation date; may predate or postdate public release.
- weights_status
- open
- availability
- available · checked 2026-09-24 · source
- license
- bigscience-bloom-rail-1.0partial · sourcenote: From HF card metadata (uploader-declared); confirm against the license text.
- architecture
- family
- decoder_only
- note
- family read from config 'architectures': ['BloomForCausalLM'].
- n_layers
- 30recorded · source
- hidden_size
- nullnot_recorded
- n_heads
- 32recorded · source
- vocab_size
- 250880recorded · source
- context_length
- 2048recorded · source
- positional_encoding
- ALiBi (attention bias by distance; no position embeddings)recorded · sourcenote: Card: 'Architecture: Same as bloom-7b1'.
- training_data
- xP3: a crosslingual task/instruction mixture across 46 languages, built by BigScience for multitask fine-tuning. 4.19B fine-tuning tokens over 1000 steps.recorded · source
- techniques
- primary_sources
- record_history
- date:2026-09-24 · change:ingested as candidate from HF (bigscience/bloomz-7b1@fa72440b228d7f42a42ec3681cf09735ad14822f) · by:ingest_hf.py ·date:2026-09-24 · change:preparer: developer, positional encoding, fine_tuned_from bloom-7b1 added, training_data filled · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:preparer cleanup: removed 2 stale flag(s) · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:reviewed and promoted from staging (1 edge(s) accepted) · by:Wilson Pruitt ·
Parents
Weights descend
- fine_tuned_from → BLOOM 7B1 declared source Card: 'Architecture: Same as bloom-7b1'; fine-tuned 1000 steps / 4.19B tokens on xP3 (crosslingual task mixture, 46 languages).
Children
No edges recorded.
Read in
No station on the reading path has touched this record yet.