Dataset · redpajama-data-instruct

RedPajama-Data-Instruct

Builder: Together Computer
Availability: available · checked 2026-09-24 · source

Raw record: /data/datasets/redpajama-data-instruct.json

Fields

id

redpajama-data-instruct

identifiers

huggingface

togethercomputer/RedPajama-Data-Instruct

builder

Together Computer

release_date

2023-06-05partial · source

note:  HF dataset repo creation date, not the builder's own release announcement.

availability

available · checked 2026-09-24 · source

content

Card: 'curated from a diverse collection of NLP tasks from both P3 (BigScience) and Natural Instruction (AI2)', decontaminated against HELM: 'we filtered out 137 tasks and 5.2M instances (out of 1069 tasks and 93.3M instances)'.recorded · source

primary_sources

https://huggingface.co/datasets/togethercomputer/RedPajama-Data-Instruct

record_history

date:2026-09-24 · change:created from primary sources (tranche 2 dataset records) · by:wilson-pruitt + claude ·

Parents

No edges recorded.

Children

Training data

• ← trained_on RedPajama-INCITE-7B-Instruct declared source Card metadata lists togethercomputer/RedPajama-Data-Instruct; the dataset card describes it as P3 plus Natural Instruction, decontaminated against HELM, consistent with the model card's 'GPT-JT data minus HELM overlap'.

Read in

No station on the reading path has touched this record yet.