BigScience Workshop
Research workshop on large language models - The Summer of Language Models 21
Popular repositories Loading
-
promptsource
promptsource PublicToolkit for creating, sharing and using natural language prompts.
-
Megatron-DeepSpeed
Megatron-DeepSpeed PublicOngoing research training transformer language models at scale, including: BERT & GPT-2
-
bigscience
bigscience PublicCentral place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
-
biomedical
biomedical PublicTools for curating biomedical training data for large-scale language modeling
Repositories
Showing 10 of 36 repositories
-
-
-
- bigscience Public
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
- Megatron-DeepSpeed Public
Ongoing research training transformer language models at scale, including: BERT & GPT-2
-
-
- massive-probing-framework Public Forked from AIRI-Institute/Probing_framework
Framework for BLOOM probing
