Skip to content

llm-datasets: Documentation

Framework overview

Initializing search

llm-datasets: Documentation

Home
Getting started
Framework overview Framework overview
Table of contents
- Data schema
- Pipeline
Available datasets
Config files
Extract text data
Adding your own data
Compose training and validation dataset
Integration with other frameworks
Related work
API reference
API reference

Table of contents

Data schema
Pipeline

Framework Overview

Data schema

Schema

Pipeline

Pipeline

Made with Material for MkDocs