tiny_schiller
A drop-in German drama corpus you plug straight into a small language model, right here in your browser or in your own project, in just a few lines of code.
Step 1 Β· Load the corpus
One line reaches the data. No parser, no tokenizer to train, no container stack.
$ Step 1 Β· Load the corpus
What you just loaded
2.07 MB Β· eleven Schiller dramas Β· 89 named personas β all in a single file.
Step 1 Β· Load the corpus
Tokenized three ways
Each token stream ships precomputed, so a small language model reads the corpus directly.
No tokenizer to build, no cleaning to redo; the file is ready to train on.
Step 1 Β· Load the corpus
What that one line replaced
Everything you would normally do before a single token reaches a model:
- βPick an edition (DTA? DraCor? Gutenberg-DE?)
- βWrite a TEI/XML parser and handle the namespaces
- βReconcile three speaker-tag styles
- βFix legacy umlaut and quote-glyph encodings
- βStrip narrow no-break spaces (U+202F)
- βNormalize whitespace and rebuild the corpus
- βCompare tokenizers and precompute the splits
tiny_schiller ships every step above already done. One line, and all the data you need is digested and ready to be used on your machine.
Step 2 Β· Run the model
The model comes online right here in your browser β a char-level net trained on that very file. No server, no API key.
$ A character-level model trained only on Schiller's dramas, running on your CPU alone β it invents, it does not quote.