Quickstart¶
This walk-through builds a TMX from three editions of one book. It skips the LLM clean-up stage, which is the fast path: a heavily illustrated 470-page book takes about five minutes end to end.
Prerequisites¶
vexy-paraltextandmarkitinstalled (see Installation).- The default embedding model,
jina, downloaded as a GGUF file. The default path is~/.lmstudio/models/jinaai/jina-embeddings-v5-text-nano-text-matching/v5-nano-text-matching-Q8_0.gguf. If yours is elsewhere, set the path inparaltext.toml(see Configuration). - Two or more editions of the same book as PDF, EPUB or DjVu.
Build the TMX¶
-
Create a book folder with one subfolder per language. Use language codes as folder names:
Put exactly one edition in each language folder. If a folder holds several, the tool uses the first in alphabetical order and logs a warning.
-
Create
frutiger/paraltext.tomlthat switches off the LLM stage: -
Run all stages:
The tool converts the three PDFs to
en/Typefaces.md,de/Schriften.mdandfr/Caracteres.md, splits them into sentences, embeds them, aligns German and French against English and writes the TMX. The last line of output names the result: -
Open
frutiger/frutiger.tmxin a CAT tool or a text editor. Each line between<body>and</body>is one translation unit.
Try settings on a slice¶
Alignment settings are easier to tune on the first part of a book. The vectors stay in the cache, so a second call only redoes the alignment.
-
Align the first 2000 sentences of each edition with a stricter threshold, into a separate file:
-
Compare it with the default threshold:
A higher threshold gives fewer, cleaner pairs. On the Frutiger book, raising it from 1.05 to 1.1 roughly halved the number of units.
Process a whole collection¶
batch runs run on every book folder under a root folder:
A book that fails is logged and skipped; the batch continues with the next one.
Next steps¶
- Turn on the LLM clean-up stage for noisier sources: see Configuration.
- Compare embedding models: see Embedding models.