Skip to content

MiguelDomingues/md-localize

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Markdown Localize

This tool was designed to be used in combination with an third-party localization tool that supports .pot/.po (gettext) files. The process encompasses three stages:

  1. Extract Strings
  2. Translate
  3. Rebuild Markdown

The diagram below shows the process when using this tool:

flowchart LR
   
    subgraph Rebuild Markdown
    locale.po-->lmd1[./md-localize ARGS<br />    -action translate<br />    -i markdown1.md<br />    -po locale.po<br />    -o locale/markdown1.pot]
    locale.po-->lmd2[./md-localize ARGS<br />    -action translate<br />    -i markdown2.md<br />    -po locale.po<br />    -o locale/markdown2.pot]
    style lmd1 text-align:left
    style lmd2 text-align:left
    end
    subgraph Translate
    tr[Use third-party<br />translation tool]-->locale.po
    end
    subgraph Extract Strings
    md1[./md-localize ARGS<br />    -action generate-pot<br />    -i markdown1.md<br />    -o strings.pot]-->strings.pot
    md2[./md-localize ARGS<br />    -action generate-pot<br />    -i markdown1.md<br />    -o strings.pot]-->strings.pot
    style md1 text-align:left
    style md2 text-align:left
    end
    strings.pot-->tr
Loading

Extract Strings

This is the first stage and it is where source files are scanned to extract strings to be translated.

The following command line should be used:

./md-localize --action generate-pot --input path/to/markdown.md --output path/to/strings.pot

The output file used here will be needed in the next stage.

If you have multiple source Markdown files, it is you decision to combine them into a single .pot file, or multiple .pot files. You can group sets of source Markdown files into a specific .pot file, and another group of source Markdown files into a different .pot file.

The example below shows the commands to groups source Markdown files into group A and group B. Each group generates its respective .pot file: strings-A.pot and strings-B.pot.

It is important that the commands for each group are ran in sequence, and not in parallel. When the first command of a group is executed, and if the output .pot file does not exist it is created. When the following commands of the same group are executed, the .pot file exists and extracted strings are appended to the file.

./md-localize --action generate-pot --input path/to/markdown-A1.md --output path/to/strings-A.pot
./md-localize --action generate-pot --input path/to/markdown-A2.md --output path/to/strings-A.pot
./md-localize --action generate-pot --input path/to/markdown-A3.md --output path/to/strings-A.pot

./md-localize --action generate-pot --input path/to/markdown-B1.md --output path/to/strings-B.pot
./md-localize --action generate-pot --input path/to/markdown-B2.md --output path/to/strings-B.pot

Translate

The translation stage is where you should use a third-party tool. This thrid-party tool should take as input the .pot file(s) generated in the previous stage, and as result produce a .po file for each locale that you are translating into.

Rebuild Markdown

The final stage is to take the source Markdown files, and the .po files generated by the translation tool in the previous stage, and with those rebuild the translated Markdown.

In this step, the input markdown is scanned, and each string found is replaced by the translation that is defined in the .po file. As a result the markdown.locale.md file is created.

The simplest command is as follows:

./md-localize --action translate --input path/to/markdown.md --po path/to/strings.locale.po --output path/to/markdown.locale.md

The command above should be executed for each source Markdown file. If you used multiple .pot files in the Extract Strings stage, you need to specify the corresponding .po file each time you execute this command.


Command Line arguments

--action , -a

Valid options are: generate-pot and translate

--input , -i

Input file or directory. If a directory is specified, the command is recursively applied to all *.md files inside the directory or sub-directories.

--output , -o

The file to write the output to. If not specified, the output is written to console.

--po-file , -po

The translated .po file. This is only used when the translate option is used.

--po-dir , -pod

The directory to place the .pot files. Using this option will re-create the directory structure existing in the --input and one .pot file for each. This is only used when the generate option is used. When using this option, do not the --po-file option.

--gfm-task-lists

Enable task lists as defined in Task list items (extension).

--gfm-tables

Enable tables as defined in Tables (extension).

--gfm-front-matter

Parse and scan YAML front-matter (if it exists).

--gfm-front-matter-exclude

Specify a key to be ignored, and hence its value is not extracted for translation. If you need to specify multiple keys, repeat this argument.

--ignore-image-alt

By default, image's alternative text is extracted. Use this option to ignore it.

--definition-lists

Enable parsing of definition lists See Definition lists for more info.

--custom-attributes

Enable custom attributes to be parsed. See Generic Attributes for more info.

--ignore-pattern

This allows you to ignore specific patterns from being extracted. For example, if you want to ignore HTML comments inside a Markdown file you can use: --ignore-pattern '<!--.*-->'.

--include-only-pattern

This allows to restrict to patterns matching this regex.

--parse-html

Enable HTML parsing. When enabled, if HTML blocks are found, the are parsed, and text strings are extracted for translation. If disabled, the resulting text string will include the HTML code.

--min-ratio N

Only write translated Markdown file if translation ratio is above. Value is integer from 0 to 100. This argument is only used when --action is set to translate.

If you want to generate the translated Markdown only if all strings are translated you can use --min-ratio 100.

--markdown-translator-comment

Add extra comments to markdown strings only. Strings extracted from front-matter or HTML (when options enabled) do not get the comment added to the .pot entry. Only valid with generate-pot action. If the comment string starts with ., the comment is added as an extracted comment (see PO File format).

--locale , -l

A locale code. Examples: pt-BR, ja-JP

--update-image-relative-paths

Flag to enable updating relative paths to images to point to the original image. Only used when translate action is specified.

--update-links-relative-paths

Flag to enable updating relative paths to other files (not images) to point to the original file. Only used when translate action is specified.

--add-front-matter-source

Add '' to front-matter with the relative path to the source markdown file. Only relevant when the action is set to translate.

--update-front-matter-locale

If a 'locale' key exists in front-matter, update it to the locale being translated.

--add-front-matter-key KEY:VALUE

Add the specified KEY with value VALUE to the front-matter of translated markdown files. Usage of this option may override other options such as --add-front-matter-source and --update-front-matter-locale. If the original markdown does not have any front-matter, then this option won't have any effect.

--file-suffix STRING

Optional suffix to append to the output file names. This affects the files specified in --output, --po-file or --po-dir

--append-pot

Only used whe --action is set to generate-pot. If used, and output file exists, then the .pot file is updated.

--ignore-missing-po

Ignore missing .po file. This should be used with --keep-source-strings.

--keep-literals-together

When multiple literals (e.g. hyperlink, text, emphasis) are part of the same markdown block (i.e. paragraph) keep them as a single string. This results in a string containing markdown.

--keep-html-together TAG

When parsing HTML, if the HTML code contains only the tags specified by this flag, then the HTML is not broken into smaller chunks. This flag can be used multiple times to allow specifying multiple HTML tags. To use this you must also enable HTML parsing with --parse-html.

--unescape-entities ENTITY

Unescape/decode HTML entities. When using --unescape-entities &quot; then the HTML entity &quot; will be replaced by " during the translation process, i.e., when generating the output markdown file.

--trim-translations

Translations retrieved from PO files will be trimmed for whitespace.