Support for Jinja in .toml files

[jiaweikho]

Tell us more.

I've got a copier template with a pyproject.toml.jinja file that is used to generate a pyproject.toml file using the Jinja template file format. Can we support jinja templates of toml files? I have managed to extend fileMatch for poetry to discover the pyproject.toml.jinja file with:

{
  "poetry": {
    "fileMatch": ["(^|/)pyproject\\.toml\\.jinja$"]
  }
}

During the renovate workflow, I get the following log message:

DEBUG: Poetry: error parsing pyproject.toml (repository=****, packageFile=pyproject.toml.jinja, branch=***)
    "err": {
        "message": "Schema error",
        "stack": "ZodError: Schema error\n    at Object.get error [as error] (/usr/local/renovate/node_modules/.pnpm/[email protected]/node_modules/zod/lib/types.js:55:31)\n    at fromZodResult (/usr/local/renovate/lib/util/result.ts:55:67)\n    at Function.parse (/usr/local/renovate/lib/util/result.ts:565:12)\n    at Object.extractPackageFile (/usr/local/renovate/lib/modules/manager/poetry/extract.ts:19:36)\n    at extractPackageFile (/usr/local/renovate/lib/modules/manager/index.ts:75:9)\n    at checkBranchDepsMatchBaseDeps (/usr/local/renovate/lib/workers/repository/update/branch/auto-replace.ts:143:41)\n    at checkExistingBranch (/usr/local/renovate/lib/workers/repository/update/branch/auto-replace.ts:165:15)\n    at doAutoReplace (/usr/local/renovate/lib/workers/repository/update/branch/auto-replace.ts:208:18)\n    at getUpdatedPackageFiles (/usr/local/renovate/lib/workers/repository/update/branch/get-updated.ts:237:38)\n    at processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at processBranch (/usr/local/renovate/lib/workers/repository/update/branch/index.ts:479:19)\n    at writeUpdates (/usr/local/renovate/lib/workers/repository/process/write.ts:166:17)\n    at update (/usr/local/renovate/lib/workers/repository/process/extract-update.ts:213:11)\n    at Object.renovateRepository (/usr/local/renovate/lib/workers/repository/index.ts:89:19)\n    at attributes.repository (/usr/local/renovate/lib/workers/global/index.ts:206:11)\n    at start (/usr/local/renovate/lib/workers/global/index.ts:191:7)\n    at /usr/local/renovate/lib/renovate.ts:19:22",
        "issues": "Invalid TOML"
    }

I believe the issue is that the jinja delimiters {% %} causes errors when parsing the toml file. The dependency block looks something like:

[tool.poetry.group.dev.dependencies]
ruff = "^0.7.3"
mypy = "^1.13.0"
{% if testing -%}
pytest = "^8.3.3"
{%- endif %}

I think this is similar to #18470 where the solution was implemented in #26682 to remove jinja blocks in .yaml files that match the regex. Is it possible to implement something similar for toml files?

[rarkins]

Here is the related code for YAML:

renovate/lib/util/yaml.ts

Lines 143 to 154 in 0552d98

	function massageContent(content: string, options?: YamlOptions): string {
	if (options?.removeTemplates) {
	return content
	.replace(regEx(/\s+{{.+?}}:.+/gs), '')
	.replace(regEx(/{{`.+?`}}/gs), '')
	.replace(regEx(/{{.+?}}/gs), '')
	.replace(regEx(/{%`.+?`%}/gs), '')
	.replace(regEx(/{%.+?%}/g), '');
	}
	return content;
	}

You're welcome to submit a PR implementing similar for toml parsing.

[jiaweikho]

I have raised PR #33123 to address this feature request.