Reporting API not returning information

[shenke-adsk]

I call APIs such as

[GET] /api/orgs
[GET] /api/repos/{org}/{repo}/-/jobs
[GET] /api/repos/{org}/{repo}/-/jobs/<latest|{jobId}>
[GET] /api/job/logs/{jobId}

All I get is

{"message":"Content was not found in database"}

But I do see data from /api/status with things like organization count, repo count, current job being processed, etc.

I have these env variables set:

MEND_RNV_ADMIN_API_ENABLED=true
MEND_RNV_REPORTING_ENABLED=true
MEND_RNV_SQLITE_FILE_PATH=/renovate/db/renovate-ce.sqlite

The /renovate/db/renovate-ce.sqlite file exists and I can query it using sqlite3 CLI. What am I missing?

[justo-mend]

I just ran the latest Renovate CE with v8.3.1 and was able to fetch results from all the APIs.
Not sure what might be wrong with your config. Are you on the latest (v8.3.1)?

[justo-mend]

My config is as follows:

MEND_RNV_ADMIN_API_ENABLED: true
MEND_RNV_SERVER_API_SECRET: ####
MEND_RNV_REPORTING_ENABLED: true
MEND_RNV_LOG_HISTORY_DIR: /logs
MEND_RNV_LOG_HISTORY_S3: s3://job-logs
MEND_RNV_SQLITE_FILE_PATH: /db/renovate-ce.sqlite

Note: I'm storing job logs in MinIO S3 storage

[shenke-adsk]

Okay, I upgraded to 8.3.0 and the jobs API starts to work. But the individual job log API does not, because the log file does not exist.

ubuntu@019afa89713a:/usr/src/app$ curl --header "Authorization: $MEND_RNV_SERVER_API_SECRET" http://localhost:8080/api/repos/security/dolus/-/jobs/latest | jq .
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   175  100   175    0     0   8333      0 --:--:-- --:--:-- --:--:--  8333
{
  "reason": "Internal Server Error",
  "message": "ENOENT: no such file or directory, open '/renovate/logs/security/dolus/20241004_221101_3c60030b-afc6-4d8b-8dae-33fa7f8796a5.log'"
}
ubuntu@019afa89713a:/usr/src/app$ curl --header "Authorization: $MEND_RNV_SERVER_API_SECRET" http://localhost:8080/api/repos/security/dolus/-/jobs | jq .
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   601  100   601    0     0  42928      0 --:--:-- --:--:-- --:--:-- 42928
[
  {
    "jobId": "3c60030b-afc6-4d8b-8dae-33fa7f8796a5",
    "reason": "scheduledAll",
    "addedAt": "2024-10-04 22:00:00",
    "startedAt": "2024-10-04 22:11:00",
    "completedAt": "2024-10-04 22:12:15",
    "logLocation": "/renovate/logs/security/dolus/20241004_221101_3c60030b-afc6-4d8b-8dae-33fa7f8796a5.log",
    "status": "success"
  },
  {
    "jobId": "73406345-b895-4d2e-b0e4-d0fc4c08738e",
    "reason": "repositories-added",
    "addedAt": "2024-10-04 20:14:57",
    "startedAt": "2024-10-04 20:39:38",
    "completedAt": "2024-10-04 20:44:54",
    "logLocation": "/renovate/logs/security/dolus/20241004_203938_73406345-b895-4d2e-b0e4-d0fc4c08738e.log",
    "status": "success"
  }
]

My set up is

buntu@019afa89713a:/usr/src/app$ env | grep LOG
MEND_RNV_LOG_HISTORY_CLEANUP_CRON=0 0 * * *
LOG_LEVEL=debug
MEND_RNV_LOG_HISTORY_DIR=/renovate/logs
RENOVATE_LOG_FILE=/renovate/renovate_runtime.log
MEND_RNV_LOG_HISTORY_TTL_DAYS=30
ubuntu@019afa89713a:/usr/src/app$ ll /renovate/logs/
total 0
drwxrwxrwx 2 root root  6 Oct  1 19:04 ./
drwxrwxrwx 4 root root 56 Oct  4 20:14 ../

I could try using S3 to store the logs, but should not the local log history dir also work?

[justo-mend]

Let's cover the obvious stuff first:

• Are you replacing {org} and {repo} with relevant org and repo names?

My examples were:

• http://localhost/api/repos/justo-mend/demo-repo-18/-/jobs
• http://localhost/api/repos/justo-mend/demo-repo-18/-/jobs/latest
• http://localhost/api/job/logs/49173039-b97c-49d7-83db-2ff1e5ebab8f

[justo-mend]

If you are getting the message "Content was not found in database", it might be because the DB was cleared on data. If you run a job after starting the server, then it should update the DB.

[shenke-adsk]

That is what I get confused about. We are currently using CE 7.2.0. When I updated it to the latest 8.3.1, I get the following error at startup:

renovate-1  | DEBUG: GET https://git.mycompany.com/api/v3/users/renovate-test[bot] = (code=ERR_NON_2XX_3XX_RESPONSE, statusCode=401 retryCount=0, duration=126)
renovate-1  | ERROR: Failed to fetch bot user
renovate-1  | FATAL: Failure initializing Renovate community edition - exiting...
renovate-1  |        "err": {
renovate-1  |          "message": "external HTTP error occurred while initializing the platform",
renovate-1  |          "stack": "Error: external HTTP error occurred while initializing the platform\n    at /usr/src/app/src/community.js:5:55045\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async Object.mustInitialize (/usr/src/app/src/community.js:5:53822)\n    at async Object.mustInitialize (/usr/src/app/src/community.js:5:57842)\n    at async t.getPlatform (/usr/src/app/src/community.js:5:76828)\n    at async /usr/src/app/src/community.js:5:117822\n    at async /usr/src/app/src/community.js:5:117137\n    at async /usr/src/app/src/community.js:5:116773"
renovate-1  |        }
renovate-1  | FATAL: Process will exit after 2 minutes
Gracefully stopping... (press Ctrl+C again to force)

Was there any breaking change from version 7.X to 8.X? Is it documented somewhere?

[rarkins]

Yes read 8.0.0 release notes