Files created by org-jounral are not synced

[DominikMendel]

The problem I am facing is that after I create a new org-roam dailies file, my org-roam-db does not sync as it should. I have to manually sync it.
I might have a unique setup where I am using both org-journal (dailies) and org-roam dailies on the same path. Org-journal is used mostly for all the functions that package provides. However it does change the major mode to Journal which I am unsure if it messing up anything else.

First of all I am unsure if I set up my Vulpea correctly with Doom Emacs. This might be a clear answer for someone who has experience with Doom Emacs. I added the following to my config.el.

(use-package! vulpea
  :ensure t
  ;; hook into org-roam-db-autosync-mode you wish to enable
  ;; persistence of meta values (see respective section in README to
  ;; find out what meta means)
  :hook ((org-roam-db-autosync-mode . vulpea-db-autosync-enable)))

In packages.el I am using (package! vulpea).
I am unsure if this is the correct approach for Doom. All of the functions appear to work fine though.

My db-sync values:
org-roam-db-autosync-mode = t and org-roam-db-autosync-mode-hook = (vulpea-db-autosync-enable).

For what it's worth, I am following https://d12frosted.io/posts/2021-01-16-task-management-with-roam-vol5.html and have implemented those functions and hooks/advices. Everything there works fine. Except files are not added to my org-agenda-files until my org-roam db-sync occurs.

Any input would be much appreciated.

[d12frosted]

Just to summarise. The issue is that org-journal doesn't assign ID on the file level when new org-journal file is created. For org-roam (and transitively vulpea) to catch this file, it has to contain an ID. So you have to:

1. Assign an ID via any relevant method (either by setting up org-journal-file-header, or using various hooks like before-save-hook or org-journal-after-header-create-hook etc.).
2. Save the file.

This will make org-roam to pick up this file unless it's located outside org-roam-directory.

---

@DominikMendel I am not using org-journal and don't have your configuration files to tell anything useful, but from quick glancing on org-journal sources I'd say it should work:

https://github.com/bastibe/org-journal/blob/f121450610650c63aabf13afd0d2089e05fad2e4/org-journal.el#L414-L420

As you can see, org-journal mode is derived from org-mode hence all hooks should work in org-journal as well, unless org-roam is checking for org-mode exclusively somewhere in its routine.

Also, I am not using Doom Emacs, so can't validate your configuration. But I'd simply check org-roam-db-autosync-mode-hook value to see if it contains the necessary function. And it seems that you checked it and the value is right :)

All of the functions appear to work fine though.

Could be a good indicator that everything is fine :)

The problem I am facing is that after I create a new org-roam dailies file, my org-roam-db does not sync as it should. I have to manually sync it.

Just by chance, do you save this file? Org roam syncs files on save.

Another hard guess/question. Do you face the problem in org-journal-mode files only?

[DominikMendel]

In my experience, after I add the ID to the org-journal file then save it, it doesn't update the DB. I am not sure why. That is why I am doing these odd work around. Maybe it is because I am adding the ID AFTER the file is created?

This is my org-journal-file-header I use. It is a little complicated but it manually creates the PROPERTIES drawer.
org-journal-file-header ":PROPERTIES: :ROAM_ALIASES: \"Work %A, %B %d %Y\" :END: :CLOCKTABLE:\n#+BEGIN: clocktable :scope work-roam :block %Y-%m-%d :maxlevel 9 :fileskip0 t\n#+END:\n:END:\n#+TITLE: Work %Y-%m-%d"
I don't know how to run org-id-get-create from this. Hence why I was adding my org-create-new-id-journal() function to the org-journal-after-header-create-hook as shown above. Is there a way I can programmatically call org-id-get-create from within that org-journal-file-header?

Questions:

1. In my describe functions list I don't see a org-roam-db-update-file option. Is this a hidden function? If it is, can I still call it. (Sorry still learning elisp)
2. You are right, I probably don't need it. I just did it there as a precaution. I will try some further testing I think.
3. This is also a good suggestion. I'll try incorporating that.
4. Even though it is just adding to the after-save-hook I was thinking maybe there is some strange case where this is preventing the org-roam-db-sync form occurring. I thought maybe I could add to THEIR hook and try to circumvent this odd problem.

Question directly about your vulpea-id-auto-assign. From look at that code, am I correct in thinking that adds and ID to all files and all header levels in org-mode files?

[DominikMendel]

Minor update.
I have confirmed that I HAVE to save the buffer in the hook, or the DB won't get updated. Even after saving the buffer afterwards, no the database won't sync.
(add-hook 'org-journal-after-header-create-hook 'org-create-new-id-journal)

This does NOT work: (defun org-create-new-id-journal () (goto-char (point-min)) (org-id-get-create) (org-roam-db-sync) (goto-char (point-max)))

This does work: (defun org-create-new-id-journal () (goto-char (point-min)) (org-id-get-create) (save-buffer) (org-roam-db-sync) (goto-char (point-max)))

Also, in response to your question 3 @d12frosted . I actually have to use the (goto-char (point-max)) because org-journal needs to be at the last entry to properly work, for some reason. This was my attempt that didn't work (defun org-create-new-id-journal () (save-excursion) (widen) (goto-char (point-min)) (org-id-get-create) (org-roam-db-sync))

[DominikMendel]

I did find the org-raom-db-update-file function. That does work slightly better than the org-roam-db-sync.

My current solution that works fine for this discussion:
(add-hook 'org-journal-after-header-create-hook 'org-create-new-id-journal) (defun org-create-new-id-journal () (goto-char (point-min)) (org-id-get-create) (save-buffer) (org-roam-db-update-file) (goto-char (point-max)))

[d12frosted]

Of course, you need to save the file. Because org-roam-db-sync is run on save 😸 Just as it was also discussed here.

This is my org-journal-file-header I use.

You need to assign an ID somehow. Of course you can use org-journal-after-header-create-hook, but you also can do it in org-journal-file-header :)

So in order for org-roam to sync your files you need to:

1. Add an ID.
2. Save the buffer.

[d12frosted]

1. org-roam-db-update-file is defined here. You should be able to find it using C-h f org-roam-db-update-file. Based on the name (e.g. no double -) it is considered public.
2. Great 😸
3. Great 😸
4. I'd take the simples approach before doing something complex 😸 It should work.

Question directly about your vulpea-id-auto-assign. From look at that code, am I correct in thinking that adds and ID to all files and all header levels in org-mode files?

As documentation on that file states, targets are controlled by value of vulpea-id-auto-targets. Which is files and headlines by default, but you can turn it into files only 😸

Regarding org-create-new-id-journal:

(defun org-create-new-id-journal ()
  (org-with-point-at 0
    (org-id-get-create)
    (save-buffer)))

1. Use org-with-point-at macro.
2. You don't need to call both save-buffer and org-roam-db-update-file as the former triggers the latter.

[DominikMendel]

I'm going to close this discussion I think and open up a different one. I have further narrowed my issue and it doesn't pertain to this topic. Everything in this topic was relevant though, and adding to those hooks worked well.

[DominikMendel]

Follow up discussion: #133