[Problem] How to reset all the data to make Shinobu work again？

[hucurve]

I have been using lanraragi for almost a year now. I really love and appreciate the fact that someone can make software that is so highly customizable and as interactive and friendly as possible.

However, there are still some major bugs that make me very sad. The garbled file names are visually distracting at best, and the occasional missing file is truly maddening.

I found that every time I tried to use the cleanup database option, I thought it would lighten the load on the system. It actually pops up with 200+ files cleaned (I'm up to about 500 total), the corresponding files disappear upon refresh, and despite all attempts to re-read the files, Shinobu ignores them. They are there, but seem to be isolated forever. I don't have a background of computer-related expertise, I'm using docke desktop to mount the image, so I made the following attempts: (which basically failed)

1. update the software version (0.89 to 0.91, only succeeded once)
2. Delete all files I could find in /databse and /content, backup files and thumbnails, and use the reset database option.
3. remount the image and replace the folder with a new one.
4. try using windows desktop version

None of this has worked, and I think the missing file ids are actually still marked by Shinobu.
I was even hoping to re-modify the ids of the files to make them new, but I can't!

i got 520+ files in total about 14.5G.but only 300+ files readed(about 5G)

Docker shows
[LANraragi] [info] Successful login attempt from 172.17.0.1
[Shinobu] [info] Shinobu File Watcher started.
[Shinobu] [info] Content folder is /home/koyomi/lanraragi/content.
[Shinobu] [info] Scanning content folder for changes...
[Shinobu] [info] Found 304 new files.
[Shinobu] [info] 0 files were found on the filemap but not on the filesystem.

lanraragi is a very handy tool and I understand that this fatal bug is very difficult to deal with.
All I'm hoping for now is to find a way to re-read the missing files (no matter what)
Finally I'd like to thank the author for his hard work!Thank U!

[Difegue]

There's no specific data storage for Shinobu alone, all it "remembers" is the filemap in the database and that's wiped when you click "rescan content folder".

I'm not sure why you'd have 200 files not being picked up unfortunately. File watching support on windows is spotty in that it won't detect newly added files, but doing a rescan/restarting the server normally picks them up.

[xzero0911]

I have same issue and research today.
I rebuild all database and not solved issue even rescan or restart WSL.
But I found if I add small size file that Shinobu can pickup them as well.

For example, DB have 6730 files now
I add 10 new big size(10MB per .jpg) of issue archive to rescan and lost some file others normal archive.
[Shinobu] [info] Shinobu File Watcher started.
[Shinobu] [info] Content folder is /mnt/d/同人.
[Shinobu] [info] Scanning content folder for changes...
[Shinobu] [info] Found 6703 new files.

But if I resize the issue jpg to smaller(3MB per .jpg) and add 10 archive new file. And Shinobu can pickup them as well.
[Shinobu] [info] Shinobu File Watcher started.
[Shinobu] [info] Content folder is /mnt/d/同人.
[Shinobu] [info] Scanning content folder for changes...
[Shinobu] [info] Found 6740 new files.

So, I guess the files too much in one archive or size too big or I/O issue that reach timeout when Shinobu scanning content.
Is it possible add more timeout let Shinobu can finish her job although I/O slow?

[ilevalser]

I ran into a similar problem with version 0.91 of wsl 2 for windows, whenever I put new files into the contents folder and rescan it, Shinobu doesn't recognize them correctly, restarting Lanraragi and rebooting the computer doesn't work.
I used "Run as administrator" on Karen.exe and it successfully recognized the zip that it had previously failed to recognize. But strangely, when all the new files are added to the library, the total number of files in the library is more than the number of files in the contents folder.


I think some files may have been duplicated, but I don't know which ones because there are too many files.

[hucurve]

God, I had this problem again today. I've opened WSL2 on Docker desktop, and 700 files have been unlinked after choosing to clean up the repository, followed by a refreshed, empty repository. Using a backup restore is also completely unchanged. I really hope this problem can be solved as soon as possible. I can only write tag in the file name now, because they will not be lost with the bug😢