Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

files missing in scene tab - loosing 10% of disk space #1778

Open
speca334 opened this issue Jul 9, 2024 · 3 comments
Open

files missing in scene tab - loosing 10% of disk space #1778

speca334 opened this issue Jul 9, 2024 · 3 comments

Comments

@speca334
Copy link

speca334 commented Jul 9, 2024

Problem : you have 1000 files in directory , all downloads from various VR Sites , but only 900 are shown in scenes. There are no double files or hidden ones, no unmatched etc. The option storage scan says 1000/0, scene available/download shows less for ex 900.

How do i find the missing ones because 100*20GB is a lot of space for "non existing" videos.

in my case its nearly 10% of the files , that means for every 10TB Videos you will lose 1TB :(

Edit1:
I think it is not a problem of the files , the problem apperars differently when matching files automatically.
I tested it with different HDD seperatly always between 30 and 900 files . on a hd with 30 files with 5 tries 2 had the full count of files and 3 tries lost mostly 3-5 files in scenes
in my try with 900 files i always lost between 50-100 files.
my test constellation :

  1. full scraped (20000 index) but no storages , add a single storage with 30 files (hdd 150gb) - lost 2-3 files
  2. full scraped (20000 index) but no storages , add a single storage with 250 files (hdd space 4TB) - lost 10-20 files
  3. full scraped (20000 index) but no storages , add multiple storage with 888 files (sum of space ca 16TB,6 disks)-lost 50-100 files
    all tries with rescan index bild and refresh scenes , no change after that

Edit 2
The problem def appears only in automatic matching, if the files are manually matched everything works fine.

@pops64
Copy link
Contributor

pops64 commented Jul 12, 2024

In the files. Have you looked to see if the missing files are matched to a scene? If they are matched to a scene search for that respective scene. If you can't find the respective scene, XBVR as a known issue with the search index making scenes disappear. Rebuild the search index to see if you can find the file.

If they are still matched to a scene and rebuilding the search index didn't fix it. Unmatch and then rematch it because it might be releated to #1758

I have over 150TB of files and I am not missing any. Occasionally I manually mismatch them and occasionally the auto match gets it wrong. In my early days of downloading before using something like IDM i would also have corrupted files which caused issues.

@speca334
Copy link
Author

yes you are right, thanks for the info. i unmatched them and rematched them manually.
how did you find the missing scenes/files ? there are thousands of files ... all files have data like resolution or so and there are no differences you can see , they have a filesize and every info for a good file. i am using IDM by the way.

@pops64
Copy link
Contributor

pops64 commented Jul 15, 2024

The other thing it could be is XBVR needs to mark all files are ready to stream. If the Available right now count doesn't match the downloaded count then you have to run the Refresh Scenes found in Options -> Cache -> Scene status. Under the Search Index

If you still suspect that the files are match to scenes that no longer exist and their are a lot I would just delete your whole scene DB and start again. There isn't a good way to sort this out

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants