Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk image processor won't process more than one img at a time #41

Open
KyleDennis03 opened this issue Mar 25, 2019 · 4 comments
Open

Comments

@KyleDennis03
Copy link

Hello,
when I try to use Disk image processor to process a batch of .img files made from floppy disks, the image processor only processes one at a time and makes one SIP, instead of making multiple individual SIPs. What I have tried so far is to isolate all of the .img files in its own folder (meaning no log files, no other folders, just the .img files in the folder) and selecting this folder as the directory to be processed. Before I process, I do not select any of the options offered at the bottom of the window (bag SIPs, run bulk_extractor, ect.). When I do click Start scan, only the first img. file is processed (first being the first .img file in the list when sorted by file name). Can anyone help me out with this please? Thank you!

@stefanabreitwieser stefanabreitwieser transferred this issue from CCA-Public/digital-archives-manual Apr 2, 2019
@tw4l
Copy link
Collaborator

tw4l commented Apr 5, 2019

Hi Kyle,

I think it might be your folder structure that's the issue. The Disk Image Processor expects that all of your disk images (as well as log files, photos, and any other files) are all in the same (flat) folder. It doesn't look into any subfolders, so if each .img file is in its own folder it won't pick them up.

If you put all of your disk images in the same folder, it should process each one of them in turn.

@KyleDennis03
Copy link
Author

Hi Tim, thanks for your help! However, I just tried that, and what ended up happening is that Disk Image Processor processed the first 20 disk image/log file pairs out of the total 80 and then just quit processing. When I looked at the log file (see attached), it appeared as though Disk Image Processor either can't recognize/work with the FAT12 file system, or it just doesn't recognize that the file is a disk image at all, and skips it. Either way, no files are ever extracted. After that, I tried processing the un-processed image files in a folder that was separate from the original one, and I wind right back up to where I started, with disk image processor just processing the first image and nothing else. Fortunately, the one SIP that was created by that did yield actual files from the image like it is supposed to. Do you have any ideas? Because I have tried pretty much everything that I can think of. Thanks again for your help though, I know you're busy and I appreciate it!

diskimageprocessor.log

@tw4l
Copy link
Collaborator

tw4l commented Jun 3, 2019 via email

@KyleDennis03
Copy link
Author

Hi Tim, thanks so much for your ideas. Stefana and I looked into the problem and after discovering that the images cannot be mounted, we determined that the issue is simply that the disk images are un-readable due to the floppy disks being in poor condition at the time of imaging. Since Disk Image Processor stops processing once it hits a disk image it cannot process, I can't figure out which images are readable and which ones aren't.

The solution we found was to just brute-force it and try to process each disk image individually to see which ones work, and any images that are not readable won't be bothered to be ingested into Archivematica, since we figure that if they're unusable now, they're probably still going to be unusable xx years in the future from now. However, as a last resort, I'll try to directly mount some of the disks to see if they're at all usable, as opposed to working from the disk image. I don't have high expectations for this to work, though.

In any case, thanks so much for taking the time to do this, we all really appreciate it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants