Getting sometimes crashes

[wipfli]

I sometimes get crashes like the following one. I don't know what it is, maybe it happens 3 to 5 out of 10 runs or so.

I am using java 22 with a jit profile using the jar that gets generated with ./scripts/build.sh in planetiler-dist.

Any idea what that could be?

0:00:06 INF [osm_pass2:process] - Finished relations: 48,763 (422k/s) in 0.1s cpu:0.6s avg:4.8
Worker osm_pass2_write-1 died
java.lang.InternalError: a fault occurred in an unsafe memory access operation
        at java.base/jdk.internal.misc.ScopedMemoryAccess.copyMemoryInternal(ScopedMemoryAccess.java:147)
        at java.base/jdk.internal.misc.ScopedMemoryAccess.copyMemory(ScopedMemoryAccess.java:129)
        at java.base/java.nio.ByteBuffer.putArray(ByteBuffer.java:1361)
        at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1218)
        at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1248)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$WriterMmap.write(ExternalMergeSort.java:469)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$Chunk.add(ExternalMergeSort.java:490)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$ThreadLocalWriter.accept(ExternalMergeSort.java:411)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$ThreadLocalWriter.accept(ExternalMergeSort.java:393)
        at com.onthegomap.planetiler.reader.osm.OsmReader.lambda$pass2$8(OsmReader.java:379)
        at com.onthegomap.planetiler.worker.WorkerPipeline$Builder.lambda$sinkTo$2(WorkerPipeline.java:272)
        at com.onthegomap.planetiler.worker.Worker.lambda$new$0(Worker.java:41)
        at com.onthegomap.planetiler.worker.Worker.lambda$new$1(Worker.java:68)
        at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1570)
Exception in thread "main" com.onthegomap.planetiler.Planetiler$PlanetilerException: Error occurred during stage osm
        at com.onthegomap.planetiler.Planetiler.run(Planetiler.java:838)
        at MyProfile.main(MyProfile.java:34)
Caused by: com.onthegomap.planetiler.util.Exceptions$FatalPlanetilerException: java.util.concurrent.ExecutionException: java.lang.InternalError: a fault occurred in an unsafe memory access operation
        at com.onthegomap.planetiler.util.Exceptions.throwFatalException(Exceptions.java:29)
        at com.onthegomap.planetiler.stats.ProgressLoggers.await(ProgressLoggers.java:367)
        at com.onthegomap.planetiler.stats.ProgressLoggers.awaitAndLog(ProgressLoggers.java:352)
        at com.onthegomap.planetiler.worker.WorkerPipeline.awaitAndLog(WorkerPipeline.java:59)
        at com.onthegomap.planetiler.reader.osm.OsmReader.pass2(OsmReader.java:399)
        at com.onthegomap.planetiler.Planetiler.lambda$addOsmSource$0(Planetiler.java:220)
        at com.onthegomap.planetiler.Planetiler.lambda$ifSourceUsed$12(Planetiler.java:964)
        at com.onthegomap.planetiler.Planetiler.run(Planetiler.java:836)
        at MyProfile.main(MyProfile.java:34)
        at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.base/java.lang.reflect.Method.invoke(Method.java:580)
        at jdk.compiler/com.sun.tools.javac.launcher.SourceLauncher.execute(SourceLauncher.java:264)
        at jdk.compiler/com.sun.tools.javac.launcher.SourceLauncher.run(SourceLauncher.java:153)
        at jdk.compiler/com.sun.tools.javac.launcher.SourceLauncher.main(SourceLauncher.java:78)
        Suppressed: java.io.UncheckedIOException: java.io.IOException: No space left on device
                at com.onthegomap.planetiler.collection.LongLongMultimap$DenseOrderedMultimap.close(LongLongMultimap.java:299)
                at com.onthegomap.planetiler.reader.osm.OsmReader.close(OsmReader.java:562)
                at com.onthegomap.planetiler.Planetiler.lambda$addOsmSource$0(Planetiler.java:212)
                ... 8 more
        Caused by: java.io.IOException: No space left on device
                at java.base/sun.nio.ch.UnixFileDispatcherImpl.write0(Native Method)
                at java.base/sun.nio.ch.UnixFileDispatcherImpl.write(UnixFileDispatcherImpl.java:65)
                at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:137)
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:102)
                at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:72)
                at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:303)
                at java.base/sun.nio.ch.ChannelOutputStream.writeFully(ChannelOutputStream.java:68)
                at java.base/sun.nio.ch.ChannelOutputStream.write(ChannelOutputStream.java:105)
                at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:125)
                at java.base/java.io.BufferedOutputStream.implFlush(BufferedOutputStream.java:252)
                at java.base/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:240)
                at java.base/java.io.FilterOutputStream.close(FilterOutputStream.java:184)
                at java.base/java.io.FilterOutputStream.close(FilterOutputStream.java:193)
                at com.onthegomap.planetiler.collection.AppendStoreMmap.close(AppendStoreMmap.java:77)
                at com.onthegomap.planetiler.collection.LongLongMultimap$DenseOrderedMultimap.close(LongLongMultimap.java:297)
                ... 10 more
                Suppressed: java.io.IOException: No space left on device
                        at java.base/sun.nio.ch.UnixFileDispatcherImpl.write0(Native Method)
                        at java.base/sun.nio.ch.UnixFileDispatcherImpl.write(UnixFileDispatcherImpl.java:65)
                        at java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:137)
                        at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:102)
                        at java.base/sun.nio.ch.IOUtil.write(IOUtil.java:72)
                        at java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:303)
                        at java.base/sun.nio.ch.ChannelOutputStream.writeFully(ChannelOutputStream.java:68)
                        at java.base/sun.nio.ch.ChannelOutputStream.write(ChannelOutputStream.java:105)
                        at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:125)
                        at java.base/java.io.BufferedOutputStream.implFlush(BufferedOutputStream.java:252)
                        at java.base/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:240)
                        at java.base/java.io.DataOutputStream.flush(DataOutputStream.java:134)
                        at java.base/java.io.FilterOutputStream.close(FilterOutputStream.java:184)
                        ... 12 more
Caused by: java.util.concurrent.ExecutionException: java.lang.InternalError: a fault occurred in an unsafe memory access operation
        at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
        at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2096)
        at com.onthegomap.planetiler.stats.ProgressLoggers.await(ProgressLoggers.java:361)
        ... 12 more
Caused by: java.lang.InternalError: a fault occurred in an unsafe memory access operation
        at java.base/jdk.internal.misc.ScopedMemoryAccess.copyMemoryInternal(ScopedMemoryAccess.java:147)
        at java.base/jdk.internal.misc.ScopedMemoryAccess.copyMemory(ScopedMemoryAccess.java:129)
        at java.base/java.nio.ByteBuffer.putArray(ByteBuffer.java:1361)
        at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1218)
        at java.base/java.nio.ByteBuffer.put(ByteBuffer.java:1248)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$WriterMmap.write(ExternalMergeSort.java:469)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$Chunk.add(ExternalMergeSort.java:490)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$ThreadLocalWriter.accept(ExternalMergeSort.java:411)
        at com.onthegomap.planetiler.collection.ExternalMergeSort$ThreadLocalWriter.accept(ExternalMergeSort.java:393)
        at com.onthegomap.planetiler.reader.osm.OsmReader.lambda$pass2$8(OsmReader.java:379)
        at com.onthegomap.planetiler.worker.WorkerPipeline$Builder.lambda$sinkTo$2(WorkerPipeline.java:272)
        at com.onthegomap.planetiler.worker.Worker.lambda$new$0(Worker.java:41)
        at com.onthegomap.planetiler.worker.Worker.lambda$new$1(Worker.java:68)
        at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1570)

[msbarry]

Looks like you might have run out of disk space

[wipfli]

Aha!

df -h 
Filesystem      Size  Used Avail Use% Mounted on
/dev/nvme0n1p3  460G  435G  1.6G 100% /

[wipfli]

Thank you...