Skip to content

Commit

Permalink
Use md5?
Browse files Browse the repository at this point in the history
  • Loading branch information
orf committed Oct 20, 2024
1 parent c76d22a commit 9d2473c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/pypi_data/combine_parquet.py
Original file line number Diff line number Diff line change
Expand Up @@ -124,7 +124,7 @@ async def fill_buffer(

# Hash the path column with zero copies.
data_buffer = batch.column("path").cast(pyarrow.large_binary()).buffers()[1]
digest = hashlib.sha256(memoryview(data_buffer)).hexdigest()
digest = hashlib.md5(memoryview(data_buffer)).hexdigest()

time_hashing_ns += time.perf_counter_ns() - start_hash_time

Expand Down

0 comments on commit 9d2473c

Please sign in to comment.