Skip to content

Latest commit

 

History

History
622 lines (294 loc) · 27.3 KB

CHANGELOG.md

File metadata and controls

622 lines (294 loc) · 27.3 KB
Raw

CHANGELOG

v1.5.4 (2024-02-02)

Documentation

Fix

  • fix: Adds fast directory check (db2e33c)

v1.5.3 (2024-02-02)

Fix

v1.5.2 (2024-01-30)

Fix

  • fix: Adds gslides and gform (f449511)

v1.5.1 (2024-01-23)

Ci

Fix

  • fix: Adds quotes to delete scripts (061700d)

Style

  • style: Fixes style issues (1e31875)

v1.5.0 (2024-01-08)

Feature

  • feat: Adds ignore hash to CLI (ff4d279)

v1.4.4 (2024-01-08)

Ci

  • ci: Adds dedup ignore to release (9d0388c)

Fix

  • fix: Fixes newlines for cross-platform (db3aa35)

  • fix: Updates dedup ignore for google drive (303c8aa)

v1.4.3 (2024-01-08)

Fix

  • fix: Adds logging to compute_sha256 (ebb80be)

Unknown

  • Merge branch 'master' of github.com:UCSD-E4E/e4e-deduplication (8a41847)

v1.4.2 (2024-01-08)

Fix

  • fix: Adds hash error trap (6d09e49)

v1.4.1 (2024-01-08)

Fix

  • fix: Adds progress bar to drop tree (a6056d8)

v1.4.0 (2024-01-07)

Feature

  • feat: Adds generate report CLI (cdf612c)

  • feat: Splits the analysis reporting (7ec23d7)

v1.3.3 (2024-01-07)

Fix

  • fix: Fixes analyze cli linkage (a1f2fc3)

v1.3.2 (2024-01-07)

Fix

  • fix: Allows multiple directory for analyze (dd42401)

v1.3.1 (2024-01-06)

Fix

  • fix: Adds cache execution logic (5625628)

v1.3.0 (2024-01-06)

Chore

  • chore: Merges 31 bug file path may contain commas (#32) (ca3ed0d)

Ci

Feature

  • feat: Switches to json based cache, splits cache upgrade scripts (14f6f32)

Style

  • style: Fixes duplicate code (c3082e8)

  • style: Removes unused imports (c8275f7)

  • style: Adds docstrings (ac087e4)

v1.2.0 (2024-01-06)

Feature

  • feat: Adds a drop tree command (#29) (62215fe)

  • feat: Adds a drop tree command (a91013e)

Style

  • style: Fixes reopen warning (df84d7e)

v1.1.3 (2023-12-27)

Fix

v1.1.2 (2023-12-22)

Fix

  • fix: Fixes Cache upgrade (#27) (9b3cec3)

  • fix: Fixes cache upgrade (dfedf70)

Style

  • style: Fixes resource allocation (fa0b2fb)

Test

  • test: Fixes upgrade cache test (2fb50d5)

v1.1.1 (2023-12-21)

Fix

  • fix: Removes versioning from appdirs (#26) (cfcf8e8)

  • fix: Removes versioning from appdirs (1bedc79)

v1.1.0 (2023-12-21)

Feature

v1.0.0 (2023-12-21)

Breaking

  • feat!: Switches cli to subcommands (3b8ccaa)

  • feat!: WIP -adding subcommands (02340be)

  • feat!: Enables hostname aware comparison (55ea161)

Ci

  • ci: Adds windows and macos for testing (568ce5a)

Feature

  • feat: allow for cross machine (#23) (3f6fa7b)

Fix

  • fix: Fixes *nix permissions (39b6c4d)

  • fix: Adds logging, fixes cache rebuild after cache sort (d200e15)

Test

  • test: Adds tests for os delete scripts (0745005)

v0.7.1 (2023-12-18)

Ci

Fix

  • fix: Faster job cache (#20) (a113912)

  • fix: Fixes synology_api version (67e5d9d)

  • fix: switching to internal offset dict (00b02af)

Style

v0.7.0 (2023-12-17)

Feature

  • feat: Adds byte based progress bar (#18) (d8d2a07)

  • feat: Adds byte based progress bar (27f9ec3)

v0.6.1 (2023-12-17)

Fix

  • fix: Fixes job cache handle initialization (ca3246d)

v0.6.0 (2023-12-16)

Ci

Feature

  • feat: reduce sql db overhead (#17) (7200b03)

  • feat: Switch to csv based hash cache (b023e79)

Fix

Style

  • style: Removes unused import (67fde55)

Unknown

  • wip: Switching to filesort based duplication (8820a1f)

v0.5.2 (2023-12-15)

Fix

  • fix: Switching to non-multiprocess Queue (f58cbaa)

  • fix: Removes submodule (9f0685d)

v0.5.1 (2023-12-15)

Ci

  • ci: Fixes wheel build (0ba6a84)

  • ci: Fixes release.yml to no longer require cibuildwheel (fff48f6)

Fix

  • fix: Adds dynamic_ncols (#15) (e1a4bf3)

  • fix: Adds dynamic_ncols (adf6529)

v0.5.0 (2023-12-15)

Feature

  • feat: Uses python parallel hasher (#13) (c0351a5)

  • feat: Switching to python hasher (11b14ca)

  • feat: Uses python parallel hasher (40a9eb1)

Fix

  • fix: Removes pybind11 dependency (7217838)

Style

v0.4.0 (2023-12-13)

Feature

  • feat: sqitches to sqlite3 and thread pool (1100593)

  • feat: Switches to a parallel thread hasher (ee04599)

  • feat: Switching to threadpool and optimizing dataflow (998fb60)

  • feat: Implements sqlite3 backend (f87d9b8)

Fix

  • fix: Fixes GIL release (acc71f1)

  • fix: Re-adds the file discovery tqdm (6dcfc30)

Unknown

  • Merge remote-tracking branch 'refs/remotes/origin/sqlite3_testing'

Conflicts: e4e_deduplication/analyzer.py (8c22f01)

  • Merge branch 'master' into 8-possible-memory-leak (15427e4)

v0.3.0 (2023-12-12)

Feature

  • feat: Adds progress bars

Merge pull request #11 from UCSD-E4E/4-progress-bar-for-analysis-result-aggregation (6abf954)

  • feat: Adds progress bars (c45e590)

Unknown

  • Merge pull request #10 from UCSD-E4E/7-add-user-confirmation-for-clear_cache

feat: Adds clear cache check (8572e57)

v0.2.2 (2023-12-11)

Ci

Feature

  • feat: Adds clear cache check (74d310b)

Fix

  • fix: Updates log timestamps (92514f6)

  • fix: Fixes logging timestamp format (d518c7f)

v0.2.1 (2023-12-11)

Ci

Documentation

Fix

  • fix: Fixes naive job file

Merge pull request #3 from UCSD-E4E/naive_job_file (a9e57fb)

  • fix: Allows for empty dict in job cache (98dfd56)

Style

v0.2.0 (2023-12-11)

Feature

  • feat: Updates dedup for synology

Merge pull request #2 from UCSD-E4E/file_filter (404641f)

  • feat: Updates dedup for synology (b14f926)

v0.1.2 (2023-12-11)

Fix

  • fix: Reduces console output to WARNING instead of DEBUG (fcfbe79)

Unknown

  • Merge branch 'master' of github.com:UCSD-E4E/e4e-deduplication (f9cd7a5)

v0.1.1 (2023-12-11)

Fix

  • fix: Fixes release publish (81bc878)

v0.1.0 (2023-12-11)

Ci

Documentation

Feature

  • feat: Merges pyFileHash for wheel (5325524)

  • feat: Adds progress bar for file discovery (0e3c773)

  • feat: Adds report (d1b74a2)

  • feat: Updates behavior (e3cec29)

Fix

Style

Unknown

  • Merge pull request #1 from UCSD-E4E/gh_actions

Github Actions (69bfb16)

  • add missing parameter to report.generate (3cda02b)

  • handle root path (5ada477)

  • fix bug with logging parameters (a22e206)

  • support providing original paths (4ecfd10)

  • remove printing that checksums are being calculated (774e82d)

  • unpack mtime as a tuple from sqlite to address bug causing checksums to be recalculated for all files (3cf892b)

  • print mtime of both files (0a27b16)

  • print when we are running checksum (a1050bd)

  • always update seen, even if mtime is the same (e018423)

  • always print file, even if in cache (8698499)

  • better handle excluded paths (beee5bf)

  • reintroduce the in memory cache (c5379a2)

  • fix no such column seen error (74c593e)

  • support rechecking files already in cache (381c3d9)

  • simplify dirty check for cache (ee6f535)

  • handle only updating the db if cache is dirty (4d09bee)

  • support in memory caching to speed up processing (d367850)

  • correctly check to see if RootDir is in the db (bc3bfcc)

  • cast cursor to list (1a352b9)

  • handle pulling the metadata correctly (cb292d8)

  • don't print path if already in cache (c69d95e)

  • comment the code (292aa68)

  • correct pylint errors (098f68f)

  • use home directory from pathlib (3c36dd8)

  • support older version of python (7479acd)

  • only copy to nas when complete (3d7eced)

  • commit every 10 items or every 10 minutes. whichever comes first. (0fea6ec)

  • instead of committing every 10 items, commit every 10 minutes. (2c118ce)

  • update cache to handle renames (aa757ea)

  • only delete cache file if exists (29ccaa8)

  • revert back to sha256 instead of file_digest to support older versions of python. (1558466)

  • revert back to sha256 instead of file_digest to support older versions of python. (d898021)

  • fixed bug in cache object with-statement (d3495a5)

  • excluded files in Directory object (ce60432)

  • support excluded files (6b090e3)

  • commit to cache every 10 items (ed66f63)

  • support cache with-statement. Store cache in local folder (8df8853)

  • reverse previous commit. add some missing type hints (8b061f5)

  • always commit after adding file (20355eb)

  • print out current file name (6028958)

  • move black and pylint to dev dependencies (f6061e4)

  • move pylint and black to dev dependencies (0fb7d20)

  • fix pylint errors (d2474b1)

  • update cache to no longer use hard coded '/' and use file_digest to compute hash (fdb7f29)

  • address Nathan's comments (bdf88ca)

  • initial checkin of the e4e deduplication tool. (e1d9c35)