Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Name Tokenization Codec (Update CRAM Codecs to CRAM 3.1) #1663

Open
wants to merge 83 commits into
base: master
Choose a base branch
from
Open

Add Name Tokenization Codec (Update CRAM Codecs to CRAM 3.1) #1663

wants to merge 83 commits into from

Commits on Oct 19, 2023

  1. adding comments to Frequencies.java

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    75171ee View commit details
    Browse the repository at this point in the history

  2. separate encode and decode classes

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    7821469 View commit details
    Browse the repository at this point in the history

  3. Add Frequency methods to encode and decode classes

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    defc174 View commit details
    Browse the repository at this point in the history

  4. clean up rans tests and add separate packages for rans 4x8 and nx16

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    f3734ca View commit details
    Browse the repository at this point in the history

  5. filter out extra column from q40+dir file

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8582ab8 View commit details
    Browse the repository at this point in the history

  6. rans nx16 order 1 freq tables + refactor

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0769ecc View commit details
    Browse the repository at this point in the history

  7. clean up

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    faf7c10 View commit details
    Browse the repository at this point in the history

  8. Update RAN test method names.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    720357b View commit details
    Browse the repository at this point in the history

  9. Remove unncessary params arg from uncompress methods (params are embe… 

    …dded in the streams).
    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    03773c6 View commit details
    Browse the repository at this point in the history

  10. Remove unnecessary RANSNx16Params state.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4a41948 View commit details
    Browse the repository at this point in the history

  11. Fix bug in the case where the cat bit is set.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ba088c6 View commit details
    Browse the repository at this point in the history

  12. Reduce unncessary buffer allocation.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ed68e3b View commit details
    Browse the repository at this point in the history

  13. Thread RANSNx16 params through RANSNx16 implementation.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0ce9080 View commit details
    Browse the repository at this point in the history

  14. Dont initialize RANSNx16 decoding structures unless we're going to us… 

    …e them.
    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    671d21f View commit details
    Browse the repository at this point in the history

  15. Move/inline RANS Nx16 D0N uncompress method into RANSNx16Decode.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    9cd168a View commit details
    Browse the repository at this point in the history

  16. Move/inline RANS Nx16 D1N uncompress method into RANSNx16Decode.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    2688906 View commit details
    Browse the repository at this point in the history

  17. Move/inline RANS Nx16 E0N compress method into RANSNx16Encode.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e01b08e View commit details
    Browse the repository at this point in the history

  18. Move/inline RANS Nx16 E1N compress method into RANSNx16Encode.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    3c7ebb8 View commit details
    Browse the repository at this point in the history

  19. Suppress spotbugs warnings.

    @cmnbroad
    cmnbroad authored and yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    56f2b86 View commit details
    Browse the repository at this point in the history

  20. Don't initialize RANS4x8 decoding structure unless we're going to use… 

    … them.
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    55e290d View commit details
    Browse the repository at this point in the history

  21. Move/inline RANS 4x8 E04 compress method into RANS4x8Encode.

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b89a222 View commit details
    Browse the repository at this point in the history

  22. Move/inline RANS 4x8 E14 compress method into RANS4x8Encode.

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e23a7e3 View commit details
    Browse the repository at this point in the history

  23. Move/inline RANS 4x8 D04 uncompress method into RANS4x8Decode.

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0b3fd27 View commit details
    Browse the repository at this point in the history

  24. Move/inline RANS 4x8 D14 uncompress method into RANS4x8Decode.

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e53f109 View commit details
    Browse the repository at this point in the history

  25. Fix normalized Frequency (4096), add normalize Frequency using bit sh… 

    …ift methods for RANS Nx16 Order 0 and Order 1, RANS Nx16 Order 0 and Order 1 with format flags = 1 works as expected when N=4
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d0279aa View commit details
    Browse the repository at this point in the history

  26. Add ransNx16 for format flags = 1,4,5 (N=32) and replace division wit… 

    …h right shifts.
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c2cac35 View commit details
    Browse the repository at this point in the history

  27. When CAT is true, add limit and rewind the outBuffer before returning… 

    … it.
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    5034915 View commit details
    Browse the repository at this point in the history

  28. Add RANSTest with formatflags = 32, 33, 36, 37

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c966eec View commit details
    Browse the repository at this point in the history

  29. Remove initialization of alphabet array.

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    890940e View commit details
    Browse the repository at this point in the history

  30. Add RLE Encode and Decode. Works as expected for RANSNx16 Order 0

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c3dd46d View commit details
    Browse the repository at this point in the history

  31. Move declaration of variables used within the for loop to inside the … 

    …for loop
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    5020477 View commit details
    Browse the repository at this point in the history

  32. Convert symbols from int to byte

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c22cd8b View commit details
    Browse the repository at this point in the history

  33. rename getInterleaveSize to getNumInterleavedRANSStates in RANSNx16Pa… 

    …rams
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b457c74 View commit details
    Browse the repository at this point in the history

  34. RLE encode and decode works as expected for RANSNx16 Order 1

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    03e9297 View commit details
    Browse the repository at this point in the history

  35. add encode and decode Pack. Add test cases for pack

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    1fb6800 View commit details
    Browse the repository at this point in the history

  36. rename variable for better readability

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d79a4cf View commit details
    Browse the repository at this point in the history

  37. add exception when num of distinct symbols = 0 or > 16

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    68994c0 View commit details
    Browse the repository at this point in the history

  38. Add Decode Stripe to RANS Nx16. Add getFormatFlags() to RANSParams

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8d93534 View commit details
    Browse the repository at this point in the history

  39. Add test for Encoding when Stripe Flag is set

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d523eac View commit details
    Browse the repository at this point in the history

  40. Fix Spot Bugs warn - Use && for logical and

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    14df7b2 View commit details
    Browse the repository at this point in the history

  41. Addressing the feedback from Aug 30, 2022

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    7f7e613 View commit details
    Browse the repository at this point in the history

  42. Use the Interop Test files from samtools-1.14/htslib-1.14/htscodecs/t… 

    …ests or ../htscodecs/tests depending on the env
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8b38306 View commit details
    Browse the repository at this point in the history

  43. Replace hex literals with bit flag masks in RANSInteropTest Data Prov… 

    …ider
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    cec6e3e View commit details
    Browse the repository at this point in the history

  44. Addressing the feedback so far

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    577d5d1 View commit details
    Browse the repository at this point in the history

  45. debug CI test failure

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    2db0878 View commit details
    Browse the repository at this point in the history

  46. Fix the htscodecs path

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c8fb550 View commit details
    Browse the repository at this point in the history

  47. rename methods that return boolean to start with 'is' instead of 'get'

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d51f9ce View commit details
    Browse the repository at this point in the history

  48. debug

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    789f50c View commit details
    Browse the repository at this point in the history

  49. Addressing the feedback from 10/25/22

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    6b0c4f1 View commit details
    Browse the repository at this point in the history

  50. undo inadvertent deletion of RANSInterop roundtrip test logic

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e72147a View commit details
    Browse the repository at this point in the history

  51. debug - add decodePack and decodeRLE on top of CAT flag

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    850280d View commit details
    Browse the repository at this point in the history

  52. rewind outBuffer before it is returned

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    3f84b2a View commit details
    Browse the repository at this point in the history

  53. remove duplicate outBuffer creation

    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    43145d4 View commit details
    Browse the repository at this point in the history

  54. Addressing the feedback from oct 11, 2023 except implementing the Str… 

    …ipe Flag in RANS Nx16 encoder
    yash-puligundla committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    f7e6c57 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Move common methods to CRAMInteropTestUtils class

    yash-puligundla committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    f9041e8 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 1

    yash-puligundla committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    7126507 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 2

    yash-puligundla committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d2802b1 View commit details
    Browse the repository at this point in the history

  2. Addressing the feedback from Nov 7 and Nov 20 - part 3

    yash-puligundla committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    e6b06a5 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 4

    yash-puligundla committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    1a89cb4 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 5

    yash-puligundla committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    f4fd67c View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 6

    yash-puligundla committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    b095b1c View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. Addressing the feedback from Nov 7 and Nov 20 - part 6

    yash-puligundla committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    b2187c3 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Move common code to CompressionUtils

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    52549f5 View commit details
    Browse the repository at this point in the history

  2. add Range Encode

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2db77e9 View commit details
    Browse the repository at this point in the history

  3. Fix RangeEncode for order 0 and formatflags=0x00

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    43a68c9 View commit details
    Browse the repository at this point in the history

  4. rebase - Add Range Codec, RangeTest, RangeInteropTest for order, rle,… 

    … stripe, nosize, cat flags
    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    49eac0e View commit details
    Browse the repository at this point in the history

  5. Add uncompressEXT and decodePack to RangeDecode

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    7b454d6 View commit details
    Browse the repository at this point in the history

  6. add Pack flag to tests

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    81bcac7 View commit details
    Browse the repository at this point in the history

  7. Add Range encode and decode for EXT flag

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    5de4036 View commit details
    Browse the repository at this point in the history

  8. debug spotbugs error

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    fc6227d View commit details
    Browse the repository at this point in the history

  9. debug - add decodePack on top of CAT flag

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    249db30 View commit details
    Browse the repository at this point in the history

  10. Addressing format related feedback from RANS PR that applies to Range… 

    … Codec as well
    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    e2d5a37 View commit details
    Browse the repository at this point in the history

  11. Rebase on RANS branch and use common methods from CRAMInteropTestUtil… 

    …s class
    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    58ace69 View commit details
    Browse the repository at this point in the history

  12. Addressing feedback from nov 21 - part 1

    yash-puligundla committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    f9b066c View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Addressing feedback from nov 21 - part 2

    yash-puligundla committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    4a416f7 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. Addressing feedback from nov 21, nov 28 - part 3

    yash-puligundla committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    55f6086 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. Add NameTokenization Decoder

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    6c0387c View commit details
    Browse the repository at this point in the history

  2. Add NameTokenization Encoder

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    902ca33 View commit details
    Browse the repository at this point in the history

  3. add descriptive variable names

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    d3ae09d View commit details
    Browse the repository at this point in the history

  4. Add unittests

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    1c0cb8d View commit details
    Browse the repository at this point in the history

  5. Use List<Token> instead of TokenStreams in NameTokenisationEncoder

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    eff17cf View commit details
    Browse the repository at this point in the history

  6. Addressing feedback from dec 5 - part 1

    yash-puligundla committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    67ad384 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. Addressing feedback from dec 5 - part 2

    yash-puligundla committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    3233e39 View commit details
    Browse the repository at this point in the history