Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: handling synonyms and text fields more efficiently #234

Merged
merged 39 commits into from
Oct 24, 2024
Merged

feat: handling synonyms and text fields more efficiently #234

merged 39 commits into from
Oct 24, 2024

Commits on Aug 21, 2024

  1. feat: wip on generating synonyms

    @alexgarel
    alexgarel committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    415840f View commit details
    Browse the repository at this point in the history

  2. feat: wip on revamp of taxonomy fields

    @alexgarel
    alexgarel committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    5ccf99c View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. wip: on changing taxonomy 

    - put main language handling in openfoodfacts.py
- generate mappings
- change indexing

not tested yet + query is yet untouched
    @alexgarel
    alexgarel committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    9a365d9 View commit details
    Browse the repository at this point in the history

  2. fix: various small fixes

    @alexgarel
    alexgarel committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    117624d View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. fix: larger timeout at index creation time

    @alexgarel
    alexgarel committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    a664fe9 View commit details
    Browse the repository at this point in the history

  2. feat: add a cleanup-indexes cli command

    @alexgarel
    alexgarel committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    8c8ed42 View commit details
    Browse the repository at this point in the history

  3. fix: changing config and fixing indexing

    @alexgarel
    alexgarel committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    92fde12 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2024

  1. feat: wip on changing query for new synonyms matching

    @alexgarel
    alexgarel committed Aug 24, 2024
    Configuration menu
    Copy the full SHA
    0a60ef1 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. feat: query now works with new full text indexing

    @alexgarel
    alexgarel committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    af191c0 View commit details
    Browse the repository at this point in the history

  2. test: add integration tests

    @alexgarel
    alexgarel committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    819d078 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. test: added integration tests 

    and fix a bug in logging during import
    @alexgarel
    alexgarel committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    d86ca93 View commit details
    Browse the repository at this point in the history

  2. fix: on taxonomy_es refresh taxonomies

    @alexgarel
    alexgarel committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    bb49c82 View commit details
    Browse the repository at this point in the history

  3. test: fix some tests and remove deprecated option

    @alexgarel
    alexgarel committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    91a0929 View commit details
    Browse the repository at this point in the history

  4. feat: add smart_words and boost_phrases 

    and tests
    @alexgarel
    alexgarel committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    47cfacf View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. feat: change boost_phrase transformer

    @alexgarel
    alexgarel committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f7c2fa6 View commit details
    Browse the repository at this point in the history

  2. feat: add debug info on demand in API

    @alexgarel
    alexgarel committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    465adab View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. feat: toward a better search 

    - return errors if query is not valid
- understand open ranges
    @alexgarel
    alexgarel committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    8792c3e View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. test: first api integration test

    @alexgarel
    alexgarel committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    db31f55 View commit details
    Browse the repository at this point in the history

  2. fix: fix tokenizer for taxonomy fields

    @alexgarel
    alexgarel committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1218b01 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. refactor: use a model for search get parameters

    @alexgarel
    alexgarel committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    c3e3da1 View commit details
    Browse the repository at this point in the history

  2. test: integrations tests

    @alexgarel
    alexgarel committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    822a72d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into fix-text-handling

    @alexgarel
    alexgarel committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    567392d View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. refactor: refactor search parameters into something really coherent

    @alexgarel
    alexgarel committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    3e3e4d1 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. fix: make taxonomy translations consistent 

    they were random as we pick one tranlations among synonyms
    @alexgarel
    alexgarel committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    475b87c View commit details
    Browse the repository at this point in the history

  2. fix: better guard config access 

    + fix search get parameters conversion
+ more integration tests
    @alexgarel
    alexgarel committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    9828aa7 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. fix: on charts 

    + integration tests
+ change name of chart type to be more easy to understand
+ add boost_phrase to search bar component
    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    0bde2e4 View commit details
    Browse the repository at this point in the history

  2. fix: fix test and add boost_phrase to search-ctl component

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    3860d87 View commit details
    Browse the repository at this point in the history

  3. fix: if q is empty, it should not be analyzed by luqum

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    f65518c View commit details
    Browse the repository at this point in the history

  4. test: add test for empty q

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    7567f14 View commit details
    Browse the repository at this point in the history

  5. chore: docs fixes and poetry lock update

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    049bacb View commit details
    Browse the repository at this point in the history

  6. test: fix test run for cold run

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    15d6cab View commit details
    Browse the repository at this point in the history

  7. chore: fix python version to be able to build schema generation image

    @alexgarel
    alexgarel committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    dead58b View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. chore: Apply suggestions from code review 

    Co-authored-by: Raphaël Bournhonesque <[email protected]>
    @alexgarel @raphael0202
    alexgarel and raphael0202 authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    792d848 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. fix: better handling hyphen and apostrophe

    @alexgarel
    alexgarel committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1270c3f View commit details
    Browse the repository at this point in the history

  2. fix: types in analyzers

    @alexgarel
    alexgarel committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    0b6084f View commit details
    Browse the repository at this point in the history

  3. chore: remove unused logger instance

    @alexgarel
    alexgarel committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7ad0369 View commit details
    Browse the repository at this point in the history

  4. fix: poetry not in package mode

    @alexgarel
    alexgarel committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b3c5548 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. docs: typo in comment 

    Co-authored-by: Raphaël Bournhonesque <[email protected]>
    @alexgarel @raphael0202
    alexgarel and raphael0202 authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    62ed4b7 View commit details
    Browse the repository at this point in the history

  2. feat: add main fallback for search in off.html

    @alexgarel
    alexgarel committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    7f20e75 View commit details
    Browse the repository at this point in the history