Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DRAFT Setup documentation #215

Draft
wants to merge 128 commits into
base: dev
Choose a base branch
from
Draft

DRAFT Setup documentation #215

wants to merge 128 commits into from

Conversation

wkdewey
Copy link
Contributor

@wkdewey wkdewey commented Mar 1, 2023

adding some new documentation for starting a new repo

@wkdewey wkdewey self-assigned this Mar 1, 2023
@wkdewey wkdewey marked this pull request as draft March 1, 2023 19:30
jduss4 and others added 26 commits March 1, 2023 13:31
in order to achieve support for multiple ES schemas
- adds configuration for different schema locations
- moves code from executables into Datura::Elasticsearch module
- Datura::Options combines settings into schema path
had suffered from errors and from gem deprecation warnings
the validator ensures that all fields have either an exact
mapping OR match a dynamic template, at least as far as our
current simple dynamic templates go. This may need to be adjusted
in the future if we start using more complex templates

refactors file_type post_es method to use Elasticsearch::Index
object and to rely less on repeated "returns" vs a final line at the end

also adds some helpful methods like should_post? to complement
should_transform? for ease
that is, previously it was assuming that nested subfields all
match a top level field or dynamic mapping
actually, nested fields can specify their own specific mapping
that the subfields may also access....sooooooo I had to redo stuff

tests should be passing! thank goodness for unit tests and tdd
reverts my earlier change, it breaks other functions
update documentation for changes to the schema
in order to achieve support for multiple ES schemas
- adds configuration for different schema locations
- moves code from executables into Datura::Elasticsearch module
- Datura::Options combines settings into schema path
the validator ensures that all fields have either an exact
mapping OR match a dynamic template, at least as far as our
current simple dynamic templates go. This may need to be adjusted
in the future if we start using more complex templates

refactors file_type post_es method to use Elasticsearch::Index
object and to rely less on repeated "returns" vs a final line at the end

also adds some helpful methods like should_post? to complement
should_transform? for ease
@karindalziel karindalziel changed the title Setup documentation DRAFT Setup documentation May 1, 2024
@techgique techgique changed the base branch from dev to new_fields August 28, 2024 19:55
@techgique techgique changed the base branch from new_fields to dev August 28, 2024 19:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants