Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

custom-dic ant regenerate java exception #1

Open
dongshik opened this issue Nov 28, 2018 · 1 comment
Open

custom-dic ant regenerate java exception #1

dongshik opened this issue Nov 28, 2018 · 1 comment

Comments

@dongshik
Copy link

when i try ant regenerate of nori occur Exception
i "tar xvf mecab-ko-dic-2.0.3-20170922.tar.gz" and didn't added custom dic
just run "ant regenerate" for build test....

like this

build-dict:
[java] dictionary builder
[java]
[java] input directory: /Users/dongsik/git/develop_with_elk/lucene-solr/lucene/build/analysis/nori/mecab-ko-dic-2.0.3-20170922
[java] output directory: /Users/dongsik/git/develop_with_elk/lucene-solr/lucene/analysis/nori/src/resources
[java] input encoding: utf-8
[java] normalize entries: false
[java]
[java] building tokeninfo dict...
[java] parse...
[java] sort...
[java] encode...
[java] Exception in thread "main" java.lang.AssertionError
[java] at org.apache.lucene.analysis.ko.util.BinaryDictionaryWriter.put(BinaryDictionaryWriter.java:120)
[java] at org.apache.lucene.analysis.ko.util.TokenInfoDictionaryBuilder.buildDictionary(TokenInfoDictionaryBuilder.java:123)
[java] at org.apache.lucene.analysis.ko.util.TokenInfoDictionaryBuilder.build(TokenInfoDictionaryBuilder.java:64)
[java] at org.apache.lucene.analysis.ko.util.DictionaryBuilder.build(DictionaryBuilder.java:30)
[java] at org.apache.lucene.analysis.ko.util.DictionaryBuilder.main(DictionaryBuilder.java:64)

BUILD FAILED
/Users/dongsik/git/develop_with_elk/lucene-solr/lucene/analysis/nori/build.xml:83: Java returned: 1

Total time: 8 seconds

@ylee-cs
Copy link

ylee-cs commented Mar 18, 2020

I am experiencing the same issue. It occurs when building a dictionary for unk.def. It is not clear that this issue is caused by nori or by mecab korean dictionary. However, I could rebuild kuromoji analyzer successfully, so I suspect that it is related to mecab korean dictionary. This is because nori is derived from kuromoji, and the two analyzers are similar to each other.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants