Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

语料数据可否上传一下! #33

Open
jbcsimple opened this issue Nov 8, 2017 · 7 comments
Open

语料数据可否上传一下! #33

jbcsimple opened this issue Nov 8, 2017 · 7 comments

Comments

@jbcsimple
Copy link

语料数据可否上传一下!

@ansjsun
Copy link
Member

ansjsun commented Nov 21, 2017

用这个吧 https://pan.baidu.com/s/1jIy3YSY

@hexufeng
Copy link

为什么运行后debug跟踪,发现loadjavaModel方法中的
words = dis.readInt();
size = dis.readInt();
words和size都是负数呢?

@ansjsun 我一开始以为是你发的这个百度网盘的预料文件太大导致的,删掉只剩下一行也是如此唉。

@ansjsun
Copy link
Member

ansjsun commented Nov 29, 2017

我发的那个是语料。需要用语料训练成模型后再加载。不能直接加载语料

@hexufeng 你加载的是用java程序训练的model吗?
如果是google训练的model就用loadgooglemodel。如果是java生成的model就用loadjavamodel

@hexufeng
Copy link

谢谢回复!
我调用的是 loadjavamodel ,请问下这个加载的文件哪里有,可以给个链接吗?

@ansjsun
Copy link
Member

ansjsun commented Dec 14, 2017

loadjavamodel是你自己训练的model。不用下载。。根据语料生成模型后用loadjavamodel 加载

@tangjx
Copy link

tangjx commented Mar 13, 2018

训练上面给出的语料时候,报出java.lang.OutOfMemoryError: Java heap space,请问各位在测试的时候,jvm的参数是什么样的?

@zmj-ii
Copy link

zmj-ii commented Mar 13, 2018

@tangjx 需要将jvm的内存调大,参数是-Xmx10240m -Xms10240m,不过不建议用java版本的训练,我用1G的语料数据训练时,6G内存还是提示溢出了,而c语言版本训练时只是用了1G多的内存,java的内存要求太多了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants