사용자 사전 최대 추가 개수가 어떻게 되나요?

Issue #22 new
JinWoo Park created an issue

안녕하세요.

약 13,000,000 개의 용어를 사용자 사전에 추가하려 하는데 아래와 같이 오류가 발생합니다.
사용자 사전 추가 최대 개수가 어떻게 되나요? 추가할 수 있는 방법이 있을런지요...
아래 로그를 첨부하오니 확인 부탁드립니다.

generating userdic...
nnp.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/nnp.csv ...
done!
jwp_nn_all_00.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_00.csv ...
done!
jwp_nn_all_01.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_01.csv ...
done!
jwp_nn_all_02.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_02.csv ...
done!
jwp_nn_all_03.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_03.csv ...
done!
jwp_nn_all_04.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_04.csv ...
done!
jwp_nn_all_05.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_05.csv ...
done!
jwp_nn_all_06.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_06.csv ...
done!
jwp_nn_all_07.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_07.csv ...
done!
jwp_nn_all_08.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_08.csv ...
done!
jwp_nn_all_09.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_09.csv ...
done!
jwp_nn_all_10.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/jwp_nn_all_10.csv ...
done!
person.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/person.csv ...
done!
place.csv
/jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../model.def is not a binary model. reopen it as text mode...
reading /jwp/mecab/mecab-ko-dic-2.1.1-20180720/tools/../user-dic/place.csv ...
done!
test -z "model.bin matrix.bin char.bin sys.dic unk.dic" || rm -f model.bin matrix.bin char.bin sys.dic unk.dic
/usr/local/libexec/mecab/mecab-dict-index -d . -o . -f UTF-8 -t UTF-8
reading ./unk.def ... 13
emitting double-array: 100% |###########################################|
reading ./XPN.csv ... 83
reading ./NNB.csv ... 140
reading ./Group.csv ... 3176
reading ./J.csv ... 416
reading ./XR.csv ... 3637
reading ./MAG.csv ... 14242
reading ./Inflect.csv ... 44820
reading ./NNG.csv ... 208524
reading ./Preanalysis.csv ... 5
reading ./user-jwp_nn_all_10.csv ... 807640
reading ./user-jwp_nn_all_08.csv ... 1300000
reading ./Place-station.csv ... 1145
reading ./Wikipedia.csv ... 36762
reading ./CoinedWord.csv ... 148
reading ./Person.csv ... 196459
reading ./NorthKorea.csv ... 3
reading ./user-jwp_nn_all_06.csv ... 1300000
reading ./user-jwp_nn_all_00.csv ... 1300000
reading ./user-jwp_nn_all_03.csv ... 1300000
reading ./user-nnp.csv ... 2
reading ./XSA.csv ... 19
reading ./ETM.csv ... 133
reading ./user-jwp_nn_all_07.csv ... 1300000
reading ./NNP.csv ... 2371
reading ./Place.csv ... 30303
reading ./EP.csv ... 51
reading ./Person-actor.csv ... 99230
reading ./NR.csv ... 482
reading ./EF.csv ... 1820
reading ./user-person.csv ... 1
reading ./Foreign.csv ... 11690
reading ./XSN.csv ... 124
reading ./user-jwp_nn_all_09.csv ... 1300000
reading ./VV.csv ... 7331
reading ./user-jwp_nn_all_02.csv ... 1300000
reading ./IC.csv ... 1305
reading ./NP.csv ... 342
reading ./Hanja.csv ... 125750
reading ./XSV.csv ... 23
reading ./user-jwp_nn_all_04.csv ... 1300000
reading ./VCP.csv ... 9
reading ./ETN.csv ... 14
reading ./user-place.csv ... 2
reading ./VCN.csv ... 7
reading ./VA.csv ... 2360
reading ./EC.csv ... 2547
reading ./MAJ.csv ... 240
reading ./Symbol.csv ... 16
reading ./MM.csv ... 453
reading ./user-jwp_nn_all_05.csv ... 1300000
reading ./user-jwp_nn_all_01.csv ... 1300000
reading ./Place-address.csv ... 19301
reading ./NNBC.csv ... 677
reading ./VX.csv ... 125
dictionary.cpp(472) [da.build(str.size(), const_cast<char **>(&str[0]), &len[0], &val[0], &progress_bar_darts) == 0] unkown error in building double-array
Makefile:501: 'model.bin' 타겟에 대한 명령이 실패했습니다
make: *** [model.bin] 오류 255

Comments (0)

  1. Log in to comment