Skip to content

After using a new pos model trained with froggen, frog still looks for the default one and fails #52

Closed

Description

@proycon

I trained a new model with froggen:

[[global]]

[[mblem]]
set=http://ilk.uvt.nl/folia/sets/frog-crmgys-lem
timblOpts=-a1 -w2 +vS
treeFile=froggen.tree

[[tagger]]
set=http://ilk.uvt.nl/folia/sets/frog-crmgys-cgn
settings=froggen.settings

[[NER]]
#this is not retrained but simply the one supplied by frog
settings="nergen.data.settings"
version=2.0
set="http://ilk.uvt.nl/folia/sets/frog-ner-nl"
known_ners=ners.known
max_ner_size=15

[[tokenizer]]
rulesFile=tokconfig-nld-historical

Note I adapted the folia set definitions here (although they don't exist for real yet)

But when running Frog with this new configuration, it still references the old CGN set and fails:

$ frog -c /home/proycon/work/nederlab-linguistic-enrichment/resources/frog-crmgys-cgn/frog.cfg 
--skip=mpca  --xmldir "." --threads 1 --nostdout --testdir input/ -x
...<snip>...
frog-:config read from: /home/proycon/work/nederlab-linguistic-enrichment/resources/frog-crmgys-cgn/frog.cfg                                                                                                          
frog-tok-:Initiating tokeniser...                                                                                                                               
frog-tok-:/home/proycon/work/nederlab-linguistic-enrichment/resources/frog-crmgys-cgn//tokconfig-nld-historical: version=0.2       
....<snip>....
frog-:Tue Jun 26 15:18:20 2018 Initialization done.                                                                                                                                                                                                            frog-:Tue Jun 26 15:18:20 2018 Frogging input/HuygensING-varia-1-1_db4093d6-079c-4787-b27b-188f55751c6a.folia.xml
frog-tok-:ucto: --filter=NO is automatically set. inputclass equals outputclass!                                                                                                                                                                              
frog-:Tue Jun 26 15:18:22 2018 process 4025 sentences                                                                                                              
terminate called after throwing an instance of 'folia::NoSuchAnnotation'                                                                                                                                                                                      
  what():  no such annotation: pos for set='http://ilk.uvt.nl/folia/sets/frog-mbpos-cgn'                                                                                   
                                                                                         
Program received signal SIGABRT, Aborted.                                                                                                                                                                                                                     
0x00007ffff203186b in raise () from /usr/lib/libc.so.6    

GDB Backtrace:

#0  0x00007ffff203186b in raise () from /usr/lib/libc.so.6                                                                                                                                                                                              [0/707]
#1  0x00007ffff201c40e in abort () from /usr/lib/libc.so.6     
#2  0x00007ffff2c1b44a in __gnu_cxx::__verbose_terminate_handler () at /build/gcc/src/gcc/libstdc++-v3/libsupc++/vterminate.cc:95                                                                                                                             
#3  0x00007ffff2c219d6 in __cxxabiv1::__terminate(void (*)()) () at /build/gcc/src/gcc/libstdc++-v3/libsupc++/eh_terminate.cc:47                                                                                                                              
#4  0x00007ffff2c209fa in __cxa_call_terminate (ue_header=ue_header@entry=0x555590547250) at /build/gcc/src/gcc/libstdc++-v3/libsupc++/eh_call.cc:54                                                                                                          
#5  0x00007ffff2c213d1 in __gxx_personality_v0 () at /build/gcc/src/gcc/libstdc++-v3/libsupc++/eh_personality.cc:676                                                                                                  
#6  0x00007ffff23c7373 in _Unwind_RaiseException_Phase2 () at /build/gcc/src/gcc/libgcc/unwind.inc:64                                                           
#7  0x00007ffff23c7bf5 in _Unwind_Resume () at /build/gcc/src/gcc/libgcc/unwind.inc:241                                                            
#8  0x00007ffff7b14d6d in __gnu_cxx::new_allocator<folia::PosAnnotation*>::~new_allocator (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/8.1.1/ext/new_allocator.h:86                                                                  
#9  std::allocator<folia::PosAnnotation*>::~allocator (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/8.1.1/bits/allocator.h:139                                                                                                        
#10 std::_Vector_base<folia::PosAnnotation*, std::allocator<folia::PosAnnotation*> >::_Vector_impl::~_Vector_impl (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/8.1.1/bits/stl_vector.h:88                                            
#11 std::_Vector_base<folia::PosAnnotation*, std::allocator<folia::PosAnnotation*> >::~_Vector_base (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/8.1.1/bits/stl_vector.h:287                                                         
#12 std::vector<folia::PosAnnotation*, std::allocator<folia::PosAnnotation*> >::~vector (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/8.1.1/bits/stl_vector.h:570                                                                     
#13 folia::FoliaElement::annotations<folia::PosAnnotation> (this=<optimized out>, s=...) at /home/proycon/lamachine-dev/include/libfolia/folia_impl.h:211                                                                                                     
#14 0x00007ffff7b4bf70 in folia::FoliaElement::annotation<folia::PosAnnotation> (st="http://ilk.uvt.nl/folia/sets/frog-mbpos-cgn", this=<optimized out>) at /home/proycon/lamachine-dev/include/libfolia/folia_impl.h:572                                     
#15 folia::FoliaImpl::annotation<folia::PosAnnotation> (st="http://ilk.uvt.nl/folia/sets/frog-mbpos-cgn", this=0x55558fbdd380) at /home/proycon/lamachine-dev/include/libfolia/folia_impl.h:573                                                               
#16 BaseTagger::extract_words_tags(std::vector<folia::Word*, std::allocator<folia::Word*> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > >&) () at tagger_base.cxx:230                      
#17 0x00007ffff7b5ab1e in NERTagger::Classify(std::vector<folia::Word*, std::allocator<folia::Word*> > const&) () at ner_tagger_mod.cxx:366                                                                                                                   
#18 0x00007ffff7aeb6a3 in FrogAPI::TestSentence(folia::Sentence*, TimerBlock&) [clone ._omp_fn.2] () at FrogAPI.cxx:577                                            
#19 0x00007ffff25dcd9c in GOMP_parallel_sections (fn=0x7ffff7aeb600 <FrogAPI::TestSentence(folia::Sentence*, TimerBlock&) [clone ._omp_fn.2]>, data=0x7fffffffc9c0, num_threads=1, count=3, flags=0) at /build/gcc/src/gcc/libgomp/sections.c:158             
#20 0x00007ffff7aeba13 in FrogAPI::TestSentence(folia::Sentence*, TimerBlock&) () at FrogAPI.cxx:567                                                                       
#21 0x00007ffff7aebfa9 in FrogAPI::FrogDoc(folia::Document&, bool) () at FrogAPI.cxx:1382
#22 0x00007ffff7af6a89 in FrogAPI::FrogFile(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::ostream&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) ()                 
    at FrogAPI.cxx:1499                                                                                                                                                                                            
#23 0x000055555555a978 in main () at Frog.cxx:631    
#24 0x00007ffff201e06b in __libc_start_main () from /usr/lib/libc.so.6

Activity

  1. kosloot commented on Jun 27, 2018

    @kosloot
    Collaborator

    Yeah, the string is hardcoded. That is even 'documented' in the ner_tagger_mod code :)

    // should come from the config!
    const string cgn_tagset  = "http://ilk.uvt.nl/folia/sets/frog-mbpos-cgn";
    

    The same problem arises (undocumented) in the Chunker code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions