[developers] LOGON batch translation profile flags
Eric Nichols
ericnichols79 at gmail.com
Wed Jun 3 09:38:52 CEST 2009
Greetings,
I am trying to pull the parse ID out of the result file from a
translation profile made with LOGON's batch script.
The number of analyses appears to be stored in parses's flags:
(:nanalyses . 5) ...
However, looking in results, I cannot find any field that appears in
the range of the number of analyses.
Looking in result's flags, I find the following, which I have
commented to my best understanding.
((:WA . 0.22222222) ;;; word acccuracy based on edit distance. see
$LOGONROOT/ntnu/bleu/wa.pl
(:TORBJOERN . 0.20808958) ;;; ntnu's bleu score implementation?
see $LOGONROOT/ntnu/bleu/bleu.pl
(:BLEU . 0.0) ;;; bleu score. see $LOGONROOT/nist/mteval-v11b.pl
(:NEVA . 0.0827) ;;; neva score. see $LOGONROOT/nist/neva.pl
(:RID . 6) ;;; result-id
(:TID . 2) ;;; transfer-id?
(:AID . 0) ;;; should be analysis (parse) id, but looks
like it is also result-id?
(:LNF . 0) ;;; norwegian->foreign GIZA++ probability?
(:LFN . 0) ;;; foreign->norwegian GIZA++ probability?
(:ASCORE . 6) ;;; analysis (parse) score?
(:UNKNOWN . 0) ;;; mark if unknown?
(:NMTRS . 13) ;;; number of MTRs
(:MTRS ZERO_ARG1_REL_NOUN_EF PROGRESSIVE_NOM_EF WA_D_REL_DITCH_EF
PRONOUN_Q UDEF-DEF_UDEF_A_Q MARK_OF_REL_NOUN_EF
KANKEI_S--CONNECTION_N_OF--EDICT-MTR
UNDOU_S_1--EXERCISE_V_1--MOSES-OMTR STD_PRON_N
RELATION-NOMINALIZATION_REL-MTR SONO-THAT_Q-MTR
NI_P+EXIST_V-HAVE_V-MTR VN-N_JF) ;; list of MTRs
(:TRATIO . 0.72727275) ;;; ???
(:TSCORE . -2550.76) ;;; transfer score
(:RSCORE . -7.4229403) ;;; realization (translation generation) score?
(:DISTANCE . 42) ;;; ???
(:PERPLEXITY . 768.14) ;;; ???
(:LM . 76.6818) ;;; language model score
(:RANK . 26) ;;; rank among translations
(:SCORE . -41.521675) ;;; ???
(:RATIO . 0.6666667) ;;; ???
)
It seems logical that :AID would contain the parse ID, but it's range
doesn't match the number of analyses
given in parse, and looking at the source in src/tsdb/mt.lisp, it
appears to be set to result-id:
src/tsdb/mt.lisp:237: for aid = (get-field :result-id result)
Could somebody let me know if the parse ID is stored during batch
translation, and if so, how I can get it from the profile?
Thanks,
Eric
More information about the developers
mailing list