<html><body bgcolor="#FFFFFF"><div>hi eric,</div><div><br></div><div>:quantum specifies how much time a client processor can spend processing one item before [incr tsdn()] will force-terminate it. with such a large transfer grammar you're possibly seeing many more :quantum time-outs, which may account for the drop in coverage. could you inspect the fan-out file to quantify which process(es) time(s) out frequently? however, allowing transfer more time might not help much: the process is an exhaustive breadth-first search with very limited ambiguity packing. lots more transfer ambiguity inevitably leads to exponential growth in combinatorics :-(.</div><div> </div><div>as regards the fan-out beam, there've been no changes in quite some time, and five sounds like the right default setting. it should work to use the --limit option to the ‘batch’ script to change the branching factor. in fact, the following allows setting it per component too:</div><div><br></div><div> ./batch --limit 2:3:4:10</div><div><br></div><div>the first numbers three control parsing, transfer, and generation. the last number determines how many outputs are retained after global re-ranking.</div><div><br></div><div>good luck with your runs :-), oe</div><div><br></div><div><br>On Aug 4, 2009, at 5:19 AM, Eric Nichols <<a href="mailto:ericnichols79@gmail.com">ericnichols79@gmail.com</a>> wrote:<br><br></div><div></div><blockquote type="cite"><div><div style="word-wrap:break-word"><div><span style="font-family:Helvetica;font-size:medium">Greetings,<div><br></div><div>I have a few follow-up questions about the current LOGON Barcelona snapshot.</div>
<div>A little background: I am working on cleaning up automatically acquired MTRs</div><div>using feedback cleaning -- calculating the individual BLEU (or NEVA) score</div><div>contribution of an individual rule and throwing away those with negative</div>
<div>contributions -- so I am running LOGON with over 100K of translation rules.</div><div><br></div><div>As I mentioned in my prior mail, translating with such a large number of rules</div><div>can cause LOGON to time out with its default wait settings. I got LOGON to</div>
<div>successfully load my large set of MTRs by setting wait to 3000. This appeared</div><div>to get translation working, but our transfer coverage dropped from 45% to 30%</div><div>(seev <a href="http://wiki.delph-in.net/moin/MtJaenTanaka" target="_blank"><a href="http://wiki.delph-in.net/moin/MtJaenTanaka">http://wiki.delph-in.net/moin/MtJaenTanaka</a></a>). Looking at the fans, I noticed</div>
<div>that the PVM client seems to be exiting a lot. Is there any other setting that controls</div><div>timeouts. Francis asked about the difference between wait and quantum on the</div><div>list earlier. Is that relevant here?</div>
<div><br></div><div><div>[11:45:26] (1000020) |あなた を 見 て いる と 私 は あなた の お父さん を 思い出し ます 。| --- 5 (0.05|0.04:0.05 s) <79</div><div>:1125> {1718:980} (8.6m).</div><div>|</div><div>|-[920.87] # 0 {10.00} --- error: PVM client exit <4000d>.</div>
<div>|</div><div>|-[1819.40] # 1 {10.00} --- error: PVM client exit <40017>.</div><div>||-[2726.81] # 2 {9.00} --- error: PVM client exit <4001b>.</div><div>|</div><div>|-[3635.84] # 3 {9.00} --- error: PVM client exit <4001f>.</div>
<div>|</div><div>|-[4549.08] # 4 {8.00} --- error: PVM client exit <40023>.</div><div>|</div><div>|< |あなた を 見 て いる と 私 は あなた の お父さん を 思い出し ます 。| (1000020) --- 5 x 0 x 0 = 0</div><div>|@ |You remind me of your father.|</div>
<div>|= 3:0 of 3 {100.0+0.0}; 2:0 of 3:0 {66.7 0.0}; 2:0 of 2:0 {100.0 0.0} @ 2 of 3 {66.7} <0.05 0.08|0.09 0.13>.</div><br></div><div>Also, I noticed that in the fan now, only 5 of the translations are listed at the end of</div>
<div>a translation block with the source and reference sentence. Is this an intentional</div><div>change or a regression? Does it effect how the NEVA and oracles are computed?</div><div><br></div><div>Eric</div><div><br>
</div>
<div><div>[21:08:46] (1002140) |彼女 は 彼 に 間違っ た 印象 を 抱い た 。| --- 5 (0.02|0.01:0.02 s) <42:450> {631:480} (5.0m).</div><div>|</div><div>|-[34.78] # 0 {5.00} --- 30 (34.25:12.46|0.00:0.00 s) <:608> (111m 9.4g 104k= 9.5g) [1].</div>
<div>| |</div><div>| |-[38.83] # 0 {-816.20} --- (3.52|3.52 s) <198:4095> {17613:3586} (48m 4.1g 0= 4.1g) [0].</div><div>| |</div><div>| |-[42.88] # 1 {-816.20} --- (3.73|3.73 s) <198:4095> {17613:3586} (48m 4.1g 0= 4.1g) [0].</div>
<div>| |</div><div>| |-[48.95] # 2 {-927.81} --- (4.96:1.56|4.96 s) <178:4031> {17469:3538} (46m 3.9g 0= 3.9g) [1].</div><div>| |</div><div>| |-[53.00] # 3 {-927.81} --- (3.41|3.41 s) <178:4031> {17469:3538} (46m 3.9g 0= 3.9g) [0].</div>
<div>| |</div><div>| |-[55.80] # 4 {-1045.05} --- 4 (2.59|0.00:2.59 s) <192:3043> {12339:2695} (38m 2.8g 0= 2.8g) [0].</div><div>| | |She bore an impression that was mistaken in him.| {-71.88|1.01|22.89|0.00|0.00} <0.08></div>
<div>| | |She bore an impression that was mistaken at him.| {-74.21|0.39|22.89|0.00|0.00} <0.08></div><div>| | |She bore an impression, that was mistaken on him.| {-70.18|0.12|22.89|0.00|0.00} <0.08></div>
<div>| | |She bore an impression that was mistaken on him.| {-73.60|0.08|22.89|0.00|0.00} <0.08></div><div>|</div><div>|-[58.18] # 1 {5.00} --- error: unknown transfer predicates: |"ja:rel_p_rel"|.</div>
<div>|</div><div>|-[58.24] # 2 {5.00} --- error: unknown transfer predicates: |"ja:rel_p_rel"|.</div><div>|</div><div>|-[116.81] # 3 {5.00} --- 30 (57.78:36.29|0.00:0.00 s) <:608> (111m 9.4g 0= 9.5g) [2].</div>
<div>| |</div><div>| |-[120.86] # 0 {-800.41} --- 3 (2.89|0.00:2.89 s) <198:3537> {15972:3107} (43m 3.3g 0= 3.3g) [0].</div><div>| | |She bore a general impression that was mistaken in him.| {-77.55|-1.13|33.33|0.00|0.00} <0.10></div>
<div>| | |She bore a general impression that was mistaken on him.| {-79.29|-1.83|33.33|0.00|0.00} <0.10></div><div>| | |She bore a general impression that was mistaken at him.| {-79.91|-2.06|33.33|0.00|0.00} <0.10></div>
<div>| |</div><div>| |-[127.21] # 1 {-800.41} --- 3 (4.39:1.51|0.00:4.39 s) <198:3537> {15972:3107} (43m 3.3g 0= 3.3g) [1].</div><div>| | |She bore a general impression that was incorrect in him.| {-78.64|-1.13|33.33|0.00|0.00} <0.10></div>
<div>| | |She bore a general impression that was incorrect on him.| {-80.99|-1.83|33.33|0.00|0.00} <0.10></div><div>| | |She bore a general impression that was incorrect at him.| {-79.33|-2.06|33.33|0.00|0.00} <0.10></div>
<div>| |</div><div>| |-[132.61] # 2 {-915.38} --- 3 (2.86|0.00:2.86 s) <178:3377> {15828:2963} (41m 3.1g 0= 3.2g) [0].</div><div>| | |She hugged a general impression that was mistaken in him.| {-79.99|-1.40|33.33|0.00|0.00} <0.10></div>
<div>| | |She hugged a general impression that was mistaken on him.| {-81.73|-2.10|33.33|0.00|0.00} <0.10></div><div>| | |She hugged a general impression that was mistaken at him.| {-82.34|-2.33|33.33|0.00|0.00} <0.10></div>
<div>| |</div><div>| |-[137.37] # 3 {-915.38} --- 3 (2.87|0.00:2.87 s) <178:3377> {15828:2963} (41m 3.1g 0= 3.2g) [0].</div><div>| | |She hugged a general impression that was incorrect in him.| {-81.07|-1.40|33.33|0.00|0.00} <0.10></div>
<div>| | |She hugged a general impression that was incorrect on him.| {-83.42|-2.10|33.33|0.00|0.00} <0.10></div><div>| | |She hugged a general impression that was incorrect at him.| {-81.77|-2.33|33.33|0.00|0.00} <0.10></div>
<div>| |</div><div>| |-[141.44] # 4 {-1014.13} --- 4 (2.33|0.00:2.33 s) <192:2863> {12054:2560} (36m 2.4g 0= 2.5g) [0].</div><div>| | |She bore an impression that was mistaken in him.| {-71.88|1.72|22.89|0.00|0.00} <0.08></div>
<div>| | |She bore an impression that was mistaken on him.| {-73.60|1.02|22.89|0.00|0.00} <0.08></div><div>| | |She bore an impression that was mistaken at him.| {-74.21|0.79|22.89|0.00|0.00} <0.08></div>
<div>
| | |She bore an impression which was mistaken on him.| {-70.82|-0.32|22.89|0.00|0.00} <0.08></div><div>|</div><div>|-[143.53] # 4 {4.00} --- error: unknown transfer predicates: |"ja:_machigau_v_1_rel"|.</div>
<div>|</div><div>|< |彼女 は 彼 に 間違っ た 印象 を 抱い た 。| (1002140) --- 5 x 60 x 20 = 17 [20]</div><div>|@ |She got a false impression of him.|</div><div>|> |She bore an impression that was mistaken in him.| {7.61e-1} <0.08> (3:4:0).</div>
<div>|> |She bore an impression, that was mistaken on him.| {7.60e-1} <0.08> (0:4:2).</div><div>|> |She bore an impression which was mistaken on him.| {7.51e-1} <0.08> (3:4:3).</div><div>|> |She bore an impression that was mistaken on him.| {6.79e-1} <0.08> (3:4:1).</div>
<div>|> |She bore a general impression that was mistaken in him.| {6.51e-1} <0.10> (3:0:0).</div><div>|= 49:0 of 65 {75.4+0.0}; 20:0 of 49:0 {40.8 0.0}; 10:0 of 20:0 {50.0 0.0} @ 10 of 65 {15.4} <0.01 0.09|0.03 0.20>.</div>
</div></span></div></div>
</div></blockquote></body></html>