Upreckon: problem.py annotate

annotate problem.py @ 89:3ae6cb69e4ef

Sample total is no longer printed if there are no samples

author	Oleg Oshmyan <chortos@inbox.lv>
date	Mon, 28 Feb 2011 15:10:40 +0000
parents	cd347cfca272
children	1fb319ec33af

rev	line source
77 69eadc60f4e2 Memory limit is now applied to the RSS when os.wait4 is available Oleg Oshmyan <chortos@inbox.lv> parents: 76 diff changeset	1 # Copyright (c) 2010-2011 Chortos-2 <chortos@inbox.lv>
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	2
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	3 from __future__ import division, with_statement
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	4
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	5 try:
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	6 from compat import *
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	7 import config, testcases
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	8 except ImportError:
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	9 import __main__
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	10 __main__.import_error(sys.exc_info()[1])
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	11 else:
85 741ae3391b61 Moved clock/time detection into platform-specific modules and testcases Oleg Oshmyan <chortos@inbox.lv> parents: 83 diff changeset	12 from __main__ import options
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	13
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	14 import os, re, sys
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	15
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	16 try:
75 007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	17 from collections import deque
007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	18 except ImportError:
007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	19 deque = list
007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	20
007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	21 try:
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	22 import signal
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	23 except ImportError:
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	24 signalnames = ()
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	25 else:
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	26 # Construct a cache of all signal names available on the current
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	27 # platform. Prefer names from the UNIX standards over other versions.
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	28 unixnames = frozenset(('HUP', 'INT', 'QUIT', 'ILL', 'ABRT', 'FPE', 'KILL', 'SEGV', 'PIPE', 'ALRM', 'TERM', 'USR1', 'USR2', 'CHLD', 'CONT', 'STOP', 'TSTP', 'TTIN', 'TTOU', 'BUS', 'POLL', 'PROF', 'SYS', 'TRAP', 'URG', 'VTALRM', 'XCPU', 'XFSZ'))
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	29 signalnames = {}
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	30 for name in dir(signal):
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	31 if re.match('SIG[A-Z]+$', name):
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	32 value = signal.__dict__[name]
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	33 if isinstance(value, int) and (value not in signalnames or name[3:] in unixnames):
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	34 signalnames[value] = name
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	35 del unixnames
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	36
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	37 __all__ = 'Problem', 'TestContext', 'test_context_end', 'TestGroup'
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	38
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	39 def strerror(e):
5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	40 s = getattr(e, 'strerror')
5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	41 if not s: s = str(e)
5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	42 return ' (%s%s)' % (s[0].lower(), s[1:]) if s else ''
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	43
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	44 class Cache(object):
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	45 def __init__(self, mydict):
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	46 self.__dict__ = mydict
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	47
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	48 class TestContext(object):
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	49 pass
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	50
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	51 test_context_end = object()
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	52
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	53 class TestGroup(TestContext):
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	54 __slots__ = 'points', 'case', 'log', 'correct', 'allcorrect', 'real', 'max', 'ntotal', 'nvalued', 'ncorrect', 'ncorrectvalued'
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	55
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	56 def __init__(self, points=None):
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	57 self.points = points
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	58 self.real = self.max = self.ntotal = self.nvalued = self.ncorrect = self.ncorrectvalued = 0
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	59 self.allcorrect = True
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	60 self.log = []
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	61
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	62 def case_start(self, case):
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	63 self.case = case
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	64 self.correct = False
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	65 self.ntotal += 1
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	66 if case.points:
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	67 self.nvalued += 1
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	68
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	69 def case_correct(self):
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	70 self.correct = True
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	71 self.ncorrect += 1
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	72 if self.case.points:
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	73 self.ncorrectvalued += 1
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	74
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	75 def case_end(self):
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	76 self.log.append((self.case, self.correct))
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	77 del self.case
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	78 if not self.correct:
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	79 self.allcorrect = False
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	80
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	81 def score(self, real, max):
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	82 self.real += real
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	83 self.max += max
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	84
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	85 def end(self):
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	86 if not self.allcorrect:
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	87 self.real = 0
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	88 if self.points is not None and self.points != self.max:
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	89 max, weighted = self.points, self.real * self.points / self.max if self.max else 0
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	90 before_weighting = ' (%g/%g before weighting)' % (self.real, self.max)
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	91 else:
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	92 max, weighted = self.max, self.real
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	93 before_weighting = ''
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	94 say('Group total: %d/%d tests, %g/%g points%s' % (self.ncorrect, self.ntotal, weighted, max, before_weighting))
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	95 # No real need to flush stdout, as it will anyway be flushed in a moment,
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	96 # when either the problem total or the next test case's ID is printed
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	97 return weighted, max, self.log
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	98
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	99 class Problem(object):
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	100 __slots__ = 'name', 'config', 'cache', 'testcases'
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	101
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	102 def __init__(prob, name):
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	103 if not isinstance(name, basestring):
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	104 # This shouldn't happen, of course
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	105 raise TypeError('Problem() argument 1 must be string, not ' + type(name).__name__)
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	106 prob.name = name
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	107 prob.config = config.load_problem(name)
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	108 prob.cache = Cache({'padoutput': 0})
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	109 prob.testcases = testcases.load_problem(prob)
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	110
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	111 # TODO
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	112 def build(prob):
ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	113 raise NotImplementedError
16 f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	114
f2279b7602d3 Initial 2.00 commit Oleg Oshmyan <chortos@inbox.lv> parents: diff changeset	115 def test(prob):
23 c1f52b5d80d6 Compatibility and bug fixes Oleg Oshmyan <chortos@inbox.lv> parents: 22 diff changeset	116 case = None
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	117 try:
75 007f7eb6fb2b The test context stack is now a deque. Oleg Oshmyan <chortos@inbox.lv> parents: 74 diff changeset	118 contexts = deque((TestGroup(),))
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	119 for case in prob.testcases:
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	120 if case is test_context_end:
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	121 real, max, log = contexts.pop().end()
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	122 for case, correct in log:
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	123 contexts[-1].case_start(case)
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	124 if correct:
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	125 contexts[-1].case_correct()
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	126 contexts[-1].case_end()
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	127 contexts[-1].score(real, max)
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	128 continue
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	129 elif isinstance(case, TestContext):
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	130 contexts.append(case)
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	131 continue
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	132 contexts[-1].case_start(case)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	133 granted = 0
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	134 id = str(case.id)
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	135 if case.isdummy:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	136 id = 'sample ' + id
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	137 say('%*s: ' % (prob.cache.padoutput, id), end='')
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	138 sys.stdout.flush()
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	139 try:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	140 granted = case(lambda: (say('%7.3f%s s, ' % (case.time_stopped - case.time_started, case.time_limit_string), end=''), sys.stdout.flush()))
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	141 except testcases.CanceledByUser:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	142 verdict = 'canceled by the user'
82 06356af50bf9 Finished testcases reorganization and CPU time limit implementation Oleg Oshmyan <chortos@inbox.lv> parents: 77 diff changeset	143 except testcases.WallTimeLimitExceeded:
06356af50bf9 Finished testcases reorganization and CPU time limit implementation Oleg Oshmyan <chortos@inbox.lv> parents: 77 diff changeset	144 verdict = 'wall-clock time limit exceeded'
06356af50bf9 Finished testcases reorganization and CPU time limit implementation Oleg Oshmyan <chortos@inbox.lv> parents: 77 diff changeset	145 except testcases.CPUTimeLimitExceeded:
06356af50bf9 Finished testcases reorganization and CPU time limit implementation Oleg Oshmyan <chortos@inbox.lv> parents: 77 diff changeset	146 verdict = 'CPU time limit exceeded'
77 69eadc60f4e2 Memory limit is now applied to the RSS when os.wait4 is available Oleg Oshmyan <chortos@inbox.lv> parents: 76 diff changeset	147 except testcases.MemoryLimitExceeded:
69eadc60f4e2 Memory limit is now applied to the RSS when os.wait4 is available Oleg Oshmyan <chortos@inbox.lv> parents: 76 diff changeset	148 verdict = 'memory limit exceeded'
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	149 except testcases.WrongAnswer:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	150 e = sys.exc_info()[1]
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	151 if e.comment:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	152 verdict = 'wrong answer (%s)' % e.comment
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	153 else:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	154 verdict = 'wrong answer'
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	155 except testcases.NonZeroExitCode:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	156 e = sys.exc_info()[1]
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	157 if e.exitcode < 0:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	158 if sys.platform == 'win32':
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	159 verdict = 'terminated with error 0x%X' % (e.exitcode + 0x100000000)
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	160 elif -e.exitcode in signalnames:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	161 verdict = 'terminated by signal %d (%s)' % (-e.exitcode, signalnames[-e.exitcode])
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	162 else:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	163 verdict = 'terminated by signal %d' % -e.exitcode
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	164 else:
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	165 verdict = 'non-zero return code %d' % e.exitcode
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	166 except testcases.CannotStartTestee:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	167 verdict = 'cannot launch the program to test%s' % strerror(sys.exc_info()[1].upstream)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	168 except testcases.CannotStartValidator:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	169 verdict = 'cannot launch the validator%s' % strerror(sys.exc_info()[1].upstream)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	170 except testcases.CannotReadOutputFile:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	171 verdict = 'cannot read the output file%s' % strerror(sys.exc_info()[1].upstream)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	172 except testcases.CannotReadInputFile:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	173 verdict = 'cannot read the input file%s' % strerror(sys.exc_info()[1].upstream)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	174 except testcases.CannotReadAnswerFile:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	175 verdict = 'cannot read the reference output file%s' % strerror(sys.exc_info()[1].upstream)
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	176 except testcases.TestCaseNotPassed:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	177 verdict = 'unspecified reason [this may be a bug in test.py]%s' % strerror(sys.exc_info()[1])
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	178 #except Exception:
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	179 # verdict = 'unknown error [this may be a bug in test.py]%s' % strerror(sys.exc_info()[1])
21 ec6f1a132109 A pretty usable version Oleg Oshmyan <chortos@inbox.lv> parents: 16 diff changeset	180 else:
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	181 try:
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	182 granted, comment = granted
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	183 except TypeError:
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	184 comment = ''
2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	185 else:
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	186 if comment:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	187 comment = ' (%s)' % comment
24 c23d81f4a1a3 Score returned by TestCase.__call__() is now normalized to 0..1 Oleg Oshmyan <chortos@inbox.lv> parents: 23 diff changeset	188 if granted >= 1:
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	189 contexts[-1].case_correct()
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	190 verdict = 'OK' + comment
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	191 elif not granted:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	192 verdict = 'wrong answer' + comment
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	193 else:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	194 verdict = 'partly correct' + comment
26 5bbb68833868 Output text improvements Oleg Oshmyan <chortos@inbox.lv> parents: 24 diff changeset	195 granted *= case.points
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	196 say('%g/%g, %s' % (granted, case.points, verdict))
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	197 contexts[-1].case_end()
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	198 contexts[-1].score(granted, case.points)
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	199 weighted = contexts[0].real * prob.config.taskweight / contexts[0].max if contexts[0].max else 0
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	200 before_weighting = valued = ''
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	201 if prob.config.taskweight != contexts[0].max:
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	202 before_weighting = ' (%g/%g before weighting)' % (contexts[0].real, contexts[0].max)
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	203 if contexts[0].nvalued != contexts[0].ntotal:
76 0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	204 valued = ' (%d/%d valued)' % (contexts[0].ncorrectvalued, contexts[0].nvalued)
0e5ae28e0b2b Points are now weighted on a test context basis Oleg Oshmyan <chortos@inbox.lv> parents: 75 diff changeset	205 say('Problem total: %d/%d tests%s, %g/%g points%s' % (contexts[0].ncorrect, contexts[0].ntotal, valued, weighted, prob.config.taskweight, before_weighting))
39 2b459f9743b4 Test groups are now supported Oleg Oshmyan <chortos@inbox.lv> parents: 26 diff changeset	206 sys.stdout.flush()
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	207 return weighted, prob.config.taskweight
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	208 finally:
83 37c4ad87583c Several small fixes Oleg Oshmyan <chortos@inbox.lv> parents: 82 diff changeset	209 if options.erase and (not prob.config.stdio or case and
37c4ad87583c Several small fixes Oleg Oshmyan <chortos@inbox.lv> parents: 82 diff changeset	210 (case.validator and not callable(case.validator))):
22 f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	211 for var in 'in', 'out':
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	212 name = getattr(prob.config, var + 'name')
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	213 if name:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	214 try:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	215 os.remove(name)
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	216 except Exception:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	217 pass
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	218 if case.validator and not callable(case.validator):
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	219 if prob.config.ansname:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	220 try:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	221 os.remove(prob.config.ansname)
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	222 except Exception:
f07b7a431ea6 Further 2.00 work Oleg Oshmyan <chortos@inbox.lv> parents: 21 diff changeset	223 pass

Mercurial > ~astiob > upreckon > hgweb

annotate problem.py @ 89:3ae6cb69e4ef