Question

You want to create a custom metric that returns the average length difference between predictions and references. Which code snippet correctly implements this?

Accepted Answer

class LengthDiffMetric(BaseEvalMetric):
    def evaluate(self, predictions, references):
        diffs = [abs(len(p) - len(r)) for p, r in zip(predictions, references)]
        return sum(diffs) / len(diffs)

Answer

class LengthDiffMetric(BaseEvalMetric):
    def evaluate(self, predictions, references):
        return len(predictions) - len(references)

Answer

class LengthDiffMetric(BaseEvalMetric):
    def evaluate(self, predictions, references):
        return max(len(predictions), len(references))

Answer

class LengthDiffMetric(BaseEvalMetric):
    def evaluate(self, predictions, references):
        diffs = [len(p) + len(r) for p, r in zip(predictions, references)]
        return sum(diffs)

You want to create a custom metric that returns the average length difference between predictions and references. Which code snippet correctly implements this?

Step 1: Calculate absolute length differences for each pair

Step 2: Compute average by summing differences and dividing by count

Final Answer:

Quick Check:

Want More Practice?