Does the EPO monitor the quality of responses provided by the Legal Interactive Platform (LIP)? Has quality deteriorated since it was first released for pilot trials?

Yes, the EPO monitors the quality of responses from the Legal Interactive Platform (LIP) over time.

We use pre-defined evaluation sets of question-answer pairs to detect errors, such as incorrect language or unresolved acronyms. We also check that previously fixed issues remain resolved.

These quality checks are performed before each update to ensure no decline in performance. If quality drops, the update is not released.

We don’t have any evidence that the quality of LIP responses has deteriorated since its initial pilot release.