The QuEst project is an open source quality estimation project. QuEst is supported in Okapi through the Okapi QuEst Plugin. Ocelot was used as part of the project to help human reviewers measure the effectiveness of the estimates.
Human reviewers in the project used a custom Rules file that contains only quick-add rules. They were then given a set of segments that had previously had their quality assessed automatically by QuEst. The reviewers performed a human review, adding LQI data to segments for each issue they encountered. The resulting ITS-annotated XLIFF files are collected and used to produce quality measurements that can be correlated with the results of QuEst.