Code-based scorers fail in online scoring rules with the error:
The following keys are not permitted {'_bt_internal_override_pagination_key'}
Even though the scorer tests successfully. This occurs when a code based scorer that was uploaded using an older Python SDK version that includes internal keys incompatible with the current runtime environment.
Upload the scorer again using the updated SDK version. The scorer code itself doesn’t need to change.
import braintrustproject = braintrust.projects.create(name="my-project")# Re-upload your existing scorer with the updated SDKproject.scorers.create( name="my-scorer", function=my_scorer_function)
