Skip to content

test: add missing assertions for run functions - #1739

Closed
Dinesh-5445 wants to merge 1 commit into
openml:mainfrom
Dinesh-5445:fix/issue-1646-missing-assertions
Closed

Dinesh-5445 wants to merge 1 commit into
openml:mainfrom
Dinesh-5445:fix/issue-1646-missing-assertions

Conversation

@Dinesh-5445

Copy link
Copy Markdown

Metadata

Details

This PR adds the missing assertions requested in issue #1646 to tests/test_runs/test_run_functions.py.

The added assertions verify that:

  • The run task uses a Holdout estimation procedure.
  • Run parameter settings are populated.
  • The serialized trace contains data.
  • Runtime information (usercpu_time_millis) is present in the fold evaluations.

These assertions strengthen the existing tests by checking that the expected run metadata and artifacts are properly populated.

No new files or documentation were added, and no unrelated code was changed.

All pre-commit checks passed, including Ruff, Ruff format, mypy, and the repository validation hooks.

@AtharvaManale AtharvaManale left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fold_Evalution Runtime validation/assert

)

# todo: check if runtime is present
assert "usercpu_time_millis" in run.fold_evaluations

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

theres no need for this cause bellow _check_fold_timing_evaluations() function validates it.

@PGijsbers

Copy link
Copy Markdown
Collaborator

Hi, thanks for taking the time to contribute, but it seems like this is a duplicate of #1658. We'll move forward with that PR.

@PGijsbers PGijsbers closed this Oct 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[MNT] Add Missing Assertions to Run Function Tests

3 participants