Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add benchmarks #164

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions DESCRIPTION
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ Imports:
bbotk,
checkmate,
data.table,
gt,
here,
htmltools,
miesmuschel,
mlr3batchmark,
Expand Down
7 changes: 6 additions & 1 deletion mlr-org/_quarto.yml
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,12 @@ website:
- fselectors.qmd
- resources.qmd
- book.qmd
- benchmark.qmd
- text: "Benchmarks"
menu:
- benchmarks_mlr3.qmd
- benchmarks_mlr3tuning.qmd
- benchmarks_mlr3fselect.qmd
- benchmarks_paradox.qmd
- gallery.qmd
- team.qmd
- text: "More"
Expand Down
2 changes: 2 additions & 0 deletions mlr-org/_setup.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,6 @@ library(mlr3misc)
library(htmltools)
library(data.table)
library(reactable)

here::i_am("mlr-org/_setup.qmd")
```
5 changes: 0 additions & 5 deletions mlr-org/benchmark.qmd

This file was deleted.

265 changes: 265 additions & 0 deletions mlr-org/benchmark_results/mlr3_benchmark_memory.csv

Large diffs are not rendered by default.

265 changes: 265 additions & 0 deletions mlr-org/benchmark_results/mlr3_benchmark_runtime.csv

Large diffs are not rendered by default.

577 changes: 577 additions & 0 deletions mlr-org/benchmark_results/mlr3_object_size.csv

Large diffs are not rendered by default.

287 changes: 287 additions & 0 deletions mlr-org/benchmark_results/mlr3_resample_memory.csv

Large diffs are not rendered by default.

145 changes: 145 additions & 0 deletions mlr-org/benchmark_results/mlr3_resample_result_memory.csv

Large diffs are not rendered by default.

145 changes: 145 additions & 0 deletions mlr-org/benchmark_results/mlr3_resample_result_runtime.csv

Large diffs are not rendered by default.

287 changes: 287 additions & 0 deletions mlr-org/benchmark_results/mlr3_resample_runtime.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3fselect_fselect_memory.csv

Large diffs are not rendered by default.

148 changes: 148 additions & 0 deletions mlr-org/benchmark_results/mlr3fselect_fselect_nested_memory.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3fselect_fselect_nested_runtime.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3fselect_fselect_runtime.csv

Large diffs are not rendered by default.

841 changes: 841 additions & 0 deletions mlr-org/benchmark_results/mlr3fselect_object_size.csv

Large diffs are not rendered by default.

841 changes: 841 additions & 0 deletions mlr-org/benchmark_results/mlr3tuning_object_size.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3tuning_tune_memory.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3tuning_tune_nested_memory.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3tuning_tune_nested_runtime.csv

Large diffs are not rendered by default.

155 changes: 155 additions & 0 deletions mlr-org/benchmark_results/mlr3tuning_tune_runtime.csv

Large diffs are not rendered by default.

13 changes: 13 additions & 0 deletions mlr-org/benchmark_results/paradox_object_size.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
set_size,renv_project,object,size,serialized_size,k
5,paradox/default/snapshots/snapshot_2023_03_17,param_set,1.530536,2.48864,1.62599246277121
5,paradox/default/snapshots/snapshot_2024_06_11,param_set,0.049664,0.059264,1.19329896907217
5,paradox/default/snapshots/snapshot_2024_07_09,param_set,0.04984,0.059952,1.20288924558587
5,paradox/default/snapshots/snapshot_2024_07_30,param_set,0.049696,0.059296,1.19317450096587
50,paradox/default/snapshots/snapshot_2023_03_17,param_set,1.838288,10.561952,5.74553715195878
50,paradox/default/snapshots/snapshot_2024_06_11,param_set,0.066848,0.076448,1.14360938247966
50,paradox/default/snapshots/snapshot_2024_07_09,param_set,0.059824,0.077136,1.28938218775074
50,paradox/default/snapshots/snapshot_2024_07_30,param_set,0.066848,0.076448,1.14360938247966
500,paradox/default/snapshots/snapshot_2023_03_17,param_set,4.916872,91.295552,18.5678114053
500,paradox/default/snapshots/snapshot_2024_06_11,param_set,0.239648,0.249248,1.0400587528375
500,paradox/default/snapshots/snapshot_2024_07_09,param_set,0.160624,0.249936,1.55603147723877
500,paradox/default/snapshots/snapshot_2024_07_30,param_set,0.239648,0.249248,1.0400587528375
559 changes: 559 additions & 0 deletions mlr-org/benchmark_results/paradox_param_set_runtime.csv

Large diffs are not rendered by default.

Loading
Loading