What's Changed

• FIX various bugs on HTML display by @tomMoral in #904
• Doc clean up by @tomMoral in #905
• Bump sigstore/gh-action-sigstore-python from 3.2.0 to 3.3.0 by @dependabot[bot] in #908
• Bump codecov/codecov-action from 5 to 6 by @dependabot[bot] in #909
• ENH add config validation step to prevent silent config failures by @tomMoral in #910
• adding API helper for merge by @DamienLesens in #916
• ENH add benchopt prepare to run dataset preparation operations by @tomMoral in #912
• No-op if Benchmark initialized with Benchmark by @DamienLesens in #917
• ENH improve mpl display for boxplots by @etyl in #913
• FIX plot only numeric vals for boxplots by @etyl in #921
• Fix slurm time by @tomMoral in #919
• ENH new boxplot metadata by @etyl in #920
• Bump conda-incubator/setup-miniconda from 3 to 4 by @dependabot[bot] in #922
• CI fix julia-forge prefix.dev repo link by @tomMoral in #925
• ENH add plot to display grid of images by @tomMoral in #923
• CLN save results extension handeling by @tomMoral in #926
• DOC add button to download example benchmarks by @tomMoral in #927
• MNT use base image for circleci by @etyl in #930
• FIX caching save final results by @tomMoral in #931
• ENH grid metadata option for mpl by @etyl in #928
• ENH new options for scatter plots by @etyl in #932
• ENH parallelize reps by @etyl in #860
• DOC refactoring doc by @tomMoral in #933
• Fix mixed types columns parquet by @tomMoral in #934
• Fix sampling strategy inheritance by @tomMoral in #936
• RELEASE 1.9.1 by @tomMoral in #937

New Contributors

• @DamienLesens made their first contribution in #916

Full Changelog: 1.9.0...1.9.1

What's Changed

• FIX: remove pip egg by @etyl in #880
• ENH: add minimize flag for stopping criterion by @etyl in #878
• FIX: scale option for barchart by @etyl in #882
• FIX: use conda-forge by default by @etyl in #879
• ENH: add minimize option for barchart by @etyl in #881
• FIX: bar-chart minimize objective by @etyl in #883
• MNT circleCI fix by @etyl in #886
• ENH better control for random seed by @etyl in #837
• Release 1.8.1 by @etyl in #888
• TST add test parameters for test dataset by @tomMoral in #889
• ENH: specify python version by @etyl in #885
• CLN remove non-working options+clean recreate by @tomMoral in #891
• Bump actions/upload-artifact from 6 to 7 by @dependabot[bot] in #893
• Bump actions/download-artifact from 7 to 8 by @dependabot[bot] in #894
• FIX check_test fixture request by @tomMoral in #895
• ENH add 'benchopt merge' to gather results by @tomMoral in #892
• ENH add option --hub to benchopt publish to publish on huggingface hub by @tomMoral in #896
• Fix plotting boxplot by @tomMoral in #898
• DOC improve get_started guide by @tomMoral in #899
• TST separate cli tests+fix bugs by @tomMoral in #900
• Fix n rep display by @tomMoral in #901
• RELEASE 1.9.0 by @tomMoral in #902

Full Changelog: 1.8.1...1.9.0

What's Changed

• FIX download data by @tomMoral in #821
• TST allow skiping any test in benchopt test by @tomMoral in #801
• DOC add dropdown switch for documentation version by @tomMoral in #822
• CI fix broken install of conda due to existing directory in cache by @lionelkusch in #823
• CI update the github workflow and add dependabot by @lionelkusch in #787
• Bump actions/checkout from 3 to 5 by @dependabot[bot] in #825
• Bump codecov/codecov-action from 4 to 5 by @dependabot[bot] in #827
• Bump conda-incubator/setup-miniconda from 2 to 3 by @dependabot[bot] in #828
• Bump actions/setup-python from 1 to 6 by @dependabot[bot] in #826
• Fix the broken link in the README by @lionelkusch in #829
• CI no need to run tests twice anymore by @tomMoral in #830
• Fix n repetitions by @tomMoral in #831
• FIX: split sys info for numpy in parquet file by @etyl in #834
• FIX parse single line in config by @etyl in #833
• Fix backslash parsing by @etyl in #835
• ENH extend parallel backend configuration by @tomMoral in #673
• CLN simplify patch_import by @tomMoral in #839
• FIX benchopt test no pytest by @tomMoral in #838
• Fix solver not installed parsing by @tomMoral in #844
• Fix ast parsing no solver by @tomMoral in #846
• CLI improve reporting by @tomMoral in #847
• FIX result_artifact path in circleCI by @tomMoral in #850
• ENH custom plots by @etyl in #842
• ENH solver specific slurm config by @tomMoral in #848
• FIX working legend and backward compat by @tomMoral in #851
• MNT move to pyproject.toml configuration by @tomMoral in #855
• ENH new custom plots by @etyl in #852
• Bump sigstore/gh-action-sigstore-python from 3.0.0 to 3.1.0 by @dependabot[bot] in #858
• DOC set submitit as default distributed backend by @tomMoral in #856
• Bump actions/download-artifact from 4 to 6 by @dependabot[bot] in #859
• FIX legend rendering with curve description by @tomMoral in #861
• TST clearer failure on no config run+allow passing test_config solver by @tomMoral in #864
• FIX conda install in CircleCI by @tomMoral in #865
• Bump actions/checkout from 5 to 6 by @dependabot[bot] in #863
• Doc examples run by @tomMoral in #841
• FIX aspect ratios for HTML plots on mobile devices by @Copilot in #867
• Bump actions/upload-artifact from 5 to 6 by @dependabot[bot] in #868
• Bump actions/download-artifact from 6 to 7 by @dependabot[bot] in #869
• Bump sigstore/gh-action-sigstore-python from 3.1.0 to 3.2.0 by @dependabot[bot] in #870
• FIX various improvement to custom plot API by @tomMoral in #871
• FEAT: table plot by @etyl in #866
• ENH add filenames of objective/solver/dataset to output parquet by @tomMoral in #873
• DOC: custom plot guide by @etyl in #872
• FIX test exit code by @tomMoral in #875
• ENH improve compatibility with benchmarks ml (api/doc/tests) by @tomMoral in #874
• RELEASE 1.8.0 by @tomMoral in #876

New Contributors

• @dependabot[bot] made their first contribution in #825
• @etyl made their first contribution in #834
• @Copilot made their first contribution in #867

Full Changelog: 1.7.0...1.8.0

What's Changed

• CI bump python versions by @tomMoral in #760
• ENH replace channel specification from : to :: to accomodate url by @tomMoral in #758
• FIX default data_home+more test cases by @tomMoral in #761
• FIX rename boxplot_chart->boxplot in result.js by @tomMoral in #757
• DOC add missing what's new entries by @tomMoral in #762
• Fix skip objective by @tomMoral in #763
• added Windows compatibility in shell manipulation by @wassimmazouz in #717
• DOC add website reference by @wassimmazouz in #764
• FIX: use correct function in "benchopt info" by @paquiteau in #768
• FIX channel specified with one colon instead of 2 by @tomMoral in #770
• FIX installing pip dependencies in conda environment by @tomMoral in #772
• Add parameters as columns in result file by @Melvin-klein in #703
• CI update to use miniforge instead of mambaforge in install by @tomMoral in #781
• FIX test updated to match outputs from mamba and conda by @tomMoral in #783
• FIX install in current env by @tomMoral in #779
• Fix result page css by @Melvin-klein in #790
• FIX remove unused globals by @tomMoral in #792
• Fix missing colors on benchmark plots by @Melvin-klein in #791
• API support requirements as dict by @mathurinm in #793
• ENH allow objective to produce multiple entries at once by @tomMoral in #778
• FIX slow parallel run when large parameter space by @tomMoral in #799
• ENH make benchopt module executable by @rflamary in #685
• FIX ignored --minimal parameter in benchopt install by @lionelkusch in #786
• ENH add --no-cache option to disable caching by @tomMoral in #800
• FIX cache miss when changing the order of the solvers by @tomMoral in #806
• API update slurm executor to limit the number of parallel jobs. by @Jad-yehya in #775
• MTN update action-wait-for-check by @tomMoral in #810
• DOC add SLOPE benchmark to readme by @jolars in #803
• [ENH] Add solver-specific overrides for SLURM executor configuration by @pbarbarant in #805
• FIX slurm_config can contain dict by @tomMoral in #813
• CLN rename output->terminal in runner by @tomMoral in #814
• FIX get_data_path in parallel run+improve serialization by @tomMoral in #815
• FIX move run_statistics.extend inside try block (WIP) by @jolars in #809
• FIX upgrade deprecated rpy2 convertion system by @tomMoral in #818
• Fix solver finish by @tomMoral in #817
• ENH remove safe_import_ctx by @mathurinm in #788
• CLN remove dummy benchmark in the tests by @tomMoral in #819
• RELEASE 1.7.0 by @tomMoral in #820

New Contributors

• @rflamary made their first contribution in #685
• @lionelkusch made their first contribution in #786

Full Changelog: 1.6.0...1.7.0

What's Changed

See formated change log in https://benchopt.github.io/whats_new.html

• FIX: update doc for objectives by @bmalezieux in #666
• FIX: wrong indentation by @paquiteau in #668
• FIX clean benchopt_run by @pbarbarant in #667
• Add a badge for latest doc by @TheoGuyard in #670
• Adding tutorials in benchopt doc by @cohenjer in #601
• FIX config set for yaml files by @tomMoral in #678
• DOC improve stopping criterion discoverability by @tomMoral in #679
• FIX update benchmarks test badges by @mathurinm in #681
• Pytest current version by @tanglef in #680
• ENH add support for fish shell by @jolars in #676
• FIX pin julia version to <=1.10.0 by @mathurinm in #682
• ENH implement cv by @chris-mrn in #623
• MTN config flake8+skip conda env test by @tomMoral in #687
• FIX sampling strategy priority by @tomMoral in #686
• ENH allow for non-numerical values in objective by @tomMoral in #684
• fix variable name in run_benchmark docstring by @mathurinm in #688
• FIX solver install only depending on global requirements by @tomMoral in #691
• MTN adapt to joblib 1.4 by @tomMoral in #695
• DOC broaden the scope by @tomMoral in #698
• Cln improve get result error by @tomMoral in #697
• FIX revert joblib change in API by @tomMoral in #707
• CLN various cleanups by @tomMoral in #702
• ENH more robust version check by @tomMoral in #709
• DOC remove custom click semantic group and use upstream feature by @tomMoral in #711
• CLI add collect command to gather existing results by @tomMoral in #710
• ENH supercharged config files by @tomMoral in #706
• FIX make benchmark_utils func picklable by @tomMoral in #712
• FIX benchmark_utils pickling by @tomMoral in #713
• MTN improve coverage reporting by @tomMoral in #692
• Fix solver complex params by @tomMoral in #716
• FIX visible .. code-block: command by @wassimmazouz in #719
• ENH download data by @tomMoral in #718
• ENH raise error for invalid 'install_cmd' by @Jad-yehya in #714
• MNT update pypa action tag by @mathurinm in #721
• Clean doc folder before publishing website by @mathurinm in #726
• FIX zero objective by @vloison in #723
• MNT Execute only the last push commit in CI by @bruAristimunha in #728
• MNT Fixing order for comment on action by @bruAristimunha in #732
• Saving final results of a solver by @paquiteau in #722
• Add "paths" key in available config keys by @Melvin-klein in #701
• ENH uncache errors run by @juAlberge in #735
• FIX avoid dropping last part of bench url when it contains a dot by @mathurinm in #741
• CLI benchopt run add --no-timeout option by @ceelestin in #725
• Doc whatsnew by @Jad-yehya in #744
• DOC update for the run_once sampling strategy by @MatDag in #700
• MTN unpin julia version by @tomMoral in #683
• DOC reference ML template by @tomMoral in #746
• DOC fixed typo by @wassimmazouz in #750
• Change status from "not ready" to "not run yet" when collecting a solver which has not been run yet by @mathurinm in #740
• FIX rendering of RST on pypi by @tomMoral in #753
• ENH improve running benchopt in a script by @tomMoral in #752
• fixing typos by @wassimmazouz in #754
• ENH remove all mention to .ini config file by @tomMoral in #699
• Boxplots by @Melvin-klein in #675

New Contributors

• @paquiteau made their first contribution in #668
• @pbarbarant made their first contribution in #667
• @TheoGuyard made their first contribution in #670
• @cohenjer made their first contribution in #601
• @chris-mrn made their first contribution in #623
• @wassimmazouz made their first contribution in #719
• @Jad-yehya made their first contribution in #714
• @vloison made their first contribution in #723
• @bruAristimunha made their first contribution in #728
• @juAlberge made their first contribution in #735
• @ceelestin made their first contribution in #725

Full Changelog: 1.5.1...1.6.0

What's Changed

• FIX failing requirements by @tomMoral in #662
• RELEASE bugfix v1.5.1 by @tomMoral in #665

Full Changelog: 1.5.0...1.5.1

What's Changed

• FIX - set width of solver description to 80 characters by @Badr-MOUFAD in #575
• ENH: add bilevel benchmark in readme by @pierreablin in #596
• FIX newline end of readme by @mathurinm in #598
• ENH util to generate benchmark in temporary directory by @mathurinm in #580
• API deprecate solver.stopping_strategy in favor of solver.sampling_strategy by @mathurinm in #588
• PLT - Fix solvers legend item vertically displayed by @Badr-MOUFAD in #611
• ENH: add a warm_up function in the solvers by @pierreablin in #602
• FIX - Broken link to documentation artifact by @Badr-MOUFAD in #620
• FIX trailing stopping_strategy by @tomMoral in #624
• MNT deprecate Solver.support_sparse by @mathurinm in #614
• FEAT add issue template by @mathurinm in #613
• DOC - rearrange benchopt documentation by @Badr-MOUFAD in #619
• FIX - broken links in the README by @Badr-MOUFAD in #628
• FIX ignore hidden files when loading datasets, solvers, etc by @antoinecollas in #625
• API rename objective.compute to objective.evaluate_result and use dictionary as input by @mathurinm in #576
• FIX abstract classes in BaseObjective by @tomMoral in #631
• MNT - rename objective column to objective metrics by @Badr-MOUFAD in #633
• DOC - Enhance installation, running and visualizing benchmarks by @Badr-MOUFAD in #629
• DOC - more clear syntax highlighting in code blocks by @Badr-MOUFAD in #638
• FIX missing solver argument for _Callback by @tomMoral in #640
• ENH add helper to store metadata in parquet files by @tomMoral in #637
• ENH improve benchmark metadata handeling by @tomMoral in #621
• FIX test failing when no output present in solver by @tomMoral in #643
• DOC - Tutorial to add a new solver by @Badr-MOUFAD in #635
• FIX - Code snippets in add_solver tutorial by @mathurinm in #645
• FIX call warm_up when the attribute _warmup_done don't exist by @MatDag in #644
• Fix HTML legend that was not displayed on some cases. by @Melvin-klein in #647
• TST error in benchopt test when objective not installed by @tomMoral in #639
• Multiple level calls in html generation CLI by @tanglef in #231
• FIX pinnig pytest for now by @tomMoral in #649
• Merge allow_meta_from_json and standalone by @tanglef in #648
• FIX example objective in write benchmark by @tomMoral in #653
• FIX install pytest in conda env using [test] target by @tomMoral in #657
• PLT add saved views and config files for plots by @AmelieVernay in #552
• FIX call pre_run_hook in run_once by @tomMoral in #659
• FIX development version install link in README by @MatDag in #660
• RELEASE v1.5.0 by @tomMoral in #658

New Contributors

• @pierreablin made their first contribution in #596
• @antoinecollas made their first contribution in #625

Full Changelog: 1.4.0...1.5.0

What's Changed

• API rename cost_curve in objective_list by @AmelieVernay in #514
• MTN improve benchmark tests and document it by @tomMoral in #516
• DOC add link to discord in readme by @tomMoral in #517
• MTN update action to v3 to use node 16 by @mathurinm in #518
• PLT - enable style reset with multiple examples in doc by @AmelieVernay in #510
• FIX convert pandas to numpy for plot by @tomMoral in #521
• ENH single run stopping criterion + improve API doc by @tomMoral in #511
• ENH allow any name for import context by @mathurinm in #524
• DOC add page on curve sampling and stopping criterion by @mathurinm in #529
• DOC update FAQ and index to better reference the different topics by @tomMoral in #530
• ENH add pre_run_hook for Solvers by @tomMoral in #525
• Fix markdown list in convergence_curves documentation by @SimonDelamare in #532
• FEAT syntactic sugar for timeout by @mathurinm in #535
• CLN default install_cmd to 'conda' by @tomMoral in #541
• PLT - add visualization of objective as function of stop_val by @Badr-MOUFAD in #479
• PLT - preserve plotting for benchmark run in previous version by @Badr-MOUFAD in #546
• ENH - update README by @Badr-MOUFAD in #549
• FIX - Discord badge in README by @Badr-MOUFAD in #550
• MTN add circle_ci api token for status report by @tomMoral in #551
• FIX detection of csv files when plotting with option --all by @MatDag in #485
• MNT update ubuntu 18.04 to ubuntu-latest (20.04) in release action by @mathurinm in #554
• ENH - Better error reporting when initializing classes by @Badr-MOUFAD in #548
• FIX start run once callback by @tomMoral in #557
• FIX README for long description on pypi by @tomMoral in #558
• PLT - Show solver description when hovering over it by @Badr-MOUFAD in #543
• Fix exception in shape_solvers_for_html when objective column has all nan values by @ogrisel in #565
• DOC better explain computational budget by @tomMoral in #563
• ENH - CLI installation messages for uninstalled solvers by @Badr-MOUFAD in #555
• PLT - Add objective description by @Badr-MOUFAD in #556
• ENH - make get_next a regular solver method by @Badr-MOUFAD in #566
• DOC add badge SWH by @tomMoral in #542
• Created error message for requirements error by @albanPi in #562
• RELEASE v1.4.0 by @tomMoral in #569

New Contributors

• @SimonDelamare made their first contribution in #532
• @ogrisel made their first contribution in #565
• @albanPi made their first contribution in #562

Full Changelog: 1.3.1...1.4.0

What's Changed

• MTN only skip julia on OSX by @tanglef in #360
• ENH add autocompletion for --config by @mathurinm in #363
• ENH support solver and dataset install from config file by @mathurinm in #368
• FIX escape brackets in command line when running in env by @tomMoral in #367
• ENH add support for custom parameters in CLI by @TomDLT in #362
• DOC add changelog entry by @TomDLT in #380
• FIX allow dots in names by @tanglef in #381
• DOC add contrib to doc by @bcharlier in #361
• CLN remove last Os from BenchOpt to Benchopt by @tanglef in #388
• FIX use utf8 when writing html report by @Badr-MOUFAD in #387
• TST skip leukemia as long as it is broken in fetch_openml by @mathurinm in #391
• FIX use redirect_stdout in get_sys_info for windows by @mathurinm in #390
• MNT return dict in get_data in test benchmarks datasets by @mathurinm in #385
• FIX platform version for windows by @mathurinm in #392
• ENH get cuda info without nvcc by @tanglef in #386
• HTML website improvements by @TomDLT in #389
• ENH use current working directory as default in CLI by @tanglef in #384
• FIX Safe exit cuda by @tanglef in #396
• BUG fix ANSI colors in Windows by @Badr-MOUFAD in #398
• CLN various improvments in the output by @tomMoral in #393
• ENH support exp notation in CLI parameters by @TomDLT in #383
• FIX: prevent from using install or run -e without conda by @bmalezieux in #399
• FIX parameters of objective shouldn't be modified by set_data by @bmalezieux in #401
• ENH change output file name by @tanglef in #397
• ENH no longer skip sparse datasets for julia solvers by @mathurinm in #404
• ENH add benchopt archive cmd to share the benchmarks by @tomMoral in #408
• ENH add slurm parallel processor using submitit by @tomMoral in #407
• FIX autocompletion for paths by @tomMoral in #414
• MNT API change handled in Lasso benchmark by @mathurinm in #420
• ENH add tag in results csv file by @mathurinm in #421
• FIX warn if benchopt version in env differ from running one by @mathurinm in #419
• HTML improve plot display by @Melvin-klein in #418
• MTN faster test_no_conda and move in common file with tests by @tomMoral in #425
• FIX generate results by @tomMoral in #426
• TST benchopt plot with html by @tomMoral in #427
• FIX Handle iterables parameters in Objective by @Badr-MOUFAD in #423
• HTML trim infinite values for HTML plotting by @Melvin-klein in #429
• HTML embed js, css, svg into Mako template by @Melvin-klein in #432
• HTML Compress data by @Melvin-klein in #433
• ENH update problems by @jolars in #431
• DOC : add AJD to documentation by @agramfort in #434
• HTML custom legend in result template by @Melvin-klein in #428
• FIX non-diverging negative losses by @tomMoral in #435
• MTN unpin 3.8 version in env creation by @mathurinm in #297
• HTML artifact by @Melvin-klein in #439
• FIX parquet file publishing by @Melvin-klein in #438
• HTML update html template by @Melvin-klein in #424
• DOC add bibtex to cite Benchopt by @Badr-MOUFAD in #441
• FIX license format by @Badr-MOUFAD in #442
• PLT Fix html artifact by @Melvin-klein in #444
• FIX for objective and solvers returning list of arrays by @mathurinm in #445
• DOC improve the how to doc by @tomMoral in #446
• CLN use benchmark pretty names by @Melvin-klein in #440
• FIX result generation by @Melvin-klein in #447
• FIX results format by @Melvin-klein in #448
• CI create new env to avoid issue with pin python version in base env by @tomMoral in #452
• FIX import error in utils displayed by @tomMoral in #451
• CLN embed all static files in html by @tomMoral in #456
• Change default parameter for --n-repetitions to 1 instead of 5 by @bmalezieux in #457
• FIX use floats for X_density and snr by @jolars in #471
• FIX create config file with mode 600 in cli set() by @mathurinm in #470
• CLN typos in stopping_criterion.py docstrings by @mathurinm in #462
• ENH allow template solver by @tomMoral in #473
• ENH stopping criterion with different objective key by @AmelieVernay in #461
• DOC add default value for strategy in doc by @AmelieVernay in #464
• FIX remove debugging print left from PR#461 by @Badr-MOUFAD in #478
• FIX detection editable install by @tomMoral in #482
• ENH specify channel for conda reqs by @tomMoral in #483
• FIX test command relative import by @tomMoral in #486
• TST add conda requirements cmd generation by @tomMoral in #491
• API deprecate Objective.to_dict in favor of Objective.get_objective by @mathurinm in #489
• ENH min benchopt version by @tomMoral in #492
• ENH add benchmark_utils as a module when setting up benchmark by @mathurinm in #472
• DOC add missing what's new entry by @tomMoral in #496
• FIX local benchopt requirement detection by @tomMoral in #497
• ENH improve error reporting in solvers by @tomMoral in #495
• PLT change colormap + clean plotting functions by @AmelieVernay in #487
• CLN raise error when objective is not installed by @tomMoral in #494

New Contributors

• @Badr-MOUFAD made their first contribution in #387
• @Melvin-klein made their first contribution in #418
• @AmelieVernay made their first contribution in #461

Full Changelog: 1.2.0...1.3.0