Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchmarks as reference point for users #209

Open
610v4nn1 opened this issue May 1, 2023 · 0 comments
Open

Benchmarks as reference point for users #209

610v4nn1 opened this issue May 1, 2023 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@610v4nn1
Copy link
Contributor

610v4nn1 commented May 1, 2023

Currently users have hard time to understand what can be achieved using continual learning methods instead of ad-hoc heuristics. It would be great to provide some benchmarks against some simple baselines tracking both accuracy and training time.

Suggested baselines: retrain from scratch, fine-tune on latch data chunk.
@610v4nn1 610v4nn1 added the dependencies Pull requests that update a dependency file label May 1, 2023
@610v4nn1 610v4nn1 added this to the Renate 0.3 milestone May 1, 2023
@610v4nn1 610v4nn1 added documentation Improvements or additions to documentation and removed dependencies Pull requests that update a dependency file labels May 1, 2023
@wistuba wistuba changed the title Benchamrks as reference point for users Benchmarks as reference point for users May 2, 2023
@lballes lballes removed this from the Renate 0.3 milestone May 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lballes @610v4nn1