1.20.0

What's Changed

New Tests

• Add tasks for Managed Starburst and first tests by @bdattoma in #633
• Add SEP TC for Monitoring by @mwaykole in #640
• Add more tests for Managed Starburst by @bdattoma in #635
• Happy path test for Model Serving UI by @lugi0 in #631

New Tasks

• Add GCP provision by @pablofelix in #636

Enhancements

• Added support for rhods installtion by olm repo by @tarukumar in #628
• Update tests to account for prebuilt CUDA images by @lugi0 in #625
• Fix smoke failure due to cpu billing tests by @lugi0 in #639
• Add notebook spawning with basic user in Smoke suite by @bdattoma in #637
• fix SERH Test-case by @mwaykole in #642
• [Model Serving] Skip deletion steps in teardown if no model deployed by @lugi0 in #645
• Fix Dashboard XPaths for RHODS v1.20 by @bdattoma in #643
• Wait for a possible popup in "Spawn Notebook With Arguments" by @jgarciao in #632
• Skip the grafana Test case execution for RHODS 1.20 by @tarukumar in #646
• update utils files with S3 vars by @lugi0 in #648
• Restore ODS-293 test case by @bdattoma in #634
• Fix Test Metric "Notebook CPU Usage" On ODS Prometheus by @jgarciao in #647
• Move sla disruptive tests to Tier3 by @jgarciao in #649
• Fix DS Projects tests for RHODS v1.20 by @bdattoma in #644
• Fix expected error page in ODS-293 by @bdattoma in #650
• Fix test-versions tooltip xpath by @lugi0 in #652
• In RHOSi Setup and Teardown, warn if alerts are firing or pending by @jgarciao in #630
• Add AutomationBug tag to failing tests. Prepare ods-ci 1.20 release by @jgarciao in #651
• Fix failures in T2 tests for RHODS 1.20 by @lugi0 in #653
• Fix expected error page in ODS-572 plus add 1.19 compatibility in ODS-293 by @bdattoma in #656
• Smarter comparison for model inference output by @lugi0 in #655
• Additional fixes for ods-ci 1.20 by @jgarciao in #654
• Fix test of status API based on RHODS version by @bdattoma in #657

Full Changelog: 1.19.0...1.20.0

1.19.0

What's Changed

New Tests

• Check and verify rhods version and display name by @tarukumar in #617
• Add new rules in Dashboard clusterrole by @pablofelix in #619
• Add tests for Data Science Projects page by @bdattoma in #583

Enhancements

• Support for deploying/uninstalling rhods in GCP cluster by @tarukumar in #613
• Modify aws cluster config to expose variables to user by @aloganat in #612
• Add Robocop support to scan ods-ci by @tarukumar in #620
• Update ODS-488 and Add ODS-1890 to check only expected ISVs are displayed in Explore page by @bdattoma in #626
• Add fixes for RHOSAK UI testing by @bdattoma in #627
• Bugfixes for releasing ods-ci 1.19. Add AutomationBug and ProductBug by @jgarciao in #629

Misc

• Add pre-req pkgs for a jenkins worker node by @aloganat in #614

Other Changes

• Tweak model serving TCs for openvino backend by @lugi0 in #621

Full Changelog: 1.18.0...1.19.0

1.18.0

What's Changed

New Tests

• Fix pod toleration test case, add new TC for unsupported tolerations by @lugi0 in #591
• Add test for unsupported environment variable names by @lugi0 in #596
• Add test case to verify it is possible to create custom Dashboard items (Application,QuickStarts,HowTo,Tutorial,Documentation) by @bdattoma in #333
• Add test suite for gpu autoscaling by @lugi0 in #602

Enhancements

• Remove dot from expected text when changing cluster settings by @lugi0 in #597
• Wait for cuda builds in Sanity by @jgarciao in #599
• Complete information about product bug in some dashboard tests by @bdattoma in #594
• Fix tests affected by changes in HTML by @bdattoma in #598
• Remove check on pachyderm secret creation by @bdattoma in #595
• Adapt ODS-488,1303,771 to account for dashboard differences in Self-managed by @bdattoma in #581
• Adapt API Access tests after new changes in dashboard endpoints by @bdattoma in #593
• Disable XLarge test by @lugi0 in #607
• update model serving tests for ovms by @lugi0 in #603
• Modify the image to Centos stream for terraform provisioning by @aloganat in #611

Other Changes

• Save cluster details in file and add sshkey option in config yaml by @aloganat in #601
• Check for modal error message when there's not enough resources to spawn notebook by @lugi0 in #590
• Implement Github Action for dry runs of the whole repo. Replace OpenShiftCLI by OpenShiftLibrary by @lugi0 in #588
• Fix dryrun action permissions by @lugi0 in #604
• Update dryrun comment workflow by @lugi0 in #608
• "Add support to perform OSD upgrade" by @mwaykole in #610

Full Changelog: 1.17.0...1.18.0

1.17.0

What's Changed

New Tests

• Added new TCs for Notebook Controller Routes and Jupyter Notebook by @tarukumar in #574
• Verify Clean Up ODS Deployer Post-Migration by @pablofelix in #576

Enhancements

• Add product bug and and remove flaky test from operator test by @tarukumar in #572
• Fix bug in keyword "Verify Operator Pod Status" by @jgarciao in #573
• Fix qaprodauth url by @bdattoma in #577
• Update performance tests for kfnbc by @tarukumar in #561
• Add support to install rhods using the self-managed-installer by @tarukumar in #555
• Add ODS-650 to Anaconda e2e test case by @bdattoma in #570
• Fix failures in Dashboard API testing by @bdattoma in #575
• Fix test on Dashboard deployment increasing expected replicas to 5 by @bdattoma in #578
• Added support for new uninstaller by @tarukumar in #580
• Shellcheck lineter implementation by @tarukumar in #584
• Add self managed catalog source by @tarukumar in #586
• Prepare ods-ci 1.17.0 release by @jgarciao in #592
• Add parameter to spawn notebook in new tab by @lugi0 in #587

Other Changes

• Spawn in same tab for rhods 1.17+ by @lugi0 in #571
• Cluster config by @aloganat in #579
• Model serving test suite by @lugi0 in #582

Full Changelog: 1.16.0...1.17.0

1.16.0

What's Changed

New Tests

• Add test to verify app switcher menu in RHODS Dashboard by @bdattoma in #482
• Add TCs for pod tolerations by @lugi0 in #531
• Add TC's for Admin UI by @mwaykole in #532
• Add tests for new kubeflow alerts by @jgarciao in #553
• Add Feature AWS Provisioning Beta by @pablofelix in #562
• Add tests for testing API based on user permission by @bdattoma in #556

Enhancements

• Add further check on doc links from Dashboard in ODS-327 by @bdattoma in #492
• Increase build timeout when waiting for CUDA builds by @jgarciao in #510
• Fix ODS-1491 to remove Openvino from dashboard after uninstall in ODS-1491 by @bdattoma in #484
• added code to skip the TC since traefik pod is removed by @tarukumar in #513
• Minor Fixes by @bdattoma in #509
• Update telemetry configmap and secret for kubeflow. Fix RHOSi Setup when prometheus is not running by @jgarciao in #511
• Adapt different TCs to work with KFNBC and without old config maps by @bdattoma in #533
• Update ODS-488 to remove perceptilabs check for Jupyter (instead of JupyterHub) by @bdattoma in #503
• Add python linter by @tarukumar in #535
• Fix wrong label selector in Smoke by @lugi0 in #537
• Update monitoring tests for kubeflow (Tier1, Tier2) by @jgarciao in #534
• Fix some failing smoke tests due to JH to Jupyter migration by @bdattoma in #536
• fix-minor-issue size=Default to size=Small by @tarukumar in #540
• Fix gpu selector handling by @lugi0 in #542
• Run black formatter only on python file by @tarukumar in #544
• Update fix spawner status keyword for KFNBC by @lugi0 in #545
• Fix spawner typos by @lugi0 in #546
• Update expected CUDA version to 11.7 by @lugi0 in #547
• added support to check rhods operator by @tarukumar in #487
• Update culler test suite for KFNBC by @lugi0 in #543
• Fix metrics tests for kubeflow by @jgarciao in #550
• Workaround for modal not appearing during spawn by @lugi0 in #549
• Added changes to PVC related tc to support KFNBC by @tarukumar in #551
• Added rhods version to be available globally by @tarukumar in #552
• Fix Jupyter tests in Tier2 by @lugi0 in #554
• Fix PSI related TC by @tarukumar in #558
• Update ODS-469 to use Notebook CR for last spawn details by @lugi0 in #560
• Fix typo in spawn keyword by @lugi0 in #564
• Add namespace parameter to oc call by @lugi0 in #568
• Fix Anaconda and Application Switcher test cases based on results from automated runs by @bdattoma in #563
• Attempt at optimizing openshift login step by @lugi0 in #559

Enhancements in scripts and CI/CD

• Add support to create osd cluster on gcp by @aloganat in #548

Documentation

• Black doc by @tarukumar in #538

Misc

• Add AutomationBug tags after TFA for Dashboard and ISV TCs by @bdattoma in #569

Other Changes

• Merge KFNBC branch onto main by @lugi0 in #521
• Use shell script for configuring aws by @aloganat in #557
• Change container size in multiple-gpus test by @lugi0 in #565
• Install GPU operator on self managed cluster by @tarukumar in #566
• Make sure Pod Toleration setting is applied before running TC by @lugi0 in #567

Full Changelog: 1.15.0...1.16.0

1.15.0

What's Changed

New Tasks

• Add PSI uninstall by @pablofelix in #491

Enhancements

• added fix for smoke run by @tarukumar in #494
• chnage default gpu node by @tarukumar in #495
• Verify cuda buildchain in smoke pipeline by @jgarciao in #502

Misc

• Adding memory and cpu resource by @tarukumar in #441

Other Changes

• Revert "chnage default gpu node" by @tarukumar in #498
• Change python code in Pep8 format by @mwaykole in #485
• Remove false negative test by @lugi0 in #504

Full Changelog: 1.14.0...1.15.0

1.14.0

What's Changed

New Tests

• Add TC to Verify external links in Quick Starts are not broken by @mwaykole in #446
• [Test] User should not see No Components Found in RHODS Dashboard by @mwaykole in #458
• [Test] RHODS user should not see No Components Found in RHODS Dashboard after configmap change by @tarukumar in #464
• Check if rhods dashborad pods doesn't restart by @tarukumar in #465
• Add tensorboard test for tensorflow/pytorch images by @lugi0 in #470
• Verify rhods_aggregated_availability Detects Downtime In Jupyterhub And Dashboard by @pablofelix in #475

Enhancements

• Added support for other RHODS supported ISV in Performance test by @tarukumar in #449
• Fix test "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @jgarciao in #456
• Spawn Notebook With Arguments: fail if the retry count is exhausted by @kpouget in #457
• Fix timing for test "Wait Until Operator Reverts "Grafana" To "Prometheus" In Rhods-Monitor-Federation" by @jgarciao in #460
• Fix test checking Active_Users metrics not to skip when active_users > 0 by @jgarciao in #459
• Move ISVs test cases from Sanity to Tier2 by @bdattoma in #463
• Fix RHOSAK teardown by @bdattoma in #466
• Check aggregate availability in "RHOSi Setup" and "RHOSi Teardown" by @jgarciao in #444
• Fix service account token fetching in ODS-CI for compatibility issue with OCP 4.11 by @bdattoma in #468
• Fix compatibility issue with OSD 4.11 in installing ISV from UI by @bdattoma in #467

Enhancements in scripts and CI/CD

• [Lib] Script to create openshift cluster on aws using openshift-install by @aloganat in #461
• Added support to install rhods on PSI with git repo by @tarukumar in #474

Misc

• moving PVC size verification TCs out of smoke by @tarukumar in #455
• Spawn Notebook With Arguments: initialize ${spawn_fail} variable by @kpouget in #469
• Spawn Notebook With Arguments: correctly initialize ${spawn_fail} variable by @kpouget in #472

Other Changes

• [TestFix] Add sanity tag by @mwaykole in #462

Full Changelog: 1.13.0...1.14.0

1.13.0

What's Changed

New Tests

• Add test cases to check error messages about RHODS groups by @bdattoma in #424
• Add test Verify That The Operator Pod Does Not Get Stuck After Upgrade by @pablofelix in #425
• Add Tests to verify Cuda Image builds in cluster(ODS-444) by @prudhvi-165 in #431
• Add test to verify user can access documentation by @risusing in #331
• Add test to Verify ODS Availability After OpenShift Node Failure by @pablofelix in #432
• Add test to check if Intel images are pinned to a numeric version by @bdattoma in #443
• Add new tests to verify alert RHODS JupyterHub Probe Success Burn Rate by @jgarciao in #450
• Add test to Verify Culler Settings are not overwritten [RHODS-4336] by @tarukumar in #451

Enhancements

• Update tests for RHODS Alerts by @VaishnaviHire in #417
• Add flaky test tags for some TCs in Sanity by @bdattoma in #433
• Fix Tier2 tag in ODS-1303 by @jgarciao in #435
• modify script with new changes in latest rhods version by @tarukumar in #434
• Fix issue while getting token for prometheus by @aloganat in #438
• Add gpu details for ods 488 by @tarukumar in #442
• Add header to GET request by @bdattoma in #445
• Update addon ID for GPU addon by @lugi0 in #447
• Change nfd operator name by @lugi0 in #448
• Fix usage data collection flaky test by @jgarciao in #437
• Slim down Sanity moving some tests to Tier2 (execution time > 15 mins) by @jgarciao in #453
• Wait until cuda builds are Completed in deployment test by @jgarciao in #452

Enhancements in scripts and CI/CD

• Fix for empty String in json files by @mwaykole in #436

Documentation

• Adding README to ocm script by @mrrajan in #246
• Update example file for test-variables.yml by @bdattoma in #439

Misc

• Dockerfile: expose utils/scripts/testconfig/test-variables.yml as test-variables.yml.model by @kpouget in #426

Other Changes

• Fix for Interop Json and Added new argument by @mwaykole in #440

New Contributors

• @mrrajan made their first contribution in #246
• @kpouget made their first contribution in #426

Full Changelog: 1.12.0...1.13.0

1.12.0

What's Changed

New Tests

• Add test to Verify Git Plugin by @risusing in #337
• Verify Monitoring Stack Is Reconciled Without Restarting The ODS Operator by @rkamble5 in #391
• Add test to verify dashboard's favorite resource cards behavior (ODS-389) by @pranavsuryaw in #367
• Verify JupyterHub DB Is Shipped And Enabled Within ODS by @pablofelix in #396
• Add Tests to Verify Empty User Groups Doesn't Allow Users to Spawn Notebooks(ODS-572) by @prudhvi-165 in #332
• Verify PostgreSQL Is Not Deployed When AWS RDS Is Enabled by @pablofelix in #398
• Verify JupyterHub Receives Credentials And Creates Instance Of AWS RDS by @pablofelix in #401
• Add test to verify that Odh-deployer Checks Cluster Platform Type by @pablofelix in #411
• Check enabled page is loading after uninstalling operator by @rkamble5 in #415
• Add Test To Verify Cuda Is Succesful In PSI Clusters(ODS-481) by @prudhvi-165 in #420
• Added Tests to Verify Notifications Are Shown When Notebook Builds Are Not Started(ODS-1347) by @prudhvi-165 in #323
• Add tests to Verify CPU and Memory requests for the CUDA and Image Pods(ODS-313) by @prudhvi-165 in #400
• Add Tests to Verify Failing Notebook Names Are Shown In Notifications(ODS-470) by @prudhvi-165 in #260

New Tasks

• Add ODS-543 label by @pablofelix in #423

Enhancements

• Add Test To Verify If Pachyderm Pipeline Can Be Created Using Jupyterlab by @risusing in #322
• Fix test "Verify That MT-SRE Are Not Paged For Alerts ..." with new keyword "Get Cluster Name From Console URL" by @tarukumar in #395
• Add fix for RHOSAK e2e test case by @bdattoma in #394
• Modify keyword to fetch the name and added retrun to the notification… by @tarukumar in #397
• Fix some test Tags, Documentation and Title by @bdattoma in #399
• Remove version check from ODS-1165 by @bdattoma in #403
• Reenable url-parse check by @lugi0 in #416
• Fix error in Smoke test of Anaconda by @bdattoma in #414
• Add timeout in select explore keyword for monitoring in grafana by @pablofelix in #422
• Update GPU add-on testing for new SKU by @lugi0 in #412
• Added steps to disable csvcopy to diable by @tarukumar in #413

Enhancements in scripts and CI/CD

• Add script to split Suites by @bdattoma in #428

Misc

• Fix Dockerfile by @fcami in #404
• Add Tests to Verify Tensorflow GPU(ODS-474) by @prudhvi-165 in #410
• venv: only create when absent by @fcami in #407
• Small changes in Sanity by @bdattoma in #421

Other Changes

• Add func in ocm.py to Automated Trigger smoke sanity with candidate version by @mwaykole in #371
• Disable npm check for 1.12 by @lugi0 in #402
• Add test to ensure users can log into RHODS using LDAP after they configure it as an identity provider (ODS-532) by @prudhvi-165 in #408

New Contributors

• @fcami made their first contribution in #404

Full Changelog: 1.11.0...1.12.0

1.11.0

What's Changed

New Tests

• Add Grafana test to verify if it is shipped and enabled by @pablofelix in #347
• Verify that Blackbox exporter is shipped and enabled within RHODS by @pablofelix in #357
• Verify that Dashboard is shipped and enabled within RHODS by @pablofelix in #352
• Verify Traefik Proxy is deployed in HA by @pablofelix in #354
• Verify Alert Manager Is Shipped And Enabled Within ODS by @pablofelix in #359
• Added Tests to Verify MT-SRE Can Connect To Prometheus , Alert Manager Using OpenShift Port-Forwarding by @prudhvi-165 in #348
• Add jupyterhub test tag by @pablofelix in #356
• Add test cases for testing QuickStart worflows by @bdattoma in #364
• Add Tests to verify Grafana Connected to Prometheus using TLS(ODS-963) by @prudhvi-165 in #340
• Verify pushing project changes to a git repository [ODS-326] by @pranavsuryaw in #276
• verify rhods-dashboard cluster role by @pablofelix in #365
• Add test to verify JupyterHub leader monitoring using RHODS Prometheus(ODS-689) by @rkamble5 in #320
• Verify that Prometheus is shipped and enabled within RHODS by @pablofelix in #353
• Calculates avg time taken by server to start by @pranavsuryaw in #314
• Add performance test by @tarukumar in #379
• Checking for oauth container ODS-355 by @pranavsuryaw in #369
• Verify CPU And Memory Requests And Limits by @pablofelix in #360
• Add test to Verify Telemetry Data Is Accessible from jupyterhub/api page by @rkamble5 in #368
• Add test case to "Verify That MT-SRE Are Not Paged For Alerts In Clusters Used For Development Or Testing" (ODS-1058) by @rkamble5 in #370

Enhancements

• Anaconda image name change in v1.11 by @lugi0 in #362
• Changes in ods-1227(verify alert severity) by @rkamble5 in #361
• Added code to verify the default size by @tarukumar in #373
• Update tensorflow version check in minimal image by @lugi0 in #375
• fix RHOSAK test case after changes in UI by @bdattoma in #374
• added pattern to check failed entry by @tarukumar in #377
• update ods-ci container to install python3.8 and use RH ubi image by @bdattoma in #372
• Update ODS-CI container with new features by @bdattoma in #378
• Add ods-ci serviceaccount variables to test-variables yaml by @bdattoma in #382
• Sec update for ODS-CI by @bdattoma in #380
• Add keyword to check for npm library installed version in container by @lugi0 in #381
• Fix "Verify JupyterHub Deployment" for RHODS < 1.12 by @lugi0 in #384
• Fix "Usage Data Collection" test. Add keyword "Save Changes In Cluster Settings" by @jgarciao in #383
• Fix automation bug in "Verify RHODS operator information" (ODS-644) by @pablofelix in #385
• Fix configuration of autogeneration of release notes by @jgarciao in #351
• Fix "Test Metric "Notebook CPU Usage" (ODS-178) when cpu usage is null by @rkamble5 in #387
• fix ODS-293 by adding wait for rollout to start by @bdattoma in #388
• Miscellaneous fixes for ods-ci 1.11.0 by @jgarciao in #386
• Update tags for nvcc TC by @lugi0 in #393

Documentation

• email-report changed to False as run_robot_test.sh by @mwaykole in #366

Other Changes

• Add test cases for metrics in OpenShift Monitoring: notebook cpu usage, rhods_total_users and rhods_aggregate_availability (RHODS-3288) by @rkamble5 in #312

Full Changelog: 1.10.0...1.11.0