2.13.0

What's Changed

New Tests

• RHOAIENG-7217 KServe and KServe.Serving management states by @mattmahoneyrh in #1736
• Added onnx model REST protocol test on triton by @Raghul-M in #1737
• caikit standalone embeddings test endpoints for kserve by @nehachopra27 in #1744
• Added onnx model Modelmesh test on triton by @Raghul-M in #1777

New Tasks

• Add support for provisioning GPUs on Azure by @bdattoma in #1740

Enhancements

• Rename some root suite directories to reflect new scrum org by @bdattoma in #1734
• Fix "SKIPPED" status in Post upgrade suite by @bdattoma in #1738
• Create root suite directory for unassigned components and move culler suite under IDE by @bdattoma in #1743
• Disable ModelRegistry Tests On RHOAI by @mattmahoneyrh in #1749
• Check KServer Managment State To Ensure That It Is Not Empty by @mattmahoneyrh in #1751
• [fix] xpaths to couple of elements in dashboard data science projects by @jstourac in #1756
• Fix keyword to watch SM cluster provisioning logs and increase timeout by @bdattoma in #1754
• [fix] xPaths with regards the change in RHOAI 2.13 by @jstourac in #1763
• Refactor Data Science Pipelines Backend Tests introducing new keywords by @jgarciao in #1767
• Fix Verify User Can Change The Minimum Number Of Replicas For A Model test case in ods-ci by @hdefazio in #1765
• Fix variable evaluation in "Verify Model Inference" and associated keywords by @lugi0 in #1773
• Fix JupyterHub tag in special-user-testing test suite by @jgarciao in #1771
• Fix wrong argument in test case, missing argument in keyword call (deployment_mode) by @lugi0 in #1782
• Add additional params for object storage configuration in CreatePipelineServer, fixing tests on disconnected by @jgarciao in #1781
• Use single tier/gate tag, fix robocop complaints in Model Serving Test Suites by @lugi0 in #1778
• Fix pipeline server creation when url ends with / by @jgarciao in #1791
• Increase Trusted CA Bundle Resource Check Timeouts by @mattmahoneyrh in #1796

Other Changes

• Support disconnected environment for Pipeline SDK tests by @diegolovison in #1730
• fix: solve issues when uninstalling and reinstalling serverless operator due to operator group not being removed by @CFSNM in #1739
• Pipeline for Importer Components by @diegolovison in #1723
• fix: use common vars in the oc uninstall keywords by @CFSNM in #1745
• Fix "Verify User Can Access Model Metrics From UWM" test in "Model Serving Llm" suite by @hdefazio in #1755
• Fix DW UI test image to use image digest by @Srihari1192 in #1760
• Added new tests to validate release.name and release.version attributes of a dsc/dsci by @CFSNM in #1750
• Create pipeline run with different user by @diegolovison in #1628
• Update runtime image for 2.13 by @tarukumar in #1766
• fix: rework in some of the operator test cases by @CFSNM in #1761
• Allow to install gpu-operator-certified in disconnected env by @apodhrad in #1639
• Fix for Authorino TC by @mwaykole in #1770
• Update DW UI tests to accommodate changes introduced in 2.13 and instability tests by @Srihari1192 in #1758
• reworking platform tests tagging following the 1-tag approach by @CFSNM in #1769
• fix: increase dsci timeout by @CFSNM in #1774
• Add verification for container images in smoke test by @ChughShilpa in #1759
• Use newer fms-hf-tuning image by @sutaakar in #1775
• fix: solving some issues in the must gather tests by @CFSNM in #1776
• Add Rhods Osd Install Repo to generateTestConfigFile by @asanzgom in #1780
• fix: add rhosi setup as a requirement for post-upgrade setup by @CFSNM in #1785
• [RHOAIENG-11805] Avoid multiple suite tags for IDE tests by @jstourac in #1787
• Update to allow installation of the Python Client without external access by @tonyxrmdavidson in #1779
• Add new runtime image with chat-template for vllm by @tarukumar in #1798
• fix: remove flaky condition to avoid false negative results for the rhods log test by @CFSNM in #1799

New Contributors

• @hdefazio made their first contribution in #1755

Full Changelog: 2.12.0...2.13.0

2.12.0

Fix Test `Verify Documentation Links HTTP Status Code` (#1731)

Signed-off-by: manosnoam <[email protected]>

2.11.0

What's Changed

New Tests

• RHOAIENG-8546 - Platform DSC Modelmeshserving Test Case by @mattmahoneyrh in #1530
• Feat: Authorino UI basic test by @FedeAlonso in #1485

Enhancements

• Set default SR for Kserve to Caikit+TGIS by @lugi0 in #1558
• Force Caikit TGIS SR in UI tests by @lugi0 in #1559
• [vllm/tgis]Add support for amd for model deployment by @tarukumar in #1564
• Adapt Data Science Pipelines tests to changes introduced by Pipeline Experiments by @jgarciao in #1576
• Check that the URL list is not empty before verifying HTTP status by @manosnoam in #1584

Enhancements in scripts and CI/CD

• Update amd script by @bdattoma in #1540
• Generalize GPU provisioning script to ease the addition of new providers by @bdattoma in #1568

Misc

• Move Serving and Pipelines suites out of Dashboard folder by @bdattoma in #1553
• Create IDE test suite directory with proper nested suites by @bdattoma in #1562
• Move ai explainability suite in dedicated directory by @bdattoma in #1575

Other Changes

• Add Upgrade test scenarios for Distributed workloads by @Srihari1192 in #1491
• moved 144 Dsc Negative No Dependant Op to Tier3 by @asanzgom in #1566
• Tag both Operator and ModelRegistry on 112_model_registry by @asanzgom in #1567
• RHOAIENG-3472: Added test to validate the DSC without dependant operator when kserver is unmanaged by @CFSNM in #1556
• update test name in codeflare tests by @ChughShilpa in #1573
• Access job submission as non-admin by @diegolovison in #1571
• Update repo for codeflare tests by @ChughShilpa in #1570
• All pipelines connections are secured by default from the client perspective by @diegolovison in #1577
• Fix Test Verify Resource Link HTTP Status Code by @manosnoam in #1582
• Add granite 7b lab model by @tarukumar in #1579
• Update rhoai 2.11 runtime images by @tarukumar in #1585
• RHOAIENG-7226 - Add TestMnistRayGpu by @jiripetrlik in #1580
• RHOAIENG-2512: Added test to validate the DSC and DSCI when Serverless operator is not installed by @CFSNM in #1574
• RHOAIENG-7919 Istio Kserve Gateway For Internal Endpoint by @mattmahoneyrh in #1583
• Update AppsInfoDictionary_latest.json with the new App: Elasticsearch by @manosnoam in #1590
• Add DW test to verify requested resources in case of multiple local queue exists by @Srihari1192 in #1565

Full Changelog: 2.10.0...2.11.0

2.10.0

What's Changed

New Tests

• RHOAIENG-5435 - Distributed Workloads Components by @mattmahoneyrh in #1392
• RHOAIENG-6627 - Training-Operator test case by @mattmahoneyrh in #1430
• Add base test for vLLM and its metrics by @lugi0 in #1438
• RHOAIENG-7181 Check DW Components are Enabled by Default by @asanzgom in #1502
• Expanded vLLM metrics test by @lugi0 in #1500
• RHOAIENG-7298 - New DSC Component Dashboard and Datasciencepipelines Test Cases by @mattmahoneyrh in #1509
• Add support for embedded endpoint for vllm by @tarukumar in #1511
• RHOAIENG-6517 Automate support for configuration of controller resources by @asanzgom in #1515
• Add Support for vllm model deployment from UI by @tarukumar in #1531
• ODS-2584 Create DSCI and DSC with Service Mesh operator NOT installed by @CFSNM in #1487
• Add embedding model deployment from ui for vllm by @tarukumar in #1548

Enhancements

• [Fix] check for the CUDA version installed on image by @jstourac in #1418
• Add support to uninstall odh-nightly from managed cluster by @tarukumar in #1421
• [fix] Update image used for must-gather test by @jstourac in #1420
• Fix "PLC0415", # import should be at the top-level of a file by @jiridanek in #1423
• Add Test and Kw for authorino by @mwaykole in #1396
• Fix "F403", # from python_terraform import * used; unable to detect undefined names by @jiridanek in #1424
• Parameterize the model deployment for tgis and using ratio to match model response by @tarukumar in #1447
• Add ProductBug tag to tgis metrics test cases by @bdattoma in #1448
• [fix] the test for special usernames by @jstourac in #1451
• [fix] two test that starts Standard Data Science workbench on ODH by @jstourac in #1456
• [fix] expected title of the browser window when running with ODH by @jstourac in #1457
• [fix] the expected network policy content for the ODH execution by @jstourac in #1454
• Bumping timeout or retries to avoid flaky timeless issues by @CFSNM in #1461
• Bumping default retry to 150 in Wait Until Operator Subscription Last Condition Is by @CFSNM in #1470
• Moved API to v2beta1 by @diegolovison in #1480
• RHOAIENG-7580 - Add Pod Ready Check by @mattmahoneyrh in #1478
• Fix "E402", # Module level import not at top of file by @jiridanek in #1483
• Refactor Data Science Pipelines to slim down sanity (Sanity on a diet) by @jgarciao in #1481
• Fix iris-pipeline sample to use the standard_scaler parameter in step normalize_dataset by @diegolovison in #1489
• Update Xpath for AiKit Card by @asanzgom in #1505
• Fix missing poetry run in run_robot_test.sh by @jiridanek in #1496
• [fix] installation of servicemesh dependant operator on managed cluster by @jstourac in #1508
• Modify Pipeline UI test in Smoke to use pip_index_url (making it compatible with disconnected clusters) by @jgarciao in #1507
• Update installation channel for the authorino dependency operator by @jstourac in #1514
• Small two DS project test fixes/stabilization by @jstourac in #1523
• [fix] close browser after each test in 415__ods_dashboard_projects.robot by @jstourac in #1524
• [fix] stabilize the ODS-1864 test by scrolling button into view by @jstourac in #1526
• fix: use activeModelState to wait ISVC status by @FedeAlonso in #1528
• Remove auth from ray by @diegolovison in #1482
• fix: 30s sleep when ISVC is loaded in order to avoid polling treshold by @FedeAlonso in #1534
• [fix] Update must-gather image reference for the RHOAI 2.10 by @jstourac in #1535
• fix: ODS-2574 wrong xpaths by @FedeAlonso in #1539
• fix: Model serving LLM UI tests by @FedeAlonso in #1541
• Simplify pipeline setting pip_index_url and pip_trusted_host by @jgarciao in #1549
• fix: Dashboard tests diet by @FedeAlonso in #1552
• Add sleep to ovms test, skip fail if UWM configmaps already present by @lugi0 in #1557

Enhancements in scripts and CI/CD

• Add script to fetch new test cases by @bdattoma in #1459
• Add option in fetch_new_test.py to automatically fetch previous release branch by @bdattoma in #1474
• Add tagger date and version:refname sort attribute for fetching releases branches by @bdattoma in #1503
• fix: wait for kserve inference host via cli by @FedeAlonso in #1518
• Add Dashboard tag to Dashboard related suites by @FedeAlonso in #1529

Misc

• [fix] disable the custom manifest support temporarily by @jstourac in #1458
• [Jupyter] RHOAIENG-7490 update test tags - remove many from Sanity by @jstourac in #1471
• Add support for amd operator installation by @tarukumar in #1498
• Finalize WIP task for fixing outstanding linter warnings by @jiridanek in #1497
• Add a trainingoperator component to the DSC template list by @jstourac in #1519
• Add SeaLights integration files and deps. Configure SonarCloud inclusions/exclusions by @jgarciao in #1533

Other Changes

• After filling the form, Create a Run button element should be enabled by @diegolovison in #1415
• Select project before checking the pipeline run status by @diegolovison in #1416
• Create kueue resources for the project by @diegolovison in #1414
• Increase the dsci timeout by @tarukumar in #1422
• Explicit move to Applications Enabled page by @diegolovison in #1432
• Add tag for Model Registry test to execute only on ODH for now by @nehachopra27 in #1426
• Include Git mirror details into test-variables.yaml by @apodhrad in #1434
• Properly set multiline custom CA Bundle by @apodhrad in #1433
• Add Training operator smoke tests to DW stack by @sutaakar in #1436
• Update codeflare-sdk tests to run against latest release tag by @Srihari1192 in #1435
• Skip Training operator smoke tests until brought to RHOAI by @sutaakar in #1446
• Fix "FA100", # Missing from __future__ import annotations, but uses typing.Optional by @jiridanek in #1441
• Fix "E721", # Use is and is not for type comparisons, or isinstance() for isinstance checks by @jiridanek in #1443
• Add python-Levenshtein to remove fuzzywuzzy warning by @tarukumar in #1450
• Add Polarion test cases for DW smoke tests by @jiripetrlik in #1449
• Fix "F841", # Local ...

2.8.0

Note: the original release date was March 15, 2024 against 1ce419d commit but we updated this so the required back-ported changes are part of this release.

What's Changed

New Tests

• Add TGIS test for fetching model from Minio object storage by @bdattoma in #1231
• adding TC for model serving setting page by @mwaykole in #1076
• Add TGIS test for bigscience/mt0-xxl model by @bdattoma in #1244
• Add support for flan-t5-xl model by @tarukumar in #1252
• Add test for flant5-xxl by @tarukumar in #1254
• Feat: Accelerators Profile Administration UI e2e Tests by @FedeAlonso in #1209
• Add test for ELYZA-japanese-Llama-2-7b-instruct by @bdattoma in #1253
• Add flan-ul test case by @tarukumar in #1261
• Add test for ibm/mpt-7b-instruct2 model by @lugi0 in #1258
• add codellama-34b-instruct-hf test by @lugi0 in #1263
• Add query to ModelInfo and Tokenize endpoints by @bdattoma in #1266
• adding TC for llama-2-13b-chat by @mwaykole in #1267
• Add test for deploying and querying a prompt-tuned google/flan-t5-xl LLM by @bdattoma in #1272

Enhancements

• RHOAIENG-23 - Cleanup CodeFlare installation code by @jiripetrlik in #1180
• Stabilize Dashboard Test Suite (415) by @manosnoam in #1235
• Improve utils.execute_command, add a Pytest selftest for it, and run it in GHA by @jiridanek in #1243
• Set namespace for dummy-storage-creds.yaml by @diegolovison in #1256
• Fix the issue with model path by @tarukumar in #1264
• For purley Kserv raw deployment teardown will fail when OSSM operator and resources are not deployed by @tarukumar in #1265
• Fix for Multi-Attach error PVC by @tarukumar in #1268
• FIx: Automation Issues from 2.8 RC1 Sanity execution by @FedeAlonso in #1274
• fix: ODS-282 Verify Content In RHODS Explore Section by @FedeAlonso in #1280
• fix: ODS-1226 Open links by @FedeAlonso in #1282
• fix: ODS-1718 update endpoint by @FedeAlonso in #1286
• Add baseline 40Gi memory request to all llm models by @lugi0 in #1278
• fix: get started and cards related tests by @FedeAlonso in #1292
• Make feature tests running on GPU and Default Raw by @bdattoma in #1277
• Fix for model response file by @tarukumar in #1294
• [Fix] Uninstallation of the RHOAI operator by @jstourac in #1245
• fix: Verify successful pipeline via UI from Pipelines->Runs view by @FedeAlonso in #1303
• Enforce the client to use a valid certificate by @diegolovison in #1285
• fix: Add productBug tag to ODS-282 by @FedeAlonso in #1304
• Backport required changes from master to releases/2.8.0 by @jstourac in #1318

Enhancements in scripts and CI/CD

• fix rosa deployment by @kobihk in #1232

Other Changes

• Fix in ocm.py for interop pipeline by @mwaykole in #1233
• update the log error messages and execute of cmd and output by @kobihk in #1234
• Reenable Kueue tests by @jiripetrlik in #1236
• increase the delete cluster timeout by @kobihk in #1238
• use cluster_id instead of cluster_name with ocm command by @kobihk in #1237
• Reapply "Add support for kueue component" by @jstourac in #1246
• add support for latest rosa version by @kobihk in #1242
• Add deployment mode support for kserve in DSC by @tarukumar in #1248
• Raise the timeout for wait of the CatalogSource to be ready. by @jstourac in #1250
• Remove Trusty tests from Sanity and Tier1 by @nehachopra27 in #1255
• RHOAIENG-3768 - Define or implement Sanity tests for KubeRay by @jiripetrlik in #1251
• Add sanity test for kueue by @ChughShilpa in #1249
• fix: New xpath on model serving runtime selection dropdown by @FedeAlonso in #1257
• Revert "Fix for Multi-Attach error PVC" by @tarukumar in #1270
• Change tier1 tag for llm model by @tarukumar in #1269
• Add tag Tier2 to kueue e2e tests by @ChughShilpa in #1262
• add existing e2e test as a sanity test for codeflare by @abhijeet-dhumal in #1260
• Delete model downloader pod after model is downloaded by @tarukumar in #1271
• Add Kserverarwa support by @tarukumar in #1273
• Wait for Hive Provision status ProvisionFailed=False up to 15 minutes by @manosnoam in #1279
• adding model-info and tokenize to the TC RHOAIENG-3483 by @mwaykole in #1281
• remove Known Issues Tags by @asanzgom in #1288
• [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1283
• Select only worker nodes by @ChughShilpa in #1284
• update the hive workaround to support the new hive by @kobihk in #1287
• RHOAIENG-4488 - Remove test-run-dw-tests.robot by @jiripetrlik in #1291
• RHOAIENG-3767 Implement Smoke tests for DW components by @jiripetrlik in #1290
• Store DSC CR in case waiting for component fails by @sutaakar in #1297
• Extend the timeout waiting for component to be enabled by @sutaakar in #1300
• [RHOAIENG-3757] DW: Reduce time of setting up of e2e tests by @sutaakar in #1293
• Modify the env name with actually parameter name by @tarukumar in #1299
• fix: add productbug tag to ODS-1969 by @FedeAlonso in #1298

New Contributors

• @abhijeet-dhumal made their first contribution in #1260
• @sutaakar made their first contribution in #1283

Full Changelog: 2.7.0...2.8.0

2.8.2

What's Changed

Enhancements

• Update the tgis runtime for rhoai_2_8_z by @tarukumar in #1417
• Backport some of the changes from master to 2.8 by @jstourac in #1419

Full Changelog: 2.8.1...2.8.2

2.9.0

What's Changed

New Tests

• RHOAIENG-3425 - Validate Trusted CA Bundle by @mattmahoneyrh in #1310
• RHOAIENG-2519 Service Mesh Test Case by @mattmahoneyrh in #1336
• RHOAIENG-2508 ODS-2600 Validate DSC creates all Serverless CRs by @asanzgom in #1259
• RHOAIENG-5092 - Validate Authorino Resources by @mattmahoneyrh in #1346
• Add check on containers list for KServe model deployments by @bdattoma in #1400
• RHOAIENG-4500 Model registry Operator Deployment by @nehachopra27 in #1295

New Tasks

• Add Provisioning ability for IBM Cloud Self-managed by @bdattoma in #1335

Enhancements

• Install Authorino Operator as a prerequisite for RHOAI 2.9+ by @jstourac in #1289
• Fix deletion confirmation message change in RHOAI 2.9.0 Dashboard by @jiridanek in #1301
• Adding link to ticket bugs in some tests by @bdattoma in #1296
• Fix Dashboard Tests for ODH and RHOAI 2.9 by @manosnoam in #1308
• [Fix] request body logged content by @jstourac in #1316
• [Fix] cleanup for the dashboard api tests by @jstourac in #1317
• [Fix] Notebook API test by @jstourac in #1306
• Migrate pipelines tests to DSPv2 (pipelines-api, pipelines-kfp) by @diegolovison in #1312
• Migrate to pipeline v2 by @diegolovison in #1322
• Reuse KW Wait For Dashboard Page Title in more tests by @manosnoam in #1321
• Use cluster id while adding machinepool by @tarukumar in #1324
• Fix linter errors in DataSciencePipelinesKfp.py and ray_integration.py by @jiridanek in #1325
• Migrate to pipeline v2 (DataSciencePipelinesKfp) by @diegolovison in #1328
• Add support to open also ODH via application list by @jstourac in #1319
• Fix linter errors in iris_pipeline.py by @jiridanek in #1332
• Exclude AI apps tests on ODH since these are irrelevant there by @jstourac in #1338
• Open Data Science Project Details Page also switch to a requested tab by @manosnoam in #1333
• Update new runtime image for tgis with snyk fixes by @tarukumar in #1340
• [RHOAIENG-5073] Add pod port fowarding for raw due to headless service by @tarukumar in #1343
• Update dashboard tests "415" by @manosnoam in #1344
• Update Keywords for the new UI: Test suite 420__model_serving.robot by @manosnoam in #1345
• Update Xpath data-testid for Jupyter Explorer Card by @manosnoam in #1350
• Fix "F811", # Redefinition of unused hide_values_in_op_json from line 565 by @jiridanek in #1353
• Fix "W605", # Invalid escape sequence: \d by @jiridanek in #1354
• Add common KW Open "Get Started" For App Name by @manosnoam in #1352
• Fix "RET503", # Missing explicit return at the end of function able to return non-None value by @jiridanek in #1357
• Revert "Fix "RET503", # Missing explicit return at the end of funct… by @jstourac in #1360
• Enhance Pipelines UI tests for DSPv2 and add some example pipelines by @jgarciao in #1358
• fix: Delete outdated skipped tests by @FedeAlonso in #1362
• fix: Delete AutomationBug tag from ODS-2379 by @FedeAlonso in #1361
• Speed-up execution of keyword "Is RHODS Self-Managed" in local by @jgarciao in #1366
• Add ibmcloud among supported platform for RHOAI install task by @bdattoma in #1364
• In RHOAI 2.9, the number of containers for envoy increased by @diegolovison in #1371
• Fix "RET503", # Missing explicit return at the end of function able… by @jiridanek in #1369
• "B007", # Loop control variable retry not used within loop body by @jiridanek in #1374
• Change IBM Watson Studio to IBM watsonx.ai title in 2.9+ by @jstourac in #1372
• Dashboard Sanity tests fixes for RHOAI 2.9 by @manosnoam in #1363
• Fix "PLR5501", # Use elif instead of else then if, to reduce indentation by @jiridanek in #1375
• Change IBM Watson Studio to IBM watsonx.ai references for 2.9+ by @jstourac in #1376
• Update Xpath for WORKBENCH_IMAGE by @manosnoam in #1382
• fix: ODS-1814 wrong xpath by @FedeAlonso in #1383
• Migrate pipelines tests to DSPv2 by @diegolovison in #1378
• fix: ODS-2054 issues by @FedeAlonso in #1384
• Adapt Trusted CA bundles tests to ODH by @asanzgom in #1380
• Verify That There Are No Sample Pipelines After Creating Pipeline Server in RHOAI by @Raghul-M in #1368
• Fix required xpaths for the selection of the model server template by @jstourac in #1387
• fix: ODS-2276 and ODS-2279 issues by @FedeAlonso in #1388
• Fix and exclude some tests in smoke for odh compatibility by @jgarciao in #1381
• Fix Canary rollout and non-admin test case in Caikit+TGIS suite (Sanity) by @bdattoma in #1390
• Fix expected version of Jupyterhub-git package for 2024.1 images by @jstourac in #1393
• Fix Quickstart tests in 412__ods_dashboard_resources.robot by @manosnoam in #1395
• Add self-signed CA bundle support for kserve grpc/http requests by @lugi0 in #1391
• Fixing Automation For Elyra Test in Dspv2 by @Raghul-M in #1394
• fix: DS Projects permission mgmt tests by @FedeAlonso in #1399
• Rhoaieng 6358 restore custom ca bundle by @mattmahoneyrh in #1398
• fix: ODS-2542 outdated xpaths by @FedeAlonso in #1403
• Update Serving Runtime images for API testing by @bdattoma in #1406
• Fix/420 model serving dashboard tests by @FedeAlonso in #1402
• Embed required data in iris-pipeline to avoid an external connection and improve compatibility with disconnected clusters by @diegolovison in #1408
• Remove workaround needed for self-signed S3 by @apodhrad in #1407
• Migrate the code to the latest changes in DW by @diegolovison in #1410
• Fix Verify Switcher to Masterhead test by @jstourac in #1404
• Fix: GPU related tests by @FedeAlonso in #1413

Enhancements in scripts and CI/CD

• Replace black and isort with ruff by @jiridanek in #1337
• Configure include and exclude paths for ruff linter by @jiridanek in #1359
• Add ruff to pre-commit by @jiridanek in #1341
• Refine execute_command function for printing aligned tabbed tables by @jiridanek in #1379

Misc

• Add DependencyLibrary to support test case/suite dependency by @manosnoam in #1323
• Add pyright typechecker...

2.8.1

What's Changed

Other Changes

• Another 2.8 backport changes by @jstourac in #1348

Full Changelog: 2.8.0...2.8.1

2.7.0

What's Changed

New Tests

• New Tests in Model Serving: Verify changes to existing model resources by @manosnoam in #1185
• Run pipeline upstream tests in ods-ci by @diegolovison in #1144
• Add tests for OVMS on Kserve by @lugi0 in #1194
• Fix modelmesh suite, add test for productbug RHOAIENG-2869 by @lugi0 in #1211
• Add OVMS on Kserve GPU test by @lugi0 in #1212
• Add parity between Caikit+TGIS and TGIS standalone test suites by @bdattoma in #1218
• [RHOAIENG-223] Test VSCode - add checks for VS Code image by @jstourac in #1102
• Automated test for checking the input for duplicated pipeline run by @diegolovison in #1220

Enhancements

• Add log gather when pod doesn't get ready by timeout by @bdattoma in #1179
• [Fix] wait for the RHOAI/ODH operator CSV to be in state condition Su… by @jstourac in #1177
• Add event and pod logs fetch in Model Mesh tests by @bdattoma in #1184
• Fix for the wait of the CatalogSource to be in Ready state by @jstourac in #1187
• Fix data science pipeline tests in Smoke due to changes related to pipeline versions by @jgarciao in #1189
• Remove managed starburst files by @bdattoma in #1190
• Fix 'Csv Is Ready' KW that fails due to wrong oc command by @manosnoam in #1191
• Update runtime yamls by @bdattoma in #1182
• Verify Pipeline Run Is Completed by @diegolovison in #1205
• Fix 'Clean All Models Of Current User' KW by @manosnoam in #1203
• Update ODS-CI image with Python version arg = 3.11 by @manosnoam in #1216
• Fix Custom Serving Runtime sanity tests by @bdattoma in #1226
• Add error message and continue on failure of bug RHOAIENG-404 by @manosnoam in #1225
• [Fix] jupyter notebook spawn checks by @jstourac in #1228
• fix to create user or idp by cluster id by @kobihk in #1229

Enhancements in scripts and CI/CD

• Pin Python version to 3.11 by @jiridanek in #1118

Misc

• [Fix] image creation via Dockerfile after move to Python 3.11 by @jstourac in #1213

Other Changes

• Decrease TTL for our DNS records for the cluster creation. by @jstourac in #1178
• Add Kueue tests to Tier2 by @jiripetrlik in #1181
• Transition to utilizing the latest version of OpenShift Pipeline Operator by @diegolovison in #1175
• Add support for kueue component whihc got added in 2.7 by @tarukumar in #1183
• Enable & Disable kueue as DSC component by @ChughShilpa in #1188
• Stick with pipelines v1 by @diegolovison in #1193
• [Fix] the image content source repo link has changed recently by @jstourac in #1105
• Another fix to Wait Until Csv Is Ready keyword by @manosnoam in #1195
• Add support to UI admin group in explore cluster by @tarukumar in #1196
• Fix problem with Ray image in DW by @jiripetrlik in #1197
• Increase timeouts for Kuberay tests by @jiripetrlik in #1198
• Fix missing GIT params for DW repo by @jiripetrlik in #1199
• Fix codeflare timeouts by @jiripetrlik in #1201
• Add wait time for the pod to become ready by @tarukumar in #1208
• Disable kueue tests by @jiripetrlik in #1206
• Skip a PV Storage test on disconnected by @jstourac in #1204
• Test Automation for Pipeline Log by @diegolovison in #1210
• Update oc_install.robot by @tarukumar in #1214
• Add Polarion ID to Run Data Science Pipelines Operator Integration Tests by @diegolovison in #1219
• remove bias tests by @nehachopra27 in #1222
• Check kserve is enabled by @lugi0 in #1221
• Fix DW sanity tests parameters by @jiripetrlik in #1224
• Remove visibility test & add env var 'NAMESPACE' by @ChughShilpa in #1217
• Update the line length to 120 by @kobihk in #1230

New Contributors

• @kobihk made their first contribution in #1229

Full Changelog: 2.6.0...2.7.0

2.6.0

What's Changed

New Tests

• Add edit/admin permissions tests for Kserve UI by @lugi0 in #1081
• RHOAIENG-1179 Verify user can create a workbench with an existing data connection by @jiridanek in #1094
• New Test ODS-2223 by @manosnoam in #1101
• Verify GPU AcceleratorProfile is created after restarting Dashboard by @manosnoam in #1103
• ODS-1975 - Verify user can cancel workbench start from event log [AUTOMATION] by @jiridanek in #1104
• Add e2e test for Caikit Nlp Client by @bdattoma in #1075
• Test Automation ODS-2173 Verify user can create a workbench using Intel AiKit image by @asanzgom in #1107
• [RHOAIENG-1574] - Add codeflare-sdk e2e tests by @ChughShilpa in #1112
• Add automated test for TGIS Standalone serving runtime (gRPC CLI) by @bdattoma in #1124
• Add test to verify Dashboard detects OpenShift Pipelines operator by @Raghul-M in #1141
• DIR SPD tests for Trusty AI by @nehachopra27 in #1088
• Add UI testing for TGIS Standalone by @bdattoma in #1151
• Add Kueue tests by @ChughShilpa in #1148

Enhancements

• [Fix] the Tests.Jupyterhub.Test-Jupyterlab-Git-Notebook by @jstourac in #1014
• [Fix] the test that checks the User/Group privileges permissions by @jstourac in #1064
• After installation, verify the monitoring stack only for managed by @jgarciao in #1077
• Improve Hive deployment to fail fast on fatal error, and fix deprovision logic by @manosnoam in #1078
• Pass Execution at the end of 'Provision Self-Managed Cluster' by @manosnoam in #1083
• Remove SMMR clean up from KServe test teardown by @bdattoma in #1082
• Workaround for old Hive with Openstack by @manosnoam in #1089
• Keywords for management of components by @jiripetrlik in #1085
• Add missing taint for gpu node by @tarukumar in #1091
• RHODS-13159: Use the new parameter 'base_domain' in ods-ci by @apodhrad in #1097
• Flip coin pipeline compiled by @diegolovison in #1109
• Fix ODS-493 (and other Explore tab tests) for ODH 2.6 by @jiridanek in #1111
• Fix test "Verify CSS Style Of Getting Started Descriptions" by @jgarciao in #1116
• Fix: 2.6 xpath fixes by @FedeAlonso in #1114
• Fix "Click Action From Actions Menu" and CustomServingRuntime test by @bdattoma in #1117
• Patternfly changes for gpu model serving by @tarukumar in #1123
• Fix ODS-2206, ODS-2226 for ODH 2.6 by @jiridanek in #1113
• Fix pf5 xpaths for Verify User Can Create And Start A Workbench Adding A New PV Storage by @jiridanek in #1126
• Move LLM CLI tests from Smoke to Sanity by @bdattoma in #1127
• Fix model serving tests in 2.6 by @bdattoma in #1125
• Fix projects page selector path by @bdattoma in #1130
• Remove ODS-1005(KFDEF) TC from the repo by @tarukumar in #1129
• Enhance "Verify That XXXXXX Image Is A CPaaS Built Image" tests by @jgarciao in #1131
• Add support for self-signed certificates by @apodhrad in #1135
• Fix for RHOAM check of the tile on the Explore page by @jstourac in #1147
• Fix xpath to env var remove button for notebook spawn by @jstourac in #1146
• Give a bit more time to load the UI elements for DS project page tests by @jstourac in #1145
• Add RHOSi Setup and RHOSi Teardown in all test suites of distributed workloads by @ChughShilpa in #1133
• Remove busybox workaround for ray by @diegolovison in #1152
• Fix: Dashboard automation errors for 2.6 pt1 by @FedeAlonso in #1132
• Adjust tests for Kuberay 1.0 by @jiripetrlik in #1150
• Fix timing issue when logging into OpenShift. Remove deprecated jupyter test by @jgarciao in #1154
• Fix library versions tests by @lugi0 in #1143
• Fix pipeline url by @diegolovison in #1156
• Trivial logging update attempt and increase of timeout by @jstourac in #1155
• Update CA_BUNDLE whenever we create DS pipeline server by @apodhrad in #1153
• Fix the broken dryrun tests with Trusty deployment by @nehachopra27 in #1159
• Revert "[Fix] attempt to stabilize the Logged Into OpenShift test (… by @jstourac in #1164
• Increase timeout for DSPO reconciliation retry by @diegolovison in #1163
• Fix broken sanity tests + Add skip wait option in test teardown in model serving by @bdattoma in #1157
• Fix CI ruff check for the take_nap.py file recently added by @jstourac in #1166
• Updating incorrect variable syntax metrics by @nehachopra27 in #1167
• Fix multiple Sanity failures in 2.6 by @lugi0 in #1158
• Use must-gather with sha256 digest by @apodhrad in #1169
• Enhancements for Trusty Tests by @nehachopra27 in #1172
• Fix test some LLM UI tests from Smoke by @bdattoma in #1170
• [Fix] Workbenches - fix xpaths for env variables section by @jstourac in #1173
• [Fix] for the window title to accomodate with RHOAI 2.5 by @jstourac in #1050

Enhancements in scripts and CI/CD

• Add __init__.py files in utils/ to mark directories as Python packages in PyCharm by @jiridanek in #1098
• Add ruff Python linter and suppress reported issues by @jiridanek in #1099
• Fix various Python lint warnings using ruff auto-fixes by @jiridanek in #1100
• Improve the code quality ruff action by @jiridanek in #1119
• Check for pre-created virtual environment to save time on repeated poetry installs by @jiridanek in #1128
• Declare and use currentpath and basepath constants in shell script by @jiridanek in #1137
• Removal of unused Polarion scripts by @jstourac in #1174
• Update defaults for test variables generation. by @jstourac in #1096

Misc

• Rename Force Tags to Test Tags due to deprecation by @jstourac in #1134
• Add take-nap example pipeline by @jgarciao in #1162

Other Changes

• Fix 'Operator Subscription Last Condition Should Be' by @manosnoam in #1079
• Add Check for dependent operator(Serverless and servicemesh) if it is Installed or not by @tarukumar in #1080
• Update of the CONTRIBUTING guide. by @jstourac in #1095
• Add support to validate gpu driver ,demonset etc validator pod verifcation after NFD resource are created by @tarukumar in #1090
• RHODS-12892: Parameterize the hive namespace by @apodhrad i...