ENH: functional support for Array API

[samir-nasibli]

Description

Array API functional support without zero-copy in scikit-learn-intelex.
Depends on #1999 and #1998

Brings extension for the device_offload logic and extends support_usm_ndarray decorator and make this work also for the array-api-strict inputs. New support_array_api decorator mainly impl Array API functional support in scikit-learn-intelex.

Proposed changes shown on the dataflow diagram below. Yellow plates is extensions in the sklearnex dataflow diagram and show the first iteration of the scikit-learn-intelex Array API support (functional support).

Works fine with array-api-strict v1 and v2 as well. Some test suits requires updates for the v2, that will be solved on #2012

Changes includes:

• updates on _device_offload modules both of onedal4py and sklearnex.
  • extensions for sklearnex._device_offload.wrap_output_data decorator and sklearnex._device_offload.dispatch function.
  • onedal._device_offload._transfer_to_host extended for the Array API inputs.
  • onedal._device_offload.support_usm_ndarray renamed to onedal._device_offload.support_array_api extend for Array API inputs handling. (several files changed for this this renaming)
• onedal4py's testing utility get_dataframes_and_queues extended for the array_api inputs
• _array_api modules added in the both onedal4py and sklearnex.\
  • onedal.utils._array_api module includes several array api utilities and _get_sycl_namespace that is used in the get_namespace (from sklearnex.utils._arrray_api), that returns supported array api namespace.

Changes are documented in the files. General documentation for Array API support will be able at #1918

Test statistics

More than 2834 new test cases (+ 46%) added for Array API inputs. On sklearnex testing you may observe the rise of test pass statistics
from
5943 passed, 898 skipped, 42083 warnings in 394.72s (0:06:34)
to
8674 passed, 1001 skipped, 44350 warnings in 538.83s (0:08:58)

• I have reviewed my changes thoroughly before submitting this pull request.
• I have commented my code, particularly in hard-to-understand areas.
• I have updated the documentation to reflect the changes, if necessary (updated in DOC: Array API support #1918)
• The unit tests pass successfully.
• I have run it locally and tested the changes extensively.
• I have resolved any merge conflicts that might occur with the base branch.
• Git commit message contains an appropriate signed-off-by string (see CONTRIBUTING.md for details)
• I have added a respective label(s) to PR if I have a permission for that.

[samir-nasibli]

/intelci: run

[samir-nasibli]

/intelci: run

[samir-nasibli]

/intelci: run

CI is Green. Test fails are related #2031

[icfaust]

Left a comment elsewhere on a previous review item, just a quick check. Looking pretty good, will give another review by tomorrow.

[samir-nasibli]

/intelci: run

[samir-nasibli]

/intelci: run

[samir-nasibli]

/intelci: run

[icfaust]

I have verified the extension of testing for sklearn > 1.2 for array_api, and looked at the performance numbers, small comments to answer before approval. Any update on who else has glanced at this, or is unwilling to review?

[samir-nasibli]

/intelci: run

[icfaust]

ready to go