Add Mobile NeRF Ray Query Sample

[RodrigoHolztrattner-QuIC]

Description

Adds a new sample, Mobile NeRF Ray Query, which is an upgraded version of the original Mobile NeRF sample. This one uses rayqueries to accelerate the NeRF processing.

General Checklist:

Please ensure the following points are checked:

• My code follows the coding style
• I have reviewed file licenses
• I have commented any added functions (in line with Doxygen)
• I have commented any code that could be hard to understand
• My changes do not add any new compiler warnings
• My changes do not add any new validation layer errors or warnings
• I have used existing framework/helper functions where possible
• My changes do not add any regressions
• I have tested every sample to ensure everything runs correctly
• This PR describes the scope and expected impact of the changes I am making

Note: The Samples CI runs a number of checks including:

• I have updated the header Copyright to reflect the current year (CI build will fail if Copyright is out of date)
• My changes build on Windows, Linux, macOS and Android. Otherwise I have documented any exceptions

If this PR contains framework changes:

• I did a full batch run using the batch command line argument to make sure all samples still work properly

Sample Checklist

If your PR contains a new or modified sample, these further checks must be carried out in addition to the General Checklist:

• I have tested the sample on at least one compliant Vulkan implementation
• If the sample is vendor-specific, I have tagged it appropriately
• I have stated on what implementation the sample has been tested so that others can test on different implementations and platforms
• Any dependent assets have been merged and published in downstream modules
• For new samples, I have added a paragraph with a summary to the appropriate chapter in the readme of the folder that the sample belongs to e.g. api samples readme
• For new samples, I have added a tutorial README.md file to guide users through what they need to know to implement code using this feature. For example, see conditional_rendering
• For new samples, I have added a link to the Antora navigation so that the sample will be listed at the Vulkan documentation site

[RodrigoHolztrattner-QuIC]

Moving sample out from draft (for review).

Note: There are some VUID-vkCmdBuildAccelerationStructuresKHR-pInfos-03710 validation errors on AMD devices when using acceleration structures. The ray_tracing_extended sample seems to trigger this same errors as well. This might be device/driver dependent and not really an issue on more up-to-date HW/drivers.

An old and similar issue raytracing_extended sample fails with a scratch buffer alignment problem · Issue #393 · KhronosGroup/Vulkan-Samples · GitHub was supposedly tracking this problem and closed as resolved, but for me at least it, it is still present.

These errors do not appear on NVIDIA's or mobile devices in general.

[SaschaWillems]

Unlike the existing mobile NeRF sample, this one does not work for me. I get this error at startup:

[error] Required device extension VK_KHR_get_physical_device_properties2 not available, cannot run
[error] Error Message: Extensions not present : ERROR_EXTENSION_NOT_PRESENT
[error] Failed when running application Mobile NeRF Ray Query

This is caused, by VK_KHR_get_physical_device_properties2 being added as a device extension, while it actually is an instance level extension.

[SaschaWillems]

Also mouse camera controls feel odd. Like they're inverted, compared to the other mobile NeRF sample.

[SaschaWillems]

The sample also trigger a lot of warnings about uninitialized variables (~75). Those need to be fixed too.

[SaschaWillems]

I also get these validation messages with the latest SDK:

[error] 269944751 - VUID-RuntimeSpirv-NonWritable-06340: Validation Error: [ VUID-RuntimeSpirv-NonWritable-06340 ] Object 0: handle = 0x59f7450000000038, type = VK_OBJECT_TYPE_SHADER_MODULE; | MessageID = 0x101707af | vkCreateGraphicsPipelines(): pCreateInfos[0].pStages[1] SPIR-V (VK_SHADER_STAGE_FRAGMENT_BIT) uses descriptor [Set 2, Binding 0, variable "indices_set"] (type VK_DESCRIPTOR_TYPE_STORAGE_BUFFER or VK_DESCRIPTOR_TYPE_STORAGE_BUFFER_DYNAMIC) which is not marked with NonWritable, but fragmentStoresAndAtomics was not enabled. The Vulkan spec states: If fragmentStoresAndAtomics is not enabled, then all storage image, storage texel buffer, and storage buffer variables in the fragment stage must be decorated with the NonWritable decoration (https://vulkan.lunarg.com/doc/view/1.3.290.0/windows/1.3-extensions/vkspec.html#VUID-RuntimeSpirv-NonWritable-06340)
[error] 269944751 - VUID-RuntimeSpirv-NonWritable-06340: Validation Error: [ VUID-RuntimeSpirv-NonWritable-06340 ] Object 0: handle = 0x59f7450000000038, type = VK_OBJECT_TYPE_SHADER_MODULE; | MessageID = 0x101707af | vkCreateGraphicsPipelines(): pCreateInfos[0].pStages[1] SPIR-V (VK_SHADER_STAGE_FRAGMENT_BIT) uses descriptor [Set 1, Binding 0, variable "vertices_set"] (type VK_DESCRIPTOR_TYPE_STORAGE_BUFFER or VK_DESCRIPTOR_TYPE_STORAGE_BUFFER_DYNAMIC) which is not marked with NonWritable, but fragmentStoresAndAtomics was not enabled. The Vulkan spec states: If fragmentStoresAndAtomics is not enabled, then all storage image, storage texel buffer, and storage buffer variables in the fragment stage must be decorated with the NonWritable decoration (https://vulkan.lunarg.com/doc/view/1.3.290.0/windows/1.3-extensions/vkspec.html#VUID-RuntimeSpirv-NonWritable-06340)

[RodrigoHolztrattner-QuIC]

Hi @SaschaWillems , I got the updated code from the team and update the PR, thanks for your feedback!

[asuessenbach]

I have to admit, I can't follow all that mlp-stuff...
But there are a few minor issues, and the camera movement is not consistent: moving left/right is correct but up/down is inverted.

[RodrigoHolztrattner-QuIC]

Hi @asuessenbach, I just got the updated code from the team and updated the PR, the remaining issues should all have been addressed.

[SaschaWillems]

Good looks good (aside from a very minor thing, see my comment), sample runs fine.

But I do get this validation error at startup:

[error] 115483881 - VUID-VkShaderModuleCreateInfo-pCode-08740: Validation Error: [ VUID-VkShaderModuleCreateInfo-pCode-08740 ] | MessageID = 0x6e224e9 | vkCreateShaderModule():  SPIR-V Capability UniformBufferArrayNonUniformIndexing was declared, but one of the following requirements is required (VkPhysicalDeviceVulkan12Features::shaderUniformBufferArrayNonUniformIndexing). The Vulkan spec states: If pCode is a pointer to SPIR-V code, and pCode declares any of the capabilities listed in the SPIR-V Environment appendix, one of the corresponding requirements must be satisfied (https://vulkan.lunarg.com/doc/view/1.3.290.0/windows/1.3-extensions/vkspec.html#VUID-VkShaderModuleCreateInfo-pCode-08740)

Looks like that feature isn't enabled.

[RodrigoHolztrattner-QuIC]

@SaschaWillems I was trying to resolve the issue below before pushing the changes to fix the validation layer error, at this point I'm starting to think it's a problem with the framework and not actually the sample, but just letting you know the latest version shouldn't have any validation errors anymore.

Gralloc4                com.khronos.vulkan_samples           E  isSupported(1, 1, 59, 1, ...) failed with 7
GraphicBufferAllocator  com.khronos.vulkan_samples           E  Failed to allocate (4 x 4) layerCount 1 format 59 usage b00: 2
AHardwareBuffer         com.khronos.vulkan_samples           E  GraphicBuffer(w=4, h=4, lc=1) failed (Unknown error -2), handle=0x0

[RodrigoHolztrattner-QuIC]

It seems other samples have the errors I mentioned above, it doesn't seem specific to this one.