Test failures with rmw_zenoh #286

Yadunund · 2024-09-26T20:26:54Z

This ticket will track the status of test failures with rmw_zenoh.

Below is the template to be used with an example. Let's copy paste this each time we make changes to the ros2.repos file from
https://github.com/Yadunund/ros2/blob/yadu/rmw_zenoh_testing/ros2.repos

Test setup

Date: 26-09-2024
ros2.repos file: https://github.com/Yadunund/ros2/blob/c425fa9d0ced5bfca6e530141fc1f1629be7e720/ros2.repos

rmw_zenoh/rolling

rmw_zenoh commit: b3e4a63

ROS Package	Failing test name	Failing test output
rclcpp	33 - test_intra_process_manager	gist

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: 6a48919

ROS Package	Failing test name	Failing test output

Additional tips

Individual tests can be run with a command like colcon test --event-handlers console_direct+ --packages-select rcl --ctest-args -R test_graph

The text was updated successfully, but these errors were encountered:

ahcorde · 2024-09-27T14:52:54Z

Test setup

Date: 30-09-2024
ros2.repos file: https://gist.github.com/ahcorde/d5b6d86762badd54cfc5021b01705dc8

rmw_zenoh/rolling

rmw_zenoh commit: 67ed661

ROS Package	Failing test name	Failing test output
rcl	None
rcl_action	None
rcl_lifecyle	None
rcl_yaml_param_parser	None
rclcpp	test_intra_process_manager	description below
rclcpp	test_node_interfaces__node_graph	description below
rclcpp	test_publisher	description below
rclcpp	test_qos	description below
rclcpp	test_events_executor	Timeout
rclcpp	test_wait_set	description below
rclcpp_action	None

test_node_interfaces__node_graph

44: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/node_interfaces/test_node_graph.cpp:645: Failure
44: Value of: endpoint_gid_is_all_zeros
44:   Actual: true
44: Expected: false

test_intra_process_manager

33: [WARN] [1727705634.805297595] [rclcpp]: Calling get_subscription_count for invalid or no longer existing publisher id
33: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_intra_process_manager.cpp:500: Failure
33: Expected equality of these values:
33:   1u
33:     Which is: 1
33:   p1_subs
33:     Which is: 2

test_publisher

62: [ERROR] [1727705680.331005842] [rclcpp]: Couldn't take event info: rmw_take_event called when event queue for event type [9] is empty, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:210, at /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/src/rcl/event.c:175
62: unknown file: Failure
62: C++ exception with description "'data' is empty" thrown in the test body.
62: 
62: [  FAILED  ] TestPublisher.run_event_handlers (7 ms)
62: [ RUN      ] TestPublisher.get_network_flow_endpoints_errors

test_qos

67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:249: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Error
67:     Which is: 4-byte object <02-00 00-00>
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:250: Failure
67: Value of: ret.reason.empty()
67:   Actual: true
67: Expected: false
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:258: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Warning
67:     Which is: 4-byte object <01-00 00-00>
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:259: Failure
67: Value of: ret.reason.empty()
67:   Actual: true
67: Expected: false

test_wait_set

108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 7 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:57" thrown in the test body.
108: 
108: [  FAILED  ] TestWaitSet.add_guard_condition_to_two_different_wait_set (13 ms)
108: [ RUN      ] TestWaitSet.add_remove_wait
108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 1 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:114" thrown in the test body.

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: * rmw_zenoh commit: 8d3fce9 and cherry-pick 8e883bc and b3e4a63

ROS Package	Failing test name	Failing test output
rcl	test_graph__rmw_zenoh_cpp	description below
rcl_action	test_action_communication__rmw_zenoh_cpp	description below
rcl_action	test_action_communication__rmw_zenoh_cpp	description below
rcl_action	test_graph__rmw_zenoh_cpp	description below
rcl_action	test_action_server	timeout
rcl_lifecyle	test_rcl_lifecycle	Timeout
rcl_yaml_param_parser	None	description below
rclcpp	test_allocator_memory_strategy	timeout
rclcpp	test_intra_process_manager	description below
rclcpp	test_node_interfaces__node_graph	description below
rclcpp	test_parameter_client	description below
rclcpp	test_publisher	description below
rclcpp	test_qos	description below
rclcpp	test_wait_for_message	description below
rclcpp	test_events_executor	timeout
rclcpp	test_wait_set	description below
rclcpp_action	test_client	timeout

test_action_communication (rcl_action)

11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:561: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 2
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:573: Failure
11: Value of: this->is_status_ready
11:   Actual: false
11: Expected: true
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:581: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 4103
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:584: Failure
11: Expected equality of these values:
11:   status_array.msg.status_list.size
11:     Which is: 1
11:   incoming_status_array.status_list.size
11:     Which is: 0

test_wait_set (rclcpp)

108: [ RUN      ] TestWaitSet.add_guard_condition_to_two_different_wait_set
108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 7 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:53" thrown in the test body.
108: 
108: [  FAILED  ] TestWaitSet.add_guard_condition_to_two_different_wait_set (16 ms)
108: [ RUN      ] TestWaitSet.add_remove_wait
108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 1 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:108" thrown in the test body.

test_wait_for_message (rclcpp)

segfault

rclcpp/rclcpp/test/rclcpp/test_wait_for_message.cpp:66

  auto wait = std::async(
    [&]() {
      auto ret = rclcpp::wait_for_message(out, node, "wait_for_message_topic" /*, -1 */);
      EXPECT_TRUE(ret);
      received = true;
    });

test_qos

67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:249: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Error
67:     Which is: 4-byte object <02-00 00-00>
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:250: Failure
67: Value of: ret.reason.empty()
67:   Actual: true
67: Expected: false
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:258: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Warning
67:     Which is: 4-byte object <01-00 00-00>

test_publisher (rclcpp)

62: [ RUN      ] TestPublisher.run_event_handlers
62: [ERROR] [1727446457.693761159] [rclcpp]: Couldn't take event info: rmw_take_event called when event queue for event type [9] is empty, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:204, at /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/src/rcl/event.c:175
62: unknown file: Failure
62: C++ exception with description "'data' is empty" thrown in the test body.

test_parameter_client (rclcpp)

56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:225: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameter_types (154 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameter_types_allow_undeclared
[Processing: rclcpp]                           
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:249: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameter_types_allow_undeclared (179 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameters
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:271: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameters (184 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameters_allow_undeclared
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:293: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameters_allow_undeclared (188 ms)
56: [ RUN      ] TestParameterClient.async_parameter_set_parameters_atomically
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:319: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_set_parameters_atomically (195 ms)
56: [ RUN      ] TestParameterClient.async_parameter_list_parameters
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:341: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)

test_node_interfaces__node_graph (rclcpp)

44: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/node_interfaces/test_node_graph.cpp:645: Failure
44: Value of: endpoint_gid_is_all_zeros
44:   Actual: true
44: Expected: false

test_intra_process_manager (rclcpp)

33: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_intra_process_manager.cpp:500: Failure
33: Expected equality of these values:
33:   1u
33:     Which is: 1
33:   p1_subs
33:     Which is: 2

test_graph__rmw_zenoh_cpp (rcl)

## 98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_subscriptions
98: [INFO] [1727443659.794092209] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443659.904155956] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443660.014433695] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_subscriptions (11335 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_publishers
98: [INFO] [1727443671.129462597] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443671.239459961] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443671.349025268] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
[Processing: rcl]                   
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_publishers (11333 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_services
98: [INFO] [1727443682.462878296] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443682.573755535] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443682.685009797] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_services (11335 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_clients
98: [INFO] [1727443693.798310426] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443693.908402327] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443694.018363041] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes

test_action_interaction__rmw_zenoh_cpp

11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:561: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 2
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:573: Failure
11: Value of: this->is_status_ready
11:   Actual: false
11: Expected: true
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:581: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 4103
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:584: Failure
11: Expected equality of these values:
11:   status_array.msg.status_list.size
11:     Which is: 1
11:   incoming_status_array.status_list.size
11:     Which is: 0

test_graph__rmw_zenoh_cpp (rcl_action)

13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_names_and_types (5333 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.test_action_get_server_names_and_types_by_node
13: [INFO] [1727443806.650512802] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443806.761221554] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443806.871264871] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_server_names_and_types_by_node (5333 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.test_action_get_client_names_and_types_by_node
13: [INFO] [1727443811.983360414] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443812.093825005] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443812.203928627] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_client_names_and_types_by_node (5332 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.get_names_and_types_maybe_fail
13: [INFO] [1727443817.315966907] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443817.428000517] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443817.537953229] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
[Processing: rcl_action]                   
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.get_names_and_types_maybe_fail (5334 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.action_client_init_maybe_fail
13: [INFO] [1727443822.650237406] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443822.760814004] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443822.870295696] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.action_client_init_maybe_fail (5378 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.rcl_get_client_names_and_types_by_node_maybe_fail
13: [INFO] [1727443828.031448905] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443828.145644359] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443828.256353051] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.rcl_get_client_names_and_types_by_node_maybe_fail (5339 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.rcl_get_server_names_and_types_by_node_maybe_fail
13: [INFO] [1727443833.367802389] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443833.480293497] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443833.590140755] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes

test_server

2: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp_action/test/test_server.cpp:1223: Failure
2: Expected equality of these values:
2:   "cancel request future timed out"
2:   e.what()
2:     Which is: "send goal future timed out"

ahcorde · 2024-09-30T14:28:48Z

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: * rmw_zenoh commit: 63530b7

ROS Package	Failing test name	Failing test output
rcl	test_graph__rmw_zenoh_cpp	description below
rcl_action	test_action_communication__rmw_zenoh_cpp	description below
rcl_action	test_graph__rmw_zenoh_cpp	description below
rcl_action	test_action_server	timeout
rcl_lifecyle	test_rcl_lifecycle	Timeout
rcl_yaml_param_parser	None	description below
rclcpp	test_allocator_memory_strategy	timeout
rclcpp	test_clock	flaky
rclcpp	test_intra_process_manager	description below
rclcpp	test_node_interfaces__node_graph	description below
rclcpp	test_parameter_client	description below
rclcpp	test_publisher	description below
rclcpp	test_qos	description below
rclcpp	test_wait_for_message	description below
rclcpp	test_events_executor	timeout
rclcpp	test_wait_set	description below
rclcpp_action	test_client	timeout
rclcpp_action	test_server	timeout

test_action_communication (rcl_action)

11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:561: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 2
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:573: Failure
11: Value of: this->is_status_ready
11:   Actual: false
11: Expected: true
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:581: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 4103
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:584: Failure
11: Expected equality of these values:
11:   status_array.msg.status_list.size
11:     Which is: 1
11:   incoming_status_array.status_list.size
11:     Which is: 0

test_wait_set (rclcpp)

108: [ RUN      ] TestWaitSet.add_guard_condition_to_two_different_wait_set
108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 7 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:53" thrown in the test body.
108: 
108: [  FAILED  ] TestWaitSet.add_guard_condition_to_two_different_wait_set (16 ms)
108: [ RUN      ] TestWaitSet.add_remove_wait
108: unknown file: Failure
108: C++ exception with description "Failed to initialize event: provided event_type 1 is not supported by rmw_zenoh_cpp, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:108" thrown in the test body.

test_wait_for_message (rclcpp)

segfault

rclcpp/rclcpp/test/rclcpp/test_wait_for_message.cpp:66

  auto wait = std::async(
    [&]() {
      auto ret = rclcpp::wait_for_message(out, node, "wait_for_message_topic" /*, -1 */);
      EXPECT_TRUE(ret);
      received = true;
    });

test_qos

67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:249: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Error
67:     Which is: 4-byte object <02-00 00-00>
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:250: Failure
67: Value of: ret.reason.empty()
67:   Actual: true
67: Expected: false
67: 
67: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_qos.cpp:258: Failure
67: Expected equality of these values:
67:   ret.compatibility
67:     Which is: 4-byte object <00-00 00-00>
67:   rclcpp::QoSCompatibility::Warning
67:     Which is: 4-byte object <01-00 00-00>

test_publisher (rclcpp)

62: [ RUN      ] TestPublisher.run_event_handlers
62: [ERROR] [1727446457.693761159] [rclcpp]: Couldn't take event info: rmw_take_event called when event queue for event type [9] is empty, at /home/ahcorde/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/rmw_event.cpp:204, at /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/src/rcl/event.c:175
62: unknown file: Failure
62: C++ exception with description "'data' is empty" thrown in the test body.

test_parameter_client (rclcpp)

56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:225: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameter_types (154 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameter_types_allow_undeclared
[Processing: rclcpp]                           
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:249: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameter_types_allow_undeclared (179 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameters
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:271: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameters (184 ms)
56: [ RUN      ] TestParameterClient.async_parameter_get_parameters_allow_undeclared
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:293: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_get_parameters_allow_undeclared (188 ms)
56: [ RUN      ] TestParameterClient.async_parameter_set_parameters_atomically
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:319: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)
56: 
56: [  FAILED  ] TestParameterClient.async_parameter_set_parameters_atomically (195 ms)
56: [ RUN      ] TestParameterClient.async_parameter_list_parameters
56: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_parameter_client.cpp:341: Failure
56: Expected equality of these values:
56:   rclcpp::FutureReturnCode::SUCCESS
56:     Which is: SUCCESS (0)
56:   return_code
56:     Which is: TIMEOUT (2)

test_node_interfaces__node_graph (rclcpp)

44: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/node_interfaces/test_node_graph.cpp:645: Failure
44: Value of: endpoint_gid_is_all_zeros
44:   Actual: true
44: Expected: false

test_intra_process_manager (rclcpp)

33: /home/ahcorde/ros2_rolling/src/ros2/rclcpp/rclcpp/test/rclcpp/test_intra_process_manager.cpp:500: Failure
33: Expected equality of these values:
33:   1u
33:     Which is: 1
33:   p1_subs
33:     Which is: 2

test_graph__rmw_zenoh_cpp (rcl)

## 98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_subscriptions
98: [INFO] [1727443659.794092209] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443659.904155956] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443660.014433695] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_subscriptions (11335 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_publishers
98: [INFO] [1727443671.129462597] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443671.239459961] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443671.349025268] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
[Processing: rcl]                   
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_publishers (11333 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_services
98: [INFO] [1727443682.462878296] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443682.573755535] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443682.685009797] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes
98: 
98: [  FAILED  ] NodeGraphMultiNodeFixture.test_node_info_services (11335 ms)
98: [ RUN      ] NodeGraphMultiNodeFixture.test_node_info_clients
98: [INFO] [1727443693.798310426] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443693.908402327] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: [INFO] [1727443694.018363041] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
98: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl/test/rcl/test_graph.cpp:1067: Failure
98: Expected: (attempts) <= (max_attempts), actual: 11 vs 10
98: Unable to attain all required nodes

test_action_interaction__rmw_zenoh_cpp

11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:561: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 2
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:573: Failure
11: Value of: this->is_status_ready
11:   Actual: false
11: Expected: true
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:581: Failure
11: Expected equality of these values:
11:   ret
11:     Which is: 4103
11:   0
11: error not set
11: 
11: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_action_communication.cpp:584: Failure
11: Expected equality of these values:
11:   status_array.msg.status_list.size
11:     Which is: 1
11:   incoming_status_array.status_list.size
11:     Which is: 0

test_graph__rmw_zenoh_cpp (rcl_action)

13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_names_and_types (5333 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.test_action_get_server_names_and_types_by_node
13: [INFO] [1727443806.650512802] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443806.761221554] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443806.871264871] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_server_names_and_types_by_node (5333 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.test_action_get_client_names_and_types_by_node
13: [INFO] [1727443811.983360414] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443812.093825005] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443812.203928627] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.test_action_get_client_names_and_types_by_node (5332 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.get_names_and_types_maybe_fail
13: [INFO] [1727443817.315966907] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443817.428000517] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443817.537953229] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
[Processing: rcl_action]                   
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.get_names_and_types_maybe_fail (5334 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.action_client_init_maybe_fail
13: [INFO] [1727443822.650237406] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443822.760814004] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443822.870295696] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.action_client_init_maybe_fail (5378 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.rcl_get_client_names_and_types_by_node_maybe_fail
13: [INFO] [1727443828.031448905] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443828.145644359] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443828.256353051] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes
13: 
13: [  FAILED  ] TestActionGraphMultiNodeFixture.rcl_get_client_names_and_types_by_node_maybe_fail (5339 ms)
13: [ RUN      ] TestActionGraphMultiNodeFixture.rcl_get_server_names_and_types_by_node_maybe_fail
13: [INFO] [1727443833.367802389] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443833.480293497] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: [INFO] [1727443833.590140755] [rmw_zenoh_cpp]: Successfully connected to a Zenoh router with id ffa65399a158d8ccd21b64105f6c7af4.
13: /home/ahcorde/ros2_rolling/src/ros2/rcl/rcl_action/test/rcl_action/test_graph.cpp:347: Failure
13: Expected: (attempts) <= (max_attempts), actual: 5 vs 4
13: Unable to attain all required nodes

YuanYuYuan · 2024-09-30T17:39:15Z

The failures of test_graph should be resolved once the RCL changes the logic in this PR.

Yadunund · 2024-10-01T18:28:08Z

@ahcorde can we update the ros2.repos file in https://github.com/yadunund/ros2 with the latest commits in rclcpp/rcl and re-run tests for both rolling and dev/1.0.0?

ahcorde · 2024-10-01T20:37:58Z

@ahcorde can we update the ros2.repos file in https://github.com/yadunund/ros2 with the latest commits in rclcpp/rcl and re-run tests for both rolling and dev/1.0.0?

There are some conflicts in the 1.0.0 branch #276 I will start with the 0.11 and when conflicts are resolved I will launch 1.0.0

ahcorde · 2024-10-02T09:11:34Z

Test setup

Date: 02-10-2024
ros2.repos file: https://gist.github.com/ahcorde/dccfd8cf6e102baf10d45bda22995f68

rmw_zenoh/rolling

rmw_zenoh commit: cf8e8a2

ROS Package	Failing test name	Failing test output
rcl	None
rcl_action	None
rcl_lifecyle	test_rcl_lifecycle	segfault
rcl_yaml_param_parser	None
rclcpp	test_intra_process_manager	description below
rclcpp	test_node_interfaces__node_graph	description below
rclcpp	test_publisher	description below
rclcpp	test_qos	PR ros2/rclcpp#2639
rclcpp	test_events_executor	Timeout
rclcpp	test_wait_set	description below
rclcpp_action	None
rclcpp_lifecycle	None
rclcpp_components	None
test_rclcpp	None

@Yadunund There is a new regression on rcl_lifecycle. A segfault in this test test_rcl_lifecycle

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: d022967

ROS Package	Failing test name	Failing test output
rcl	test_publisher__rmw_zenoh_cpp

There is an issue with zc_liveliness_token_check in the dev/1.0.0 branch

ahcorde · 2024-10-02T11:22:25Z

PR to fix rclcpp.test_qos ros2/rclcpp#2639

Yadunund · 2024-10-02T17:35:12Z

@ahcorde thanks for reporting the regression. I can reproduce it. seems to be have caused by #278.


  'Unable to allocate space for type hash string., at /home/yadunund/ros2_rolling/src/ros2/rosidl/rosidl_runtime_c/src/type_hash.c:66'

with this new error message:

  'Failed to allocate type_hash_c_str., at /home/yadunund/ros2_rolling/src/ros2/rmw_zenoh/rmw_zenoh_cpp/src/detail/rmw_publisher_data.cpp:76'

clalancette · 2024-10-02T19:28:03Z

@ahcorde thanks for reporting the regression. I can reproduce it. seems to be have caused by #278.

Yes. Looking at it, the problem is that PublisherData::make can create a "partially-initialized" PublisherData object. Basically it can create the object, and then something further down can fail. At that point, the destructor for PublisherData will be called, at which point it will try to do shutdown(). Since shutdown() expects a fully-initialized object, it can access invalid memory.

One way to solve this would be to not actually create the PublisherData object until we have already initialized everything. That is, we would initialize everything into stack variables, and then do something like:

return std::make_shared<PublisherData>(node, gid, type_support_impl, type_support, entity, pub_cache, pub, token, events_mgr);

YuanYuYuan · 2024-10-03T06:35:13Z

There is a mistake in dev/1.0.0 which has been fixed in this commit. Now it can pass all the rcl_action tests.

100% tests passed, 0 tests failed out of 22

Label Time Summary:
copyright     =   1.32 sec*proc (1 test)
cppcheck      =   0.26 sec*proc (1 test)
cpplint       =   2.40 sec*proc (1 test)
gtest         =  65.53 sec*proc (16 tests)
lint_cmake    =   0.27 sec*proc (1 test)
linter        =   6.41 sec*proc (6 tests)
uncrustify    =   0.81 sec*proc (1 test)
xmllint       =   1.35 sec*proc (1 test)

Total Test time (real) =  71.95 sec
---
Finished <<< rcl_action [1min 12s]

Summary: 1 package finished [1min 13s]

imstevenpmwork · 2024-10-03T09:43:02Z

Hello guys, here's the latest update of the week.

Test Setup

Date: 03-10-2024
ros2.repos file: https://gist.github.com/imstevenpmwork/221e55706af00b2a4ad6ce7e9f13ccdd
ROS Rolling
Ubuntu 24 (Containerised CI)

Version

rolling rmw_zenoh: cf8e8a2
dev/1.0.0 rmw_zenoh: ZettaScaleLabs@c386a3d
zenoh-c/zenoh: eclipse-zenoh/zenoh-c@278726e (1.0.0.10)
rclcpp: ros2/rclcpp@1a0092a
rcl: ros2/rcl@d680ff3
system_tests: ros2/system_tests@5f73908

Logs

rolling rmw_zenoh: logs_system_test_rolling.zip
dev/1.0.0 rmw_zenoh: logs_system_test_dev100.zip

rmw_zenoh/rolling

rmw_zenoh commit: cf8e8a2

ROS Package	Failing test name	Failing test output
rcl	None	None
rcl_action	None	None
rcl_lifecycle	None	None
rcl_yaml_param	None	None
rclcpp	test_intra_process_manager	Failed (Check logs)
rclcpp	test_node_interfaces__node_graph	Failed (Check logs)
rclcpp	test_publisher	Failed (Check logs)
rclcpp	test_events_executor	Timeout (Check logs)
rclcpp	test_wait_set	Failed (Check logs)
rclcpp_action	test_client	Failed (Check logs)
rclcpp_components	None	None
~~rclcpp_lifecycle~~	~~test_lifecycle_node~~	Failed (Check logs)
rmw_zenoh_cpp	None	None
test_cli	None	None
test_cli_remap	test_cli_remapping	TBD
test_communication	test_requester_replier__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_action_client_server__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_requester_replier__rclcpp__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_action_client_server__rclcpp__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_deadline__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_liveliness__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_best_available__rmw_zenoh_cpp	Failed (Check logs)
test_rclcpp	None	None
test_security	None	None

Nav2 Demo: Working

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: ZettaScaleLabs@c386a3d

ROS Package	Failing test name	Failing test output
rcl	None	None
rcl_action	test_graph__rmw_zenoh_cpp	Timeout (Check logs)
rcl_lifecycle	None	None
rcl_yaml_param	None	None
rclcpp	test_intra_process_manager	Failed (Check logs)
rclcpp	test_node_interfaces__node_graph	Failed (Check logs)
rclcpp	test_publisher	Failed (Check logs)
rclcpp	test_publisher_subscription_count_api	Timeout (Check logs)
rclcpp	test_wait_for_message	Failed (Check logs)
rclcpp	test_events_executor	Timeout (Check logs)
rclcpp	test_wait_set	Failed (Check logs)
rclcpp_action	None	None
rclcpp_components	test_component_manager	Failed (Check logs)
rclcpp_lifecycle	test_lifecycle_node	Failed (Check logs)
rclcpp_lifecycle	test_lifecycle_service_client	Timeout (Check logs)
rmw_zenoh_cpp	None	None
test_cli	None	None
test_cli_remap	test_cli_remapping	Failed (Check logs)
test_communication	test_requester_replier__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_action_client_server__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_requester_replier__rclcpp__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_action_client_server__rclcpp__rclpy__rmw_zenoh_cpp	Failed (Check logs)
test_communication	test_publisher_subscriber__rclcpp__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_deadline__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_liveliness__rmw_zenoh_cpp	Failed (Check logs)
test_qos	test_best_available__rmw_zenoh_cpp	Failed (Check logs)
test_rclcpp	test_services_cpp__rmw_zenoh_cpp	Timeout (Check logs)
test_rclcpp	test_services_cpp__rmw_zenoh_cpp	Failed (Check logs)
test_security	None	None

Nav2 Demo: Not Working

Summary

rmw_zenoh/rolling: 15 failing tests
rmw_zenoh/dev/1.0.0: 22 failing tests
Delta: 7 tests
Note: mind some of them might/are flaky

YuanYuYuan · 2024-10-03T14:11:15Z

The reason that 1.0 is failing in rcl/test_wait_for_message is we try to fetch the z_id info of the session while creating a subscription AFTER the shutdown is called. Since the session is not alive anymore, it would cause a segfault.

After a discussion with the team, it's impossible to check the session status once it's dropped. The design is elegant in Rust that users can't even use the session object once the session is dead. In rmw_zenoh, We had better follow the same way and wrap the session with a smart pointer. We expect this will be better handled once we migrate to zenoh-cpp.

Yadunund · 2024-10-03T15:30:05Z

@imstevenpmwork can you retry the tests with Rolling built from source using the latest ros2.repos from here?

ahcorde · 2024-10-04T10:24:32Z

This PR should fix test_events_executor in rclcpp

ahcorde · 2024-10-04T10:39:22Z

This PR should fix some of the failures in test_communication

ahcorde · 2024-10-04T10:50:57Z

This PR should fix test_deadline__rmw_zenoh_cpp and test_liveliness__rmw_zenoh_cpp

ahcorde · 2024-10-04T10:56:49Z

This PR should fix test_cli_remapping

ahcorde · 2024-10-04T11:14:40Z

This PR should fix test_wait_set in rclcpp

ahcorde · 2024-10-04T12:26:22Z

I found some issue on rclpy this PR should fix then

ahcorde · 2024-10-08T11:39:39Z

ros2.repos

rmw_zenoh/dev/1.0.0

rmw_zenoh commit: ZettaScaleLabs@589971e

ROS Package	Failing test name	Failing test output
rcl	None	None
rcl_action	test_graph__rmw_zenoh_cpp	Timeout (Check logs)
rcl_lifecycle	None	None
rcl_yaml_param	None	None
rclcpp	test_intra_process_manager	Failed (Check logs)
rclcpp	test_node_interfaces__node_graph	Failed (Check logs)
rclcpp	test_parameter_client	Failed (Check logs)
rclcpp	test_publisher	Failed (Check logs)
rclcpp	test_events_executor	Timeout (Check logs)
rclcpp	test_wait_set	Failed (Check logs)
rclcpp_action	test_server
rclcpp_components	test_component_manager	Failed (Check logs)
rclcpp_lifecycle	test_lifecycle_node	Failed (Check logs)
rclcpp_lifecycle	test_lifecycle_service_client	Timeout (Check logs)
rmw_zenoh_cpp	None	None
test_cli	None	None
test_cli_remap	test_cli_remapping	Failed (Check logs)

test_parameter_client is a new failure

Yadunund pinned this issue Sep 26, 2024

Yadunund mentioned this issue Sep 26, 2024

Make rmw_zenoh_cpp pass all core tests #267

Closed

diogomatsubara mentioned this issue Oct 2, 2024

Several system test failures with the latest dev/1.0.0 ZettaScaleLabs/rmw_zenoh#19

Closed

Yadunund mentioned this issue Oct 2, 2024

Initialize PublsiherData only after all members are valid #289

Merged

ahcorde mentioned this issue Oct 4, 2024

Fixed zenoh cli mapping error ros2/system_tests#552

Draft

ahcorde mentioned this issue Oct 4, 2024

Clean qos zenoh tests ros2/rclpy#1369

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Test failures with rmw_zenoh #286

Test failures with rmw_zenoh #286

Yadunund commented Sep 26, 2024 •

edited

Loading

ahcorde commented Sep 27, 2024 •

edited

Loading

ahcorde commented Sep 30, 2024

YuanYuYuan commented Sep 30, 2024

Yadunund commented Oct 1, 2024

ahcorde commented Oct 1, 2024

ahcorde commented Oct 2, 2024 •

edited

Loading

ahcorde commented Oct 2, 2024

Yadunund commented Oct 2, 2024 •

edited

Loading

clalancette commented Oct 2, 2024

YuanYuYuan commented Oct 3, 2024 •

edited

Loading

imstevenpmwork commented Oct 3, 2024 •

edited by ahcorde

Loading

YuanYuYuan commented Oct 3, 2024 •

edited

Loading

Yadunund commented Oct 3, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024 •

edited

Loading

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 8, 2024

Test failures with rmw_zenoh #286

Test failures with rmw_zenoh #286

Comments

Yadunund commented Sep 26, 2024 • edited Loading

Test setup

rmw_zenoh/rolling

rmw_zenoh/dev/1.0.0

ahcorde commented Sep 27, 2024 • edited Loading

Test setup

rmw_zenoh/rolling

test_node_interfaces__node_graph

test_intra_process_manager

test_publisher

test_qos

test_wait_set

rmw_zenoh/dev/1.0.0

test_action_communication (rcl_action)

test_wait_set (rclcpp)

test_wait_for_message (rclcpp)

test_qos

test_publisher (rclcpp)

test_parameter_client (rclcpp)

test_node_interfaces__node_graph (rclcpp)

test_intra_process_manager (rclcpp)

test_graph__rmw_zenoh_cpp (rcl)

test_action_interaction__rmw_zenoh_cpp

test_graph__rmw_zenoh_cpp (rcl_action)

test_server

ahcorde commented Sep 30, 2024

rmw_zenoh/dev/1.0.0

test_action_communication (rcl_action)

test_wait_set (rclcpp)

test_wait_for_message (rclcpp)

test_qos

test_publisher (rclcpp)

test_parameter_client (rclcpp)

test_node_interfaces__node_graph (rclcpp)

test_intra_process_manager (rclcpp)

test_graph__rmw_zenoh_cpp (rcl)

test_action_interaction__rmw_zenoh_cpp

test_graph__rmw_zenoh_cpp (rcl_action)

YuanYuYuan commented Sep 30, 2024

Yadunund commented Oct 1, 2024

ahcorde commented Oct 1, 2024

ahcorde commented Oct 2, 2024 • edited Loading

Test setup

rmw_zenoh/rolling

rmw_zenoh/dev/1.0.0

ahcorde commented Oct 2, 2024

Yadunund commented Oct 2, 2024 • edited Loading

clalancette commented Oct 2, 2024

YuanYuYuan commented Oct 3, 2024 • edited Loading

imstevenpmwork commented Oct 3, 2024 • edited by ahcorde Loading

Test Setup

Version

Logs

rmw_zenoh/rolling

Nav2 Demo: Working

rmw_zenoh/dev/1.0.0

Nav2 Demo: Not Working

Summary

YuanYuYuan commented Oct 3, 2024 • edited Loading

Yadunund commented Oct 3, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024 • edited Loading

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 4, 2024

ahcorde commented Oct 8, 2024

rmw_zenoh/dev/1.0.0

Yadunund commented Sep 26, 2024 •

edited

Loading

ahcorde commented Sep 27, 2024 •

edited

Loading

ahcorde commented Oct 2, 2024 •

edited

Loading

Yadunund commented Oct 2, 2024 •

edited

Loading

YuanYuYuan commented Oct 3, 2024 •

edited

Loading

imstevenpmwork commented Oct 3, 2024 •

edited by ahcorde

Loading

YuanYuYuan commented Oct 3, 2024 •

edited

Loading

ahcorde commented Oct 4, 2024 •

edited

Loading