cloudmap controller error on import side logged in manager container

[emilienkofman]

Hi and thanks for the great work. I'm trying to debug a cluster interconnect and I don't know exactly where to look up. I could only find some logs in the manager container of cloud-map-mcs-controller-manager deployment, on cluster having the serviceImport object (the manager on serviceexport side does not report any error)

{"level":"error","ts":1674744805.8496525,"logger":"controllers.CloudmapReconciler","msg":"error when syncing service","namespace":"bidder-inte","name":"creapp-api","error":"Service \"imported-ob7f6lerv9\"
 not found","stacktrace":"github.com/aws/aws-cloud-map-mcs-controller-for-k8s/pkg/controllers/multicluster.(*CloudMapReconciler).reconcileNamespace\n\t/workspace/pkg/controllers/multicluster/cloudmap_cont
roller.go:108\ngithub.com/aws/aws-cloud-map-mcs-controller-for-k8s/pkg/controllers/multicluster.(*CloudMapReconciler).Reconcile\n\t/workspace/pkg/controllers/multicluster/cloudmap_controller.go:72\ngithub
.com/aws/aws-cloud-map-mcs-controller-for-k8s/pkg/controllers/multicluster.(*CloudMapReconciler).Start\n\t/workspace/pkg/controllers/multicluster/cloudmap_controller.go:43\nsigs.k8s.io/controller-runtime/
pkg/manager.(*runnableGroup).reconcile.func1\n\t/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219"}                                                                      
{"level":"error","ts":1674744805.8634145,"logger":"controllers.CloudmapReconciler","msg":"Cloud Map reconciliation error","error":"Service \"imported-ob7f6lerv9\" not found","stacktrace":"github.com/aws/a
ws-cloud-map-mcs-controller-for-k8s/pkg/controllers/multicluster.(*CloudMapReconciler).Start\n\t/workspace/pkg/controllers/multicluster/cloudmap_controller.go:45\nsigs.k8s.io/controller-runtime/pkg/manage
r.(*runnableGroup).reconcile.func1\n\t/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219"}                                                                                
{"level":"info","ts":1674744807.7857904,"logger":"controllers.CloudmapReconciler","msg":"ServiceImport IPs need update","ServiceImport IPs":[],"cluster IPs":["172.20.48.95"]}                              
{"level":"info","ts":1674744807.7999845,"logger":"controllers.CloudmapReconciler","msg":"updated ServiceImport","namespace":"bidder-inte","name":"creapp-api","IP":["172.20.48.95"],"ports":[{"name":"http",
"protocol":"TCP","port":8080}]}

It looks like this originates from here. Any idea about what could be wrong or where to investigate?

[runakash]

Hello emilienkofman - Are you using VPC peering to connect the clusters? If yes, you can use VPC Reachability Analyzer to debug. Also, you can reach us at slack to help with debugging.