Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UI Test shards are flaky, perhaps interfering with each other? #1107

Open
rjrjr opened this issue Sep 5, 2023 · 2 comments
Open

UI Test shards are flaky, perhaps interfering with each other? #1107

rjrjr opened this issue Sep 5, 2023 · 2 comments
Labels
build ui Related to UI integration

Comments

@rjrjr
Copy link
Contributor

rjrjr commented Sep 5, 2023

We all know that our UI shards have gotten unbearably flaky again, but are having trouble articulating exactly what the symptoms are. This time around it feels less lack bad espresso code and more like infrastructure, for what that's worth.

Let's use the issue to take notes each time we're afflicted and see if we can tease out a pattern.

@steve-the-edwards
Copy link
Contributor

For example, #1105 added a new test class but did not invoke it. Making no changes to code that would be executed in CI. But yet the instrumentation shards all failed? Such as https://github.com/square/workflow-kotlin/actions/runs/6051263654.

We have no idea why they fail - but they look like legit timeouts on espresso, so are the emulators freezing/lagging?

@rjrjr
Copy link
Contributor Author

rjrjr commented Oct 13, 2023

Maybe we have some good old espresso root matcher issues? Maybe a system dialog was popped? This would be easier to dig into if we had screen grabs or video. And if I had a pony.

com.squareup.workflow1.ui.container.BackStackContainerPersistenceLifecycleTest > restores_view_on_pop_after_config_change[test(AVD) - 10] FAILED 
	androidx.test.espresso.base.RootViewPicker$RootViewWithoutFocusException: Waited for the root of the view hierarchy to have window focus and not request layout for 10 seconds. If you specified a non default root matcher, it may be picking a root that never takes focus. Root:
	Root{application-window-token=android.view.ViewRootImpl$W@8a45edf, window-token=android.view.ViewRootImpl$W@8a45edf, has-window-focus=false, layout-params-type=1, layout-params-string={(0,0)(fillxfill) sim={forwardNavigation} ty=BASE_APPLICATION wanim=0x10302fe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build ui Related to UI integration
Projects
None yet
Development

No branches or pull requests

2 participants