Please answer these questions before submitting your issue.
This is a continuation of https://github.com/grpc/grpc/issues/11586 which I am opening here for better visibility from the grpc-go devs.
What version of gRPC are you using?
We are using python grpcio==1.3.5 and grpc-go==v1.4.x. We've also reproduced this on python grpcio==1.4.0
What version of Go are you using (go version
)?
We're using go version 1.8.1
What operating system (Linux, Windows, …) and version?
Ubuntu 14.04
What did you do?
If possible, provide a recipe for reproducing the error.
Happens inconsistently, every so often a streaming RPC will fail with the following error:
<_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Failed parsing HTTP/2)>
Some grpc logs:
E0629 13:45:52.222804121 27606 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.222827355 27606 completion_queue.c:226] Operation failed: tag=0x7f10bbd9ca60, error={"created":"@1498769152.222798356","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:45:52.222838571 27606 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.222846339 27606 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cad0, error={"created":"@1498769152.222799406","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:45:52.223925299 27603 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.223942312 27603 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c9f0, error={"created":"@1498769152.223918465","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:45:52.223949262 27603 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.223979616 27603 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c980, error={"created":"@1498769152.223919439","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:45:52.224009309 27603 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.224017226 27603 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c830, error={"created":"@1498769152.223920475","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:45:52.224391810 27609 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:45:52.224403941 27609 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cc20, error={"created":"@1498769152.224387963","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.556768181 28157 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.556831045 28157 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cb40, error={"created":"@1498769557.556750425","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.557441154 28161 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.557504078 28161 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c830, error={"created":"@1498769557.557416763","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.557563746 28161 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.557608834 28161 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cc20, error={"created":"@1498769557.557420283","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.557649360 28161 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.557694897 28161 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c980, error={"created":"@1498769557.557423433","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.558510258 28166 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.558572634 28166 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cd70, error={"created":"@1498769557.558490789","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.558610179 28166 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.558644492 28166 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cec0, error={"created":"@1498769557.558494483","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 13:52:37.559833158 28167 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 13:52:37.559901218 28167 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cad0, error={"created":"@1498769557.559815450","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.635698278 29153 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.635812439 29153 completion_queue.c:226] Operation failed: tag=0x7f108afcb1a0, error={"created":"@1498770706.635668871","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.635887056 29153 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.635944586 29153 completion_queue.c:226] Operation failed: tag=0x7f108afcb210, error={"created":"@1498770706.635675260","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.636461489 29155 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.636525366 29155 completion_queue.c:226] Operation failed: tag=0x7f108afcb130, error={"created":"@1498770706.636440110","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.636556141 29155 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.636585820 29155 completion_queue.c:226] Operation failed: tag=0x7f108afcb360, error={"created":"@1498770706.636443702","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.637721291 29163 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.637791752 29163 completion_queue.c:226] Operation failed: tag=0x7f108afcb0c0, error={"created":"@1498770706.637702529","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.637836300 29163 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.637872014 29163 completion_queue.c:226] Operation failed: tag=0x7f108afcb2f0, error={"created":"@1498770706.637706809","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:11:46.641194536 29163 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:11:46.641241298 29163 completion_queue.c:226] Operation failed: tag=0x7f108afcb050, error={"created":"@1498770706.641178364","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.539497986 29251 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.539555939 29251 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cc90, error={"created":"@1498771717.539483236","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.540536617 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.540601626 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c910, error={"created":"@1498771717.540517372","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.540647559 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.540679773 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cd70, error={"created":"@1498771717.540521809","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.541893786 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.541943420 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9ce50, error={"created":"@1498771717.541871189","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.541982533 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.542009741 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c830, error={"created":"@1498771717.541874944","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.542044730 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.542080406 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9c980, error={"created":"@1498771717.541878692","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
E0629 14:28:37.543488271 29265 channel_connectivity.c:138] watch_completion_error: "Cancelled"
E0629 14:28:37.543534201 29265 completion_queue.c:226] Operation failed: tag=0x7f10bbd9cad0, error={"created":"@1498771717.543473445","description":"Timed out waiting for connection state change","file":"src/core/ext/filters/client_channel/channel_connectivity.c","file_line":145}
<_Rendezvous of RPC that terminated with (StatusCode.UNAVAILABLE, Failed parsing HTTP/2)>
What did you expect to see?
The streaming RPC to succeed.
What did you see instead?
The streaming RPC failed
Status: Requires Reporter Clarification Type: Bug