Skip to content

FATA[0110] rpc error: ... with argocd app create argo-cd...

  • on minikube, cluster running
  • argocd installed
  • namespace argocd created and pods running
  • done kubectl port-forward svc/argocd-server -n argocd 8080:443
  • logged in with argocd login localhost:8080
  • creating an argocd test app from their getting started is successful and have that healthy and synced:
argocd app create guestbook --repo https://github.com/argoproj/argocd-example-apps.git --path guestbook --dest-server https://kubernetes.default.svc --dest-namespace default
argocd app sync guestbook
$ argocd app list
NAME       CLUSTER                         NAMESPACE  PROJECT  STATUS  HEALTH   SYNCPOLICY  CONDITIONS  REPO                                                 PATH       TARGET
guestbook  https://kubernetes.default.svc  default    default  Synced  Healthy  <none>      <none>      https://github.com/argoproj/argocd-example-apps.git  guestbook

From the argocd-server logs:

time="2020-10-25T17:56:01Z" level=info msg="received unary call /application.ApplicationService/Create" grpc.method=Create grpc.request.claims="{\"iat\":1603647157,\"iss\":\"argocd\",\"nbf\":1603647157,\"sub\":\"admin\"}" grpc.request.content="%!v(PANIC=String method: reflect.Value.Interface: cannot return value obtained from unexported field or method)" grpc.service=application.ApplicationService grpc.start_time="2020-10-25T17:56:01Z" span.kind=server system=grpc
time="2020-10-25T17:56:05Z" level=info msg="admin created application" application=guestbook dest-namespace=default dest-server="https://kubernetes.default.svc" reason=ResourceCreated type=Normal
time="2020-10-25T17:56:05Z" level=info msg="finished unary call with code OK" grpc.code=OK grpc.method=Create grpc.service=application.ApplicationService grpc.start_time="2020-10-25T17:56:01Z" grpc.time_ms=4224.187 span.kind=server system=grpc
  • creating argo-cd app, it fails:
$ argocd app create argo-cd --repo https://gitlab.cern.ch/clange/gitops-argo-cd.git --path 01_argo-cd --dest-server https://kubernetes.default.svc --dest-namespace argocd
FATA[0110] rpc error: code = Unavailable desc = transport is closing

From the argocd-server logs:

time="2020-10-25T18:07:55Z" level=info msg="received unary call /application.ApplicationService/Create" grpc.method=Create grpc.request.claims="{\"iat\":1603647157,\"iss\":\"argocd\",\"nbf\":1603647157,\"sub\":\"admin\"}" grpc.request.content="%!v(PANIC=String method: reflect.Value.Interface: cannot return value obtained from unexported field or method)" grpc.service=application.ApplicationService grpc.start_time="2020-10-25T18:07:55Z" span.kind=server system=grpc
time="2020-10-25T18:09:45Z" level=info msg="finished unary call with code InvalidArgument" error="rpc error: code = InvalidArgument desc = application spec is invalid: InvalidSpecError: Unable to get app details: rpc error: code = Canceled desc = context canceled" grpc.code=InvalidArgument grpc.method=Create grpc.service=application.ApplicationService grpc.start_time="2020-10-25T18:07:55Z" grpc.time_ms=110004.93 span.kind=server system=grpc

And correspondingly. a timeout from the argocd-repo-server logs:

time="2020-10-25T18:09:28Z" level=error msg="`kustomize build /tmp/https:__gitlab.cern.ch_clange_gitops-argo-cd/01_argo-cd` failed timeout after 1m30s" execID=Sg17I

This is fixed with --grpc-web as suggested in faq It randomly succeeded once with the --grpc-web setting, but I cannot reproduce it

argocd app create argo-cd --repo https://gitlab.cern.ch/clange/gitops-argo-cd.git --path 01_argo-cd --dest-server https://kubernetes.default.svc --dest-namespace argocd --grpc-web

And, I do not get why the first app should work without it and this should fail. Maybe it is a time-dependent problem instead?

$ argocd version
argocd: v1.7.8+ef5010c
  BuildDate: 2020-10-15T22:33:00Z
  GitCommit: ef5010c3a0b5e027fd642732d03c5b0391b1e574
  GitTreeState: clean
  GoVersion: go1.14.1
  Compiler: gc
  Platform: linux/amd64
argocd-server: v1.7.8+ef5010c
  BuildDate: 2020-10-15T22:34:12Z
  GitCommit: ef5010c3a0b5e027fd642732d03c5b0391b1e574
  GitTreeState: clean
  GoVersion: go1.14.1
  Compiler: gc
  Platform: linux/amd64
  Ksonnet Version: v0.13.1
  Kustomize Version: {Version:kustomize/v3.6.1 GitCommit:c97fa946d576eb6ed559f17f2ac43b3b5a8d5dbd BuildDate:2020-05-27T20:47:35Z GoOs:linux GoArch:amd64}
  Helm Version: version.BuildInfo{Version:"v3.2.0", GitCommit:"e11b7ce3b12db2941e90399e874513fbd24bcb71", GitTreeState:"clean", GoVersion:"go1.13.10"}
  Kubectl Version: v1.17.8
Edited by Kati Lassila-Perini