Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

error log when receive telemetry data from nexus9k 7.0(3)I6(1) #4

Open
wonstonx opened this issue Jun 30, 2017 · 8 comments
Open

error log when receive telemetry data from nexus9k 7.0(3)I6(1) #4

wonstonx opened this issue Jun 30, 2017 · 8 comments

Comments

@wonstonx
Copy link

I'm using latest pipeline to receive telemetry data from nexus 9k (7.0(3)I6(1)).

the N9K configuration:
telemetry
destination-group 100
ip address 10.140.0.123 port 57500 protocol gRPC encoding GPB
sensor-group 100
path sys/cdp depth 0
subscription 100
dst-grp 100
snsr-grp 100 sample-interval 5000

the configuration file of pipeline is:
[wx_output]
stage = xport_output
type = tap
file = /home/tom/work/data/dump.txt
encoding = json
countonly = false

[n9k_dialout_grpc]
stage = xport_input
type = grpc
encap = gpb
listen = 192.168.156.153:57500
tls = false
logdata = on

Due to I'm running pipeline in a VM, so the internal ip address 192.168.156.153:57500 will be NATed to 10.140.0.123:57500. When pipeline received data from N9K, it report following errors:

INFO[2017-06-30 01:10:35.487100] Conductor says hello, loading config config=wx.conf debug=true fluentd= logfile=pipeline.log maxthreads=2 tag=pipeline.ubuntu version="v1.0.0(bigmuddy)"
DEBU[2017-06-30 01:10:35.487838] Conductor processing section... name=conductor section="wx_output" tag=pipeline.ubuntu
DEBU[2017-06-30 01:10:35.487873] Conductor processing section, type... name=conductor section="wx_output" tag=pipeline.ubuntu type=tap
INFO[2017-06-30 01:10:35.487887] Conductor starting up section name=conductor section="wx_output" stage="xport_output" tag=pipeline.ubuntu
DEBU[2017-06-30 01:10:35.487913] Conductor processing section... name=conductor section="n9k_dialout_grpc" tag=pipeline.ubuntu
DEBU[2017-06-30 01:10:35.487926] Conductor processing section, type... name=conductor section="n9k_dialout_grpc" tag=pipeline.ubuntu type=grpc
INFO[2017-06-30 01:10:35.487939] Conductor starting up section name=conductor section="n9k_dialout_grpc" stage="xport_input" tag=pipeline.ubuntu
INFO[2017-06-30 01:10:35.488009] Metamonitoring: not enabled tag=pipeline.ubuntu
DEBU[2017-06-30 01:10:35.488072] Conductor watching for shutdown... config=wx.conf debug=true logfile=pipeline.log tag=pipeline.ubuntu
INFO[2017-06-30 01:10:35.488154] Starting up tap countonly=false filename="/home/tom/work/data/dump.txt" name="wx_output" streamSpec=&{2 } tag=pipeline.ubuntu
INFO[2017-06-30 01:10:35.488218] gRPC starting block encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
INFO[2017-06-30 01:10:35.488582] gRPC: Start accepting dialout sessions encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"

INFO[2017-06-30 01:13:55.069815] gRPC: Receiving dialout stream encap=gpb name="n9k_dialout_grpc" peer="10.75.195.101:37295" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
DEBU[2017-06-30 01:13:55.117430] gRPC server logdata encap=gpb msg="00000000 0a 02 73 31 32 07 73 79 73 2f 63 64 70 40 01 5a |..s12.sys/[email protected]|\n00000010 a5 02 7a 1a 12 04 6b 65 79 73 7a 12 12 07 73 79 |..z...keysz...sy|\n00000020 73 2f 63 64 70 2a 07 73 79 73 2f 63 64 70 7a 86 |s/cdp*.sys/cdpz.|\n00000030 02 12 07 63 6f 6e 74 65 6e 74 7a fa 01 7a f7 01 |...contentz..z..|\n00000040 12 09 63 64 70 45 6e 74 69 74 79 7a e9 01 7a e6 |..cdpEntityz..z.|\n00000050 01 12 0a 61 74 74 72 69 62 75 74 65 73 7a d7 01 |...attributesz..|\n00000060 7a 12 12 07 61 64 6d 69 6e 53 74 2a 07 65 6e 61 |z...adminSt*.ena|\n00000070 62 6c 65 64 7a 10 12 0b 63 68 69 6c 64 41 63 74 |bledz...childAct|\n00000080 69 6f 6e 2a 01 20 7a 0d 12 02 64 6e 2a 07 73 79 |ion*. z...dn*.sy|\n00000090 73 2f 63 64 70 7a 26 12 05 6d 6f 64 54 73 2a 1d |s/cdpz&..modTs*.|\n000000a0 32 30 31 37 2d 30 36 2d 32 37 54 32 33 3a 30 30 |2017-06-27T23:00|\n000000b0 3a 34 35 2e 31 35 39 2b 30 30 3a 30 30 7a 25 12 |:45.159+00:00z%.|\n000000c0 08 6d 6f 6e 50 6f 6c 44 6e 2a 19 75 6e 69 2f 66 |.monPolDn*.uni/f|\n000000d0 61 62 72 69 63 2f 6d 6f 6e 66 61 62 2d 64 65 66 |abric/monfab-def|\n000000e0 61 75 6c 74 7a 09 12 04 6e 61 6d 65 2a 01 20 7a |aultz...name*. z|\n000000f0 0c 12 07 6f 70 65 72 45 72 72 2a 01 20 7a 11 12 |...operErr*. z..|\n00000100 06 6f 70 65 72 53 74 2a 07 65 6e 61 62 6c 65 64 |.operSt*.enabled|\n00000110 7a 1a 12 12 70 65 72 73 69 73 74 65 6e 74 4f 6e |z...persistentOn|\n00000120 52 65 6c 6f 61 64 2a 04 74 72 75 65 7a 09 12 02 |Reload*.truez...|\n00000130 72 6e 2a 03 63 64 70 |rn*.cdp|\n" name="n9k_dialout_grpc" peer="10.75.195.101:37295" reqID=0 server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
ERRO[2017-06-30 01:13:55.118415] gRPC: session closed encap=gpb error=EOF name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"

INFO[2017-06-30 01:13:59.716359] gRPC: Receiving dialout stream encap=gpb name="n9k_dialout_grpc" peer="10.75.195.101:37295" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
DEBU[2017-06-30 01:13:59.716524] gRPC server logdata encap=gpb msg="00000000 0a 02 73 31 32 07 73 79 73 2f 63 64 70 40 02 5a |..s12.sys/[email protected]|\n00000010 a5 02 7a 1a 12 04 6b 65 79 73 7a 12 12 07 73 79 |..z...keysz...sy|\n00000020 73 2f 63 64 70 2a 07 73 79 73 2f 63 64 70 7a 86 |s/cdp*.sys/cdpz.|\n00000030 02 12 07 63 6f 6e 74 65 6e 74 7a fa 01 7a f7 01 |...contentz..z..|\n00000040 12 09 63 64 70 45 6e 74 69 74 79 7a e9 01 7a e6 |..cdpEntityz..z.|\n00000050 01 12 0a 61 74 74 72 69 62 75 74 65 73 7a d7 01 |...attributesz..|\n00000060 7a 12 12 07 61 64 6d 69 6e 53 74 2a 07 65 6e 61 |z...adminSt*.ena|\n00000070 62 6c 65 64 7a 10 12 0b 63 68 69 6c 64 41 63 74 |bledz...childAct|\n00000080 69 6f 6e 2a 01 20 7a 0d 12 02 64 6e 2a 07 73 79 |ion*. z...dn*.sy|\n00000090 73 2f 63 64 70 7a 26 12 05 6d 6f 64 54 73 2a 1d |s/cdpz&..modTs*.|\n000000a0 32 30 31 37 2d 30 36 2d 32 37 54 32 33 3a 30 30 |2017-06-27T23:00|\n000000b0 3a 34 35 2e 31 35 39 2b 30 30 3a 30 30 7a 25 12 |:45.159+00:00z%.|\n000000c0 08 6d 6f 6e 50 6f 6c 44 6e 2a 19 75 6e 69 2f 66 |.monPolDn*.uni/f|\n000000d0 61 62 72 69 63 2f 6d 6f 6e 66 61 62 2d 64 65 66 |abric/monfab-def|\n000000e0 61 75 6c 74 7a 09 12 04 6e 61 6d 65 2a 01 20 7a |aultz...name*. z|\n000000f0 0c 12 07 6f 70 65 72 45 72 72 2a 01 20 7a 11 12 |...operErr*. z..|\n00000100 06 6f 70 65 72 53 74 2a 07 65 6e 61 62 6c 65 64 |.operSt*.enabled|\n00000110 7a 1a 12 12 70 65 72 73 69 73 74 65 6e 74 4f 6e |z...persistentOn|\n00000120 52 65 6c 6f 61 64 2a 04 74 72 75 65 7a 09 12 02 |Reload*.truez...|\n00000130 72 6e 2a 03 63 64 70 |rn*.cdp|\n" name="n9k_dialout_grpc" peer="10.75.195.101:37295" reqID=0 server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
ERRO[2017-06-30 01:13:59.716713] gRPC: session closed encap=gpb error=EOF name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
INFO[2017-06-30 01:14:04.392640] gRPC: gRPC client loop, rxed SHUTDOWN, closing connections ctrl_msg_id=0 encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
DEBU[2017-06-30 01:14:04.392718] gRPC: waiting for children encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
INFO[2017-06-30 01:14:04.392737] gRPC: Stop accepting dialout sessions encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
DEBU[2017-06-30 01:14:04.392764] gRPC: gRPC server notify conductor binding is closed encap=gpb name="n9k_dialout_grpc" server=192.168.156.153:57500 tag=pipeline.ubuntu type="pipeline is SERVER"
INFO[2017-06-30 01:14:04.392783] tap feeder loop, rxed SHUTDOWN countonly=false filename="/home/tom/work/data/dump.txt" name="wx_output" streamSpec=&{2 } tag=pipeline.ubuntu
INFO[2017-06-30 01:14:04.392811] Goodbye tag=pipeline.ubuntu
@kecorbin
Copy link

kecorbin commented Jan 9, 2018

Any solution here? I'm seeing a similar issue

@luflores
Copy link

I this still an issue? I am about to give it a try with i7.3

@kecorbin
Copy link

Yes, still an issue. This version does not support N9K.

@dekumar23
Copy link

xport_grpc Dialout modify code like below this will not cause close of connection with nexus
reply, err := stream.Recv()
if err != nil {
if err == io.EOF {
/*
logctx.WithError(err).Error(GRPCLOGPRE +
"session closed")
*/
} else {
logctx.WithError(err).Error(GRPCLOGPRE +
"session error")
}
//return err
return nil
}

@omarcin31
Copy link

did you mean xport_grpc_test.go?

@lokilak
Copy link

lokilak commented Nov 1, 2019

Hi any one able to solve this issue, when i run with debug mode enabled i see this error on the receiver and switch errors as Transmit error , but i was still able to get the metrics on the dump.txt file am really confused . can any one point me to a successful setup for Nexus platforms using this pipeline ?

@saarbali01
Copy link

did anyone find a solution to this ? I changed func MdtDialout in xport_grpc.go as @dekumar23 suggested but nothing happened . still getting the same error

@saarbali01
Copy link

I this still an issue? I am about to give it a try with i7.3

did it work for you ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@luflores @kecorbin @wonstonx @omarcin31 @dekumar23 @saarbali01 @lokilak