Welcome, Guest. Please login or register.

Author Topic: ASR9001 Discovery Problems  (Read 5725 times)

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
ASR9001 Discovery Problems
« on: February 25, 2019, 10:24:13 am »
Hi all,

we have some Problems to Discover our Cisco ASR9001 Routers. Tested with nedi 1.6 and 1.7

Here the error:

Device            Status            Todo/Done-Time
===============================================================================
xxx.xxx.xxx.xxx  ham-apc-r01     Iv i112 JxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxUse of uninitialized value in concatenation (.) or string at /var/www/nedi/inc/libsnmp.pm line 1915.
 j143   p0 b0 m8   Ap a0/0    f0Ru(MgmtEth0%2FRSP0%2FCPU0%2F1)Ri(Bundle-Ether1.171)Ri(Bundle-Ether1.240)Ri(Bundle-Ether1.203)Ri(Bundle-Ether1.184)Ri(Bundle-Ether1.221)Ri(Bundle-Ether1.115)Ri(Bundle-Ether1.126)Ri(Bundle-Ether1.531)Ri(Bundle-Ether1.176)Ri(Bundle-Ether1.116)Ri(Bundle-Ether1.9)Ri(Bundle-Ether1.151)Ri(Bundle-Ether1.145)Ri(Bundle-Ether1.174)Ri(Bundle-Ether1.110)Ri(Bundle-Ether1.108)Ri(Bundle-Ether1.14)Ri(Bundle-Ether1.19)Ri(Bundle-Ether1.152)Ri(Bundle-Ether1.163)Ri(Bundle-Ether1.216)Ri(Bundle-Ether1.236)Ri(Bundle-Ether1.161)Ri(Bundle-Ether1.124)Ri(Bundle-Ether1.148)Ri(Bundle-Ether1.242)Ri(Bundle-Ether1.154)Ri(Bundle-Ether1.169)Ri(Bundle-Ether1.215)Ri(TenGigE0%2F0%2F2%2F2)Ri(Bundle-Ether1.217)Ri(Bundle-Ether1.134)Ri(Bundle-Ether1.230)Ri(Bundle-Ether1.196)Ri(Bundle-Ether1.204)Ri(Bundle-Ether1.208)Ri(Bundle-Ether1.243)Ri(Bundle-Ether1.507)Ri(Bundle-Ether1.510)Ri(Bundle-Ether1.164)Ri(Bundle-Ether1.212)Ri(Bundle-Ether1.139)Ri(Bundle-Ether1.167)Ri(Bundle-Ether1.202)Ri(Bundle-Ether1.207)Ri(Bundle-Ether1.122)Ri(Bundle-Ether1.4)Ri(Bundle-Ether1.50)DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.
DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.

Is there anybody, who can help?

Regards
t0mat000

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #1 on: February 25, 2019, 10:32:16 am »
Can you add -vdb to see more details?
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #2 on: February 25, 2019, 10:44:43 am »
Error may be:

not a simple unsigned integer: '1.84467440737096e+19'


DevRRD       ------------------------------------------------------------------
DRRD:Updated /var/www/nedi/rrd/ASR9001/system.rrd
DRRD:CPU=3 MEM=0 TEMP=0 CUS=0
DRRD:IFName        Inoct     Outoct  Inerr Outerr   Indis  Outdis Inbcst Stat
DRRD:Bundle-E 2093782482 2182088288      0      0 1655570       0     54    3
DRRD:Bundle-E 1127285508 6667518210      0      0 2174563       0 606258    3
DRRD:Bundle-E 1770919761 2857895784      0      0 2103717       0 535475    3
DRRD:Bundle-E 2320390322 4610183851      0      0 3565149       0  16099    3
DRRD:Bundle-E 6708202412 7100620979      0      0 3714378       0 216182    3
DRRD:Bundle-E 4139896491 1116155318      0      0 3026142       0 126943    3
DRRD:Bundle-E 4027828300 4060968250      0      0 3437661       0 188572    3
DRRD:Bundle-E 7718087548 2107062224      0      0 2707757       0 125512    3
DRRD:Bundle-E 2378294859 7589733608      0      0 1820050       0 164477    3
DRRD:Bundle-E 1471913415 1113832933      0      0 1840338       0 213502    3
DRRD:Bundle-E 1683131203 1778652351      0      0 2417012       0   5362    3
DRRD:Bundle-E 7967891337 3469143603      0      0 2196861       0 629109    3
DRRD:Bundle-E  231727074 3957847265      0      0    1578       0  53688    3
DRRD:Bundle-E 3681255301 1613054744      0      0 1036358       0 455491    3
DRRD:Bundle-E 1116267778 3230970075      0      0 7128849       0 546184    3
DRRD:Bundle-E 1951583524 4872395284      0      0 3716252       0 105445    3
DRRD:Bundle-E 2113573054 7885001281      0      0 7096914       0 696324    3
DRRD:Bundle-E 3544281225 8167665772      0      0 2473197       0 150294    3
DRRD:MgmtEth0 7531065374 1065689767 429496 429496 2621021       0 430436    3
DRRD:Bundle-E 2493787930 2242638987      0      0 3148798       0 769093    3
DRRD:Bundle-E 2032435307 9241141299      0      0 1146014       0 293361    3
DRRD:Bundle-E 6858831799 1956230727      0      0 3095186       0 143890    3
DRRD:TenGigE0 3121686709 3130449450     54      0       0       0 255872    3
DRRD:Bundle-E 1785362754 3840725656      0      0 2104605       0 538887    3
DRRD:Bundle-E 4432079395 9314902245      0      0 2185637       0 617144    3
DRRD:Bundle-E 6501432110 4849505121      0      0 2266248       0 565766    3
DRRD:Bundle-E 4191223053 2458346680      0      0 2062866       0 479139    3
ERR :MgmtEth0%2FRSP0%2FCPU0%2F1.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
DRRD:MgmtEth0 3435973836 1.84467440 429496      0       0       0 429496    0
ERR :RRD /var/www/nedi/rrd/ASR9001/Bundle-Ether1.200.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
DRRD:Bundle-E 2328422804 4477996765      0      0 1402215       0 105178    3
ERR :RRD /var/www/nedi/rrd/ASR9001/Bundle-Ether1.196.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
DRRD:Bundle-E 4367677454 4138573960      0      0 1733672       0     60    3
ERR :RRD /var/www/nedi/rrd/ASR9001/Bundle-Ether1.183.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
DRRD:Bundle-E 3501453827 1865836094      0      0 1236936       0 140477    3
ERR :RRD /var/www/nedi/rrd/ASR9001/Bundle-Ether1.507.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
DRRD:Bundle-E 1819983988 1789286396      0      0 9751907       0 653685    3
ERR :RRD /var/www/nedi/rrd/ASR9001/Bundle-Ether1.151.rrd /var/www/nedi/rrd/ASR9001/MgmtEth0%2FRSP0%2FCPU0%2F1.rrd: not a simple unsigned integer: '1.84467440737096e+19'
...

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #3 on: February 26, 2019, 09:46:51 am »
See attached the nedi debug output.

I changed IP's, names, descs, passwords etc.

Have you an idea to fix this?

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #4 on: February 28, 2019, 12:38:45 pm »
Oh I see now :-)

1.84467440737096e+19 is a fairly bug number and perl resorts to scientific representation. I've seen this on devices craving a reboot, but it's possible those counters are that high indeed. Can you verify it?

You can also try adding this line in nedi.pl around line 40:
use bigint;
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #5 on: March 03, 2019, 12:47:09 pm »
I rebooted the nedi Server. It is still not working.

 Or do you mean to reboot the router?


I added the bigint, but this is not working, too.  :(

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #6 on: March 04, 2019, 10:39:36 am »
It will help to reboot the router as the counters will be reset too. But first you should check, if they even increase or if they're stuck at this very large number...

Do you have another ASR9001? What does that one look like?
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #7 on: March 04, 2019, 03:44:04 pm »
we have two ASR9001, the other node has "only" this error: uninitialized value in concatenation (.) or string at /var/www/nedi/inc/libsnmp.pm line 1915.

But this is not breaking the discovery...

I can't reboot the router, it's live with customer. 

In our cacti the graphs are working, so i think the data from the router is OK.

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #8 on: March 05, 2019, 03:23:47 pm »
Cacti works? Ok, no pressure ;-)
But can you check, whether the Cacti graphs show real traffic?

It's an issue, I've actually fixed (so I think) in 1.8. You can try this, to keep the discovery going:

Replace line 535:
         if( $val < 18446744073709551615 and $dval == abs $dval ){         # Nexus can produce overflowing 64-bit counters causing NeDi to die at DB write!


With this:
         if( $val eq '1.84467440737096e+19' ){                  # Some Cisco routers got counters stuck at > 64bit!
            $val = 1;
            Prt("ERR :$abs counter stuck > 64bit!\n",'');
         }elsif( $val < 18446744073709551615 and $dval == abs $dval ){         # Nexus can produce overflowing 64-bit counters causing NeDi to die at DB write!


This warning on line 1915 results from a "weird" looking IP address. I see it in your debug output on interface Bundle-Ether1.196. Is this supposed to be an IPv6 address?



Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #9 on: March 06, 2019, 03:25:27 pm »
"But can you check, whether the Cacti graphs show real traffic?"

Yes, it shows real traffic :)

"It's an issue, I've actually fixed (so I think) in 1.8. You can try this, to keep the discovery going:"

inc/libmisc.pm (I think you mean this file?) is now:

if($main::int{$dv}{$i}{old}){
                        my $dval = $val - $main::int{$dv}{$i}{$abs};
         if( $val eq '1.84467440737096e+19' ){                  # Some Cisco routers got counters stuck at > 64bit!
            $val = 1;
            Prt("ERR :$abs counter stuck > 64bit!\n",'');
                 }elsif( $val < 18446744073709551615 and $dval == abs $dval ){         # Nexus can produce overflowing 64-bit counters causing NeDi to die at DB write!
                 $main::int{$dv}{$i}{$dlt} = $dval;
                        }else{
                                Prt("ERR :$abs overflow, not updating\n",'');


But the error occurs anyway...

"I see it in your debug output on interface Bundle-Ether1.196. Is this supposed to be an IPv6 address?"

Yes this intarface has a IPv4 and IPv6 address.


/var/www/nedi/nedi.pl -a r03
Started with 1 seed at Wed Mar  6 15:23:31 2019
-------------------------------------------------------------------------------
Device            Status            Todo/Done-Time
===============================================================================
192.168.1.1      r03     Iv i50 JxJxJxJxJxJxJxJxJxJxJxJxUse of uninitialized value in concatenation (.) or string at /var/www/nedi/inc/libsnmp.pm line 1915.
 j48   Dcp0 b0 m10   Ap a0/0    f0    0/1-5s
===============================================================================
1 devices, 3 threads, retire: 0 MAC links in 1 iterations, 0 seconds
Took 0 minutes



/var/www/nedi/nedi.pl -a r01
Started with 1 seed at Wed Mar  6 15:24:25 2019
-------------------------------------------------------------------------------
Device            Status            Todo/Done-Time
===============================================================================
192.168.2.2  ham-apc-r01     Iv i112 JxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxUse of uninitialized value in concatenation (.) or string at /var/www/nedi/inc/libsnmp.pm line 1915.
 j143   p0 b0 m8   Ap a0/0    f0Ru(MgmtEth0%2FRSP0%2FCPU0%2F1)Ri(Bundle-Ether1.120)Ri(Bundle-Ether1.147)Ri(Bundle-Ether1.198)Ri(Bundle-Ether1.121)Ri(Bundle-Ether1.105)Ri(Bundle-Ether1.510)Ri(Bundle-Ether1.171)Ri(Bundle-Ether1.161)Ri(Bundle-Ether1.156)Ri(Bundle-Ether1.164)Ri(Bundle-Ether1.117)Ri(Bundle-Ether1.229)Ri(Bundle-Ether1.188)Ri(Bundle-Ether1.226)Ri(Bundle-Ether1.131)Ri(Bundle-Ether1.134)Ri(Bundle-Ether1.124)Ri(Bundle-Ether1.2)Ri(TenGigE0%2F0%2F2%2F0)Ri(Bundle-Ether1.207)Ri(Bundle-Ether1.218)Ri(Bundle-Ether1.208)Ri(dwdm0%2F0%2F2%2F3)Ri(Bundle-Ether1.215)Ri(Bundle-Ether1.230)Ri(Bundle-Ether1.531)Ri(dwdm0%2F0%2F2%2F0)Ri(Bundle-Ether1.122)Ri(Bundle-Ether1.144)Ri(Bundle-Ether1.153)Ri(Bundle-Ether1.148)Ri(Bundle-Ether1.9)Ri(Bundle-Ether1.193)Ri(Bundle-Ether1.174)Ri(Bundle-Ether1.194)Ri(MgmtEth0%2FRSP0%2FCPU0%2F0)Ri(Bundle-Ether1.108)Ri(Bundle-Ether1.245)Ri(Bundle-Ether1.167)Ri(dwdm0%2F0%2F2%2F1)Ri(Bundle-Ether1.203)Ri(Bundle-Ether1.149)Ri(TenGigE0%2F0%2F2%2F1)Ri(Bundle-Ether1.200)Ri(Bundle-Ether1.115)Ri(Bundle-Ether1.172)Ri(Bundle-Ether1.136)Ri(Bundle-Ether1.176)Ri(Bundle-Ether1.197)Ri(Bundle-Ether1.219)Ri(Bundle-Ether1.4)Ri(Bundle-Ether1.231)Ri(Bundle-Ether1.19)Ri(Bundle-Ether1.242)Ri(Bundle-Ether1.102)Ri(Bundle-Ether1.175)Ri(dwdm0%2F0%2F2%2F2)Ri(Bundle-Ether1.125)Ri(Bundle-Ether1.204)Ri(Bundle-Ether1.196)Ri(Bundle-Ether1.165)Ri(Bundle-Ether1.116)Ri(Bundle-Ether1.118)Ri(Bundle-Ether1.158)Ri(Bundle-Ether1.163)Ri(Bundle-Ether1.169)Ri(Bundle-Ether1.154)Ri(Bundle-Ether1.142)Ri(Bundle-Ether1.202)Ri(Bundle-Ether1.221)Ri(Bundle-Ether1)Ri(Bundle-Ether1.238)Ri(Bundle-Ether1.213)Ri(Bundle-Ether1.145)Ri(Bundle-Ether1.243)Ri(Bundle-Ether1.110)Ri(Bundle-Ether1.152)Ri(Bundle-Ether1.107)Ri(Bundle-Ether1.157)Ri(Bundle-Ether1.212)Ri(Bundle-Ether1.184)Ri(Null0)Ri(Loopback0)Ri(Bundle-Ether1.507)Ri(Bundle-Ether1.179)Ri(Bundle-Ether1.236)Ri(Bundle-Ether1.216)Ri(TenGigE0%2F0%2F2%2F3)Ri(Bundle-Ether1.214)Ri(Bundle-Ether1.14)Ri(Bundle-Ether1.237)Ri(Bundle-Ether1.240)Ri(Bundle-Ether1.50)Ri(Bundle-Ether1.151)Ri(Bundle-Ether1.241)Ri(Bundle-Ether1.103)Ri(Bundle-Ether1.139)Ri(Bundle-Ether1.205)Ri(Bundle-Ether1.246)Ri(Bundle-Ether1.201)Ri(Bundle-Ether1.206)Ri(Bundle-Ether1.183)Ri(Bundle-Ether1.178)Ri(Bundle-Ether1.109)Ri(Bundle-Ether1.217)Ri(Bundle-Ether1.189)DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.
DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.



rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #10 on: March 11, 2019, 07:51:07 pm »
Darn!

I really don't understand, what value you're getting here...

Can you add this above that line 535 and share the output?:
print "+$val+";

Just to be sure, the DB fields for those counters are all bigint(20) unsigned? You can check in System-Database -> interfaces table...
« Last Edit: March 11, 2019, 08:14:50 pm by rickli »
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #11 on: March 13, 2019, 10:36:02 am »
I changed it to bigint(40) unsigned but no change...

print "+$val+";

--> gives no output

print "hello";

--> gives no output


Where should I see the otput?

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #12 on: March 13, 2019, 05:21:43 pm »
OK, the Second ASR9001 gives me Output for "print "+$val+";"

(+5065994933+29686203813+0+0+44641+0+1180880+IF  :    66 Bundle-Eth)

So the first ASR9001 is not going to line 535? The Error must come before that line...

rickli

  • Administrator
  • Hero Member
  • *****
  • Posts: 2893
    • View Profile
    • NeDi
Re: ASR9001 Discovery Problems
« Reply #13 on: March 20, 2019, 12:14:07 pm »
Ok, put this on line 529:

print "+$stat+$abs+$dlt+$val+\n";
Please consider Other-Invoices on your NeDi installation for an annual contribution, tx!
-Remo

t0mat000

  • Newbie
  • *
  • Posts: 10
    • View Profile
Re: ASR9001 Discovery Problems
« Reply #14 on: March 29, 2019, 10:30:24 am »
Here the output:

Code: [Select]
Started with 1 seed at Fri Mar 29 10:28:36 2019
-------------------------------------------------------------------------------
Device Status Todo/Done-Time
===============================================================================
192.168.178.123  asr9001     Iv++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+76213287766+
++ooc+doo+125011423246+
++ier+die+4294967293+
++oer+doe+4294967294+
++idi+did+3114410+
++odi+dod+0+
++ibr+dib+4307123926+
++ioc+dio+51539607540+
++ooc+doo+1.84467440737096e+19+
++ier+die+4294967293+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+8589934590+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+907117217571917+
++ooc+doo+902153247424226+
++ier+die+8654019+
++oer+doe+0+
++idi+did+217+
++odi+dod+0+
++ibr+dib+648626439+
++ioc+dio+107452364246673+
++ooc+doo+296480642315934+
++ier+die+0+
++oer+doe+0+
++idi+did+27079220+
++odi+dod+0+
++ibr+dib+1805277+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+443425905655286+
++ooc+doo+439623948044583+
++ier+die+8653964+
++oer+doe+0+
++idi+did+35+
++odi+dod+0+
++ibr+dib+368457309+
++ioc+dio+463691314016284+
++ooc+doo+462529301514423+
++ier+die+55+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+280169130+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+0+
++ooc+doo+0+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+0+
++ioc+dio+21072960025640+
++ooc+doo+20793424082928+
++ier+die+0+
++oer+doe+0+
++idi+did+30257794+
++odi+dod+0+
++ibr+dib+1232747+
++ioc+dio+346662188302+
++ooc+doo+44761029692+
++ier+die+0+
++oer+doe+0+
++idi+did+314939683+
++odi+dod+0+
++ibr+dib+8076661+
++ioc+dio+17931607936296+
++ooc+doo+6042317310324+
++ier+die+0+
++oer+doe+0+
++idi+did+25059706+
++odi+dod+0+
++ibr+dib+21522508+
++ioc+dio+346449342604+
++ooc+doo+28902213685+
++ier+die+0+
++oer+doe+0+
++idi+did+8376217+
++odi+dod+0+
++ibr+dib+3750777+
++ioc+dio+56473517952490+
++ooc+doo+26237934870058+
++ier+die+0+
++oer+doe+0+
++idi+did+71489606+
++odi+dod+0+
++ibr+dib+97423942+
++ioc+dio+141549031517+
++ooc+doo+8693138633+
++ier+die+0+
++oer+doe+0+
++idi+did+2174563+
++odi+dod+0+
++ibr+dib+606258+
++ioc+dio+65161947765+
++ooc+doo+156766857621+
++ier+die+0+
++oer+doe+0+
++idi+did+3046040+
++odi+dod+0+
++ibr+dib+1294855+
++ioc+dio+44203599691399+
++ooc+doo+11930619431590+
++ier+die+0+
++oer+doe+0+
++idi+did+2014271+
++odi+dod+0+
++ibr+dib+307884+
++ioc+dio+325657880542+
++ooc+doo+55239243314+
++ier+die+0+
++oer+doe+0+
++idi+did+2103717+
++odi+dod+0+
++ibr+dib+535650+
++ioc+dio+605725167302+
++ooc+doo+135188902237+
++ier+die+0+
++oer+doe+0+
++idi+did+2185637+
++odi+dod+0+
++ibr+dib+617182+
++ioc+dio+751629307707+
++ooc+doo+3608018733522+
++ier+die+0+
++oer+doe+0+
++idi+did+12712522+
++odi+dod+0+
++ibr+dib+10749514+
++ioc+dio+1854285850045+
++ooc+doo+776436387059+
++ier+die+0+
++oer+doe+0+
++idi+did+30622058+
++odi+dod+0+
++ibr+dib+26205820+
++ioc+dio+154097851651+
++ooc+doo+17455747747+
++ier+die+0+
++oer+doe+0+
++idi+did+1622631+
++odi+dod+0+
++ibr+dib+370318+
++ioc+dio+172827521496+
++ooc+doo+88813703208+
++ier+die+0+
++oer+doe+0+
++idi+did+6592046+
++odi+dod+0+
++ibr+dib+4953763+
++ioc+dio+1075465096534+
++ooc+doo+465320795891+
++ier+die+0+
++oer+doe+0+
++idi+did+2196861+
++odi+dod+0+
++ibr+dib+636779+
++ioc+dio+1212089297902+
++ooc+doo+8010859087412+
++ier+die+0+
++oer+doe+0+
++idi+did+6011250+
++odi+dod+0+
++ibr+dib+3342308+
++ioc+dio+5584465975+
++ooc+doo+3430512150+
++ier+die+0+
++oer+doe+0+
++idi+did+2062866+
++odi+dod+0+
++ibr+dib+479141+
++ioc+dio+2274357457833+
++ooc+doo+3290795150069+
++ier+die+0+
++oer+doe+0+
++idi+did+5051341+
++odi+dod+0+
++ibr+dib+297856+
++ioc+dio+2988355939306+
++ooc+doo+121742323301+
++ier+die+0+
++oer+doe+0+
++idi+did+1571208+
++odi+dod+0+
++ibr+dib+8+
++ioc+dio+341531438968+
++ooc+doo+71342144785+
++ier+die+0+
++oer+doe+0+
++idi+did+2239013+
++odi+dod+0+
++ibr+dib+649789+
++ioc+dio+8925056701+
++ooc+doo+3896339807+
++ier+die+0+
++oer+doe+0+
++idi+did+2193677+
++odi+dod+0+
++ibr+dib+625381+
++ioc+dio+3524991267483+
++ooc+doo+7205044087615+
++ier+die+0+
++oer+doe+0+
++idi+did+35664427+
++odi+dod+0+
++ibr+dib+20863+
++ioc+dio+16404384253+
++ooc+doo+3892961865+
++ier+die+0+
++oer+doe+0+
++idi+did+2036011+
++odi+dod+0+
++ibr+dib+465593+
++ioc+dio+612831869230+
++ooc+doo+60308699547+
++ier+die+0+
++oer+doe+0+
++idi+did+3437661+
++odi+dod+0+
++ibr+dib+1893399+
++ioc+dio+2732357053122+
++ooc+doo+165904312388+
++ier+die+0+
++oer+doe+0+
++idi+did+1909419+
++odi+dod+0+
++ibr+dib+323694+
++ioc+dio+73823924466982+
++ooc+doo+111748090746459+
++ier+die+0+
++oer+doe+0+
++idi+did+15248305+
++odi+dod+0+
++ibr+dib+47435797+
++ioc+dio+7903976180+
++ooc+doo+2307210279+
++ier+die+0+
++oer+doe+0+
++idi+did+2171598+
++odi+dod+0+
++ibr+dib+603347+
++ioc+dio+15704763911590+
++ooc+doo+1126059645383+
++ier+die+0+
++oer+doe+0+
++idi+did+2963997+
++odi+dod+0+
++ibr+dib+1351766+
++ioc+dio+8822344474967+
++ooc+doo+1128638830360+
++ier+die+0+
++oer+doe+0+
++idi+did+1861958+
++odi+dod+0+
++ibr+dib+7+
++ioc+dio+24875989640757+
++ooc+doo+1326595228255+
++ier+die+0+
++oer+doe+0+
++idi+did+5780699+
++odi+dod+0+
++ibr+dib+3888598+
++ioc+dio+70153562279+
++ooc+doo+6682177688+
++ier+die+0+
++oer+doe+0+
++idi+did+2258409+
++odi+dod+0+
++ibr+dib+645465+
++ioc+dio+91121954819+
++ooc+doo+10420390521+
++ier+die+0+
++oer+doe+0+
++idi+did+33219192+
++odi+dod+0+
++ibr+dib+1631350+
++ioc+dio+22096123532+
++ooc+doo+28908746235+
++ier+die+0+
++oer+doe+0+
++idi+did+1612981+
++odi+dod+0+
++ibr+dib+1004+
++ioc+dio+1692846941667+
++ooc+doo+149541120051+
++ier+die+0+
++oer+doe+0+
++idi+did+1666670+
++odi+dod+0+
++ibr+dib+1901+
++ioc+dio+3371859581704+
++ooc+doo+827395336254+
++ier+die+0+
++oer+doe+0+
++idi+did+3716252+
++odi+dod+0+
++ibr+dib+1054543+
++ioc+dio+4704958802+
++ooc+doo+2128561077+
++ier+die+0+
++oer+doe+0+
++idi+did+2449147+
++odi+dod+0+
++ibr+dib+664875+
++ioc+dio+1265220469547+
++ooc+doo+52557996520+
++ier+die+0+
++oer+doe+0+
++idi+did+2239393+
++odi+dod+0+
++ibr+dib+620923+
++ioc+dio+6148138524+
++ooc+doo+3656515832+
++ier+die+0+
++oer+doe+0+
++idi+did+2629944+
++odi+dod+0+
++ibr+dib+2999490+
++ioc+dio+2785805754418+
++ooc+doo+11162266808516+
++ier+die+0+
++oer+doe+0+
++idi+did+5400852+
++odi+dod+0+
++ibr+dib+4107822+
++ioc+dio+804875567613+
++ooc+doo+123040785498+
++ier+die+0+
++oer+doe+0+
++idi+did+1613272+
++odi+dod+0+
++ibr+dib+7+
++ioc+dio+137744707615+
++ooc+doo+80737818949+
++ier+die+0+
++oer+doe+0+
++idi+did+2112761+
++odi+dod+0+
++ibr+dib+500364+
++ioc+dio+200584385959+
++ooc+doo+44999498826+
++ier+die+0+
++oer+doe+0+
++idi+did+2079005+
++odi+dod+0+
++ibr+dib+466826+
++ioc+dio+47581944140517+
++ooc+doo+93242719900+
++ier+die+0+
++oer+doe+0+
++idi+did+1784961+
++odi+dod+0+
++ibr+dib+208788+
++ioc+dio+51065338932+
++ooc+doo+22535571112+
++ier+die+0+
++oer+doe+0+
++idi+did+1036358+
++odi+dod+0+
++ibr+dib+547952+
++ioc+dio+223297840454+
++ooc+doo+15920308909+
++ier+die+0+
++oer+doe+0+
++idi+did+3077531+
++odi+dod+0+
++ibr+dib+15254+
++ioc+dio+20334361104+
++ooc+doo+16562486616+
++ier+die+0+
++oer+doe+0+
++idi+did+3820605+
++odi+dod+0+
++ibr+dib+2296743+
++ioc+dio+31538600437666+
++ooc+doo+10952296087564+
++ier+die+0+
++oer+doe+0+
++idi+did+12529581+
++odi+dod+0+
++ibr+dib+3516202+
++ioc+dio+9106014744759+
++ooc+doo+679874538243+
++ier+die+0+
++oer+doe+0+
++idi+did+2305550+
++odi+dod+0+
++ibr+dib+567014+
++ioc+dio+401408648161+
++ooc+doo+16152692294+
++ier+die+0+
++oer+doe+0+
++idi+did+2240518+
++odi+dod+0+
++ibr+dib+628389+
++ioc+dio+6915443915705+
++ooc+doo+362490636279+
++ier+die+0+
++oer+doe+0+
++idi+did+12369367+
++odi+dod+0+
++ibr+dib+16812132+
++ioc+dio+344625393339+
++ooc+doo+193114209804+
++ier+die+0+
++oer+doe+0+
++idi+did+2182967+
++odi+dod+0+
++ibr+dib+325319+
++ioc+dio+28951350686+
++ooc+doo+40701849007+
++ier+die+0+
++oer+doe+0+
++idi+did+2104605+
++odi+dod+0+
++ibr+dib+538887+
++ioc+dio+19487032167+
++ooc+doo+6581894912+
++ier+die+0+
++oer+doe+0+
++idi+did+53651696+
++odi+dod+0+
++ibr+dib+1624273+
++ioc+dio+436902260+
++ooc+doo+89141314+
++ier+die+0+
++oer+doe+0+
++idi+did+1780322+
++odi+dod+0+
++ibr+dib+168193+
++ioc+dio+3822030487817+
++ooc+doo+379060887017+
++ier+die+0+
++oer+doe+0+
++idi+did+1804915+
++odi+dod+0+
++ibr+dib+190041+
++ioc+dio+604069436964+
++ooc+doo+65766503307+
++ier+die+0+
++oer+doe+0+
++idi+did+1761873+
++odi+dod+0+
++ibr+dib+95+
++ioc+dio+2556693636707+
++ooc+doo+132945919397+
++ier+die+0+
++oer+doe+0+
++idi+did+3815513+
++odi+dod+0+
++ibr+dib+2151994+
++ioc+dio+14481331541433+
++ooc+doo+19588369740276+
++ier+die+0+
++oer+doe+0+
++idi+did+2437608+
++odi+dod+0+
++ibr+dib+3336927+
++ioc+dio+332061476141+
++ooc+doo+622363181384+
++ier+die+0+
++oer+doe+0+
++idi+did+1405905+
++odi+dod+0+
++ibr+dib+1180385+
++ioc+dio+1195192489737+
++ooc+doo+10321689883907+
++ier+die+0+
++oer+doe+0+
++idi+did+19466795+
++odi+dod+0+
++ibr+dib+167942+
++ioc+dio+11133070685806+
++ooc+doo+11020893435200+
++ier+die+0+
++oer+doe+0+
++idi+did+4436695+
++odi+dod+0+
++ibr+dib+2210682+
++ioc+dio+3859011442893+
++ooc+doo+6963101217260+
++ier+die+0+
++oer+doe+0+
++idi+did+18060805+
++odi+dod+0+
++ibr+dib+28560866+
++ioc+dio+450426045421+
++ooc+doo+256863188395+
++ier+die+0+
++oer+doe+0+
++idi+did+6242967+
++odi+dod+0+
++ibr+dib+4591794+
++ioc+dio+2120561281142+
++ooc+doo+12621814882335+
++ier+die+0+
++oer+doe+0+
++idi+did+2778433+
++odi+dod+0+
++ibr+dib+1599618+
++ioc+dio+772480532+
++ooc+doo+2593161481+
++ier+die+0+
++oer+doe+0+
++idi+did+6654745+
++odi+dod+0+
++ibr+dib+4484167+
++ioc+dio+32192765748+
++ooc+doo+3359738716+
++ier+die+0+
++oer+doe+0+
++idi+did+1655570+
++odi+dod+0+
++ibr+dib+77+
++ioc+dio+963556884453+
++ooc+doo+84049711679+
++ier+die+0+
++oer+doe+0+
++idi+did+0+
++odi+dod+0+
++ibr+dib+11+
++ioc+dio+76800040690+
++ooc+doo+301500648159+
++ier+die+0+
++oer+doe+0+
++idi+did+776948+
++odi+dod+0+
++ibr+dib+30+
++ioc+dio+369813772544+
++ooc+doo+141937636748+
++ier+die+0+
++oer+doe+0+
++idi+did+1820050+
++odi+dod+0+
++ibr+dib+164477+
++ioc+dio+6670380765567+
++ooc+doo+155524992589+
++ier+die+0+
++oer+doe+0+
++idi+did+24732381+
++odi+dod+0+
++ibr+dib+18781084+
++ioc+dio+3734178048361+
++ooc+doo+176752782059+
++ier+die+0+
++oer+doe+0+
++idi+did+1656003+
++odi+dod+0+
++ibr+dib+4+
++ioc+dio+85013562021+
++ooc+doo+28474851540+
++ier+die+0+
++oer+doe+0+
++idi+did+2319279+
++odi+dod+0+
++ibr+dib+663791+
++ioc+dio+74656758429+
++ooc+doo+652084332110+
++ier+die+0+
++oer+doe+0+
++idi+did+2331255+
++odi+dod+0+
++ibr+dib+699677+
++ioc+dio+11442482357320+
++ooc+doo+21039315571652+
++ier+die+0+
++oer+doe+0+
++idi+did+8541115+
++odi+dod+0+
++ibr+dib+1557316+
++ioc+dio+78914291117312+
++ooc+doo+24543063181+
++ier+die+0+
++oer+doe+0+
++idi+did+1331432393+
++odi+dod+0+
++ibr+dib+161167+
++ioc+dio+236086600415+
++ooc+doo+178877723303+
++ier+die+0+
++oer+doe+0+
++idi+did+1840338+
++odi+dod+0+
++ibr+dib+227723+
++ioc+dio+101450255489+
++ooc+doo+76862793280+
++ier+die+0+
++oer+doe+0+
++idi+did+3529676+
++odi+dod+0+
++ibr+dib+672808+
++ioc+dio+821551795229+
++ooc+doo+613459360099+
++ier+die+0+
++oer+doe+0+
++idi+did+3077516+
++odi+dod+0+
++ibr+dib+825147+
++ioc+dio+11015457383201+
++ooc+doo+309255277859+
++ier+die+0+
++oer+doe+0+
++idi+did+3319060+
++odi+dod+0+
++ibr+dib+1439186+
++ioc+dio+2703650544+
++ooc+doo+1901842832+
++ier+die+0+
++oer+doe+0+
++idi+did+4230273+
++odi+dod+0+
++ibr+dib+365056+
++ioc+dio+11080576276+
++ooc+doo+3708408531+
++ier+die+0+
++oer+doe+0+
++idi+did+1655684+
++odi+dod+0+
++ibr+dib+53694+
++ioc+dio+833052005911+
++ooc+doo+10663774805225+
++ier+die+0+
++oer+doe+0+
++idi+did+1662216+
++odi+dod+0+
++ibr+dib+11+
++ioc+dio+238647543712+
++ooc+doo+17003017194+
++ier+die+0+
++oer+doe+0+
++idi+did+189959846+
++odi+dod+0+
++ibr+dib+14887+
++ioc+dio+1126525720+
++ooc+doo+5604621171+
++ier+die+0+
++oer+doe+0+
++idi+did+11906705+
++odi+dod+0+
++ibr+dib+9702156+
++ioc+dio+65074177115+
++ooc+doo+19150057716+
++ier+die+0+
++oer+doe+0+
++idi+did+3427686+
++odi+dod+0+
++ibr+dib+1770989+
++ioc+dio+73946822377+
++ooc+doo+5568286702+
++ier+die+0+
++oer+doe+0+
++idi+did+1656479+
++odi+dod+0+
++ibr+dib+81+
++ioc+dio+639349347060+
++ooc+doo+1535136496394+
++ier+die+0+
++oer+doe+0+
++idi+did+1934260+
++odi+dod+0+
++ibr+dib+1438+
++ioc+dio+96159932314+
++ooc+doo+457175385625+
++ier+die+0+
++oer+doe+0+
++idi+did+1778259+
++odi+dod+0+
++ibr+dib+42816+
++ioc+dio+884681665+
++ooc+doo+4134305489+
++ier+die+0+
++oer+doe+0+
++idi+did+1135059+
++odi+dod+0+
++ibr+dib+2638807+
++ioc+dio+2692330040920+
++ooc+doo+2611704313106+
++ier+die+0+
++oer+doe+0+
++idi+did+14744682+
++odi+dod+0+
++ibr+dib+8786764+
++ioc+dio+2065380491526+
++ooc+doo+5167149864850+
++ier+die+0+
++oer+doe+0+
++idi+did+8485807+
++odi+dod+0+
++ibr+dib+5100255+
++ioc+dio+1627741086326+
++ooc+doo+504952753469+
++ier+die+0+
++oer+doe+0+
++idi+did+7128849+
++odi+dod+0+
++ibr+dib+5463421+
++ioc+dio+245314981958183+
++ooc+doo+235993248454700+
++ier+die+0+
++oer+doe+0+
++idi+did+541347102+
++odi+dod+0+
++ibr+dib+7665+
++ioc+dio+8426461335+
++ooc+doo+11391789407+
++ier+die+0+
++oer+doe+0+
++idi+did+2954+
++odi+dod+0+
++ibr+dib+1109+
++ioc+dio+758336998+
++ooc+doo+3423085219448+
++ier+die+0+
++oer+doe+0+
++idi+did+1886675+
++odi+dod+0+
++ibr+dib+1243120+
++ioc+dio+3747466823+
++ooc+doo+29654221963122+
++ier+die+0+
++oer+doe+0+
++idi+did+13718898+
++odi+dod+0+
++ibr+dib+37579554+
++ioc+dio+471512646+
++ooc+doo+33579085170+
++ier+die+0+
++oer+doe+0+
++idi+did+437634+
++odi+dod+0+
++ibr+dib+1323018+
++ioc+dio+466305389+
++ooc+doo+8075940879+
++ier+die+0+
++oer+doe+0+
++idi+did+2140+
++odi+dod+0+
++ibr+dib+109072+
 i112 JxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxJxUse of uninitialized value in concatenation (.) or string at /var/www/nedi/inc/libsnmp.pm line 1915.
 j143   p0 b0 m8   Ap a0/0    f0Ru(MgmtEth0%2FRSP0%2FCPU0%2F1)Ri(Bundle-Ether1.9)Ri(Bundle-Ether1.531)Ri(Bundle-Ether1.240)Ri(TenGigE0%2F0%2F2%2F3)Ri(Bundle-Ether1.158)Ri(Bundle-Ether1.144)Ri(Bundle-Ether1.230)Ri(Bundle-Ether1.136)Ri(Bundle-Ether1.121)Ri(Bundle-Ether1.102)Ri(Bundle-Ether1.198)Ri(MgmtEth0%2FRSP0%2FCPU0%2F0)Ri(Bundle-Ether1.208)Ri(Bundle-Ether1)Ri(Bundle-Ether1.203)Ri(Bundle-Ether1.172)Ri(Bundle-Ether1.115)DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.
DBD::mysql::st execute failed: Out of range value for column 'outoct' at row 1 at /var/www/nedi/inc/libdb.pm line 1476.