Configuration of T1 on Netvanta 3448

[f1x0r4t3d]

Hello,

I am in the process of configuring a NetVanta 3448 with T1 interface. I have successfully configured the T1 and PPP as they both show as up but I cannot ping anything other than the local ethernet interface. I am able to lock the circuit from our DS3 and perform loopback tests but IP routing seems to not be working properly. Any assistance would be greatly appreciated.

Thanks

[f1x0r4t3d]

To add a few more details, the config has the IP route of 0.0.0.0 0.0.0.0 ppp 1

[Anonymous · Accepted solution]

Can you post your full config from both routers?  Or does this connect to a service provider such that you don't control the other end? 

[f1x0r4t3d]

Here is the config of the Adtran router. I began testing with a 3200.

! ADTRAN, Inc. OS version 17.05.01.00.E

! Boot ROM version 17.02.01.00

! Platform: NetVanta 3200, part number xxxxxx

! Serial number XXXXX

!

!

hostname "Router"

no enable password

!

clock timezone GMT-Dublin

!

ip subnet-zero

ip classless

ip routing

!!!

!

auto-config

!

event-history on

no logging forwarding

no logging email

!

no service password-encryption

!

username "admin" password "password"

!

!

no ip firewall alg msn

no ip firewall alg mszone

no ip firewall alg h323

!

no dot11ap access-point-control

!

interface eth 0/1

  ip address  11.205.205.5  255.255.255.0

  no shutdown

!

interface t1 1/1

  fdl att

  tdm-group 1 timeslots 1-24 speed 64

  no shutdown

!

interface ppp 1

  ip unnumbered eth 0/1

  peer default ip address 11.205.205.205

  ppp multilink interleave

  ppp multilink fragmentation

  ppp multilink

  no shutdown

  cross-connect 1 t1 1/1 1 ppp 1

!

!

ip route 0.0.0.0 0.0.0.0 ppp 1

!

no ip tftp server

no ip tftp server overwrite

ip http server

no ip http secure-server

no ip snmp agent

no ip ftp server

no ip scp server

no ip sntp server

!

!

no snmp-server enable traps

!

!

!

!!!!!

!

line con 0

  no login

!

line telnet 0 4

  login

  no shutdown

line ssh 0 4

  login local-userlist

  no shutdown

!

!

end

[f1x0r4t3d]

Here is the DS3 configuration for the bundle I am working with.

##################DS3 Configuration:

interface  bundle TEST

    link  ct3 1 18

    encapsulation ppp

    ppp mru 64-1518-4500

    ip  unnumbered ethernet1

    ip  multicast ospfrip2

    red

      exit red

    icmp

      exit icmp

    qos

      add_class TESTvoice root-out cr 300 br 1500 priority 1

      add_class TESTdefault root-out cr 100 br 1000 priority 5

      add_class TESTdata root-out cr 600 br 1000 priority 2

      add_class TESTdatain TESTdata cr 300 br 1000

      add_class TESTdataout TESTdata cr 200 br 1000

      class TESTvoice

        add_vlan_id 30

        exit class

      class TESTdefault

        add_vlan_id default

        exit class

      class TESTdata

        add_vlan_id 31

        exit class

      class TESTdatain

        add_src_ip 11.0.0.0 255.0.0.0

        exit class

      class TESTdataout

        add_src_ip default

        exit class

      enable cbq outbound

      exit qos

    aaa

      exit aaa

    exit bundle

################################TRIED DS3 CONFIG:

interface  bundle TEST

    link  ct3 1 18

    encapsulation ppp

    ppp mru 64-1518-4500

    ip  unnumbered ethernet1

    ip  multicast ospfrip2

    red

      exit red

    icmp

      exit icmp

    qos

      exit qos

    aaa

      exit aaa

    exit bundle

####################DS3 BUNDLE Status

DS3> show int bundle TEST

bundle TEST

--------------

status                              up

number of links                     1

total bandwidth                     1536 kbps

link                 speed  bw     inverted  status     diffdelay(msec)

----                 -----  --     --------  ------     ----------------

ct3 1 18             64     1536   no        up          -

encapsulation                       ppp

    mtu                             64-1500-4500

    mru                             64-1518-4500

    magic_check                     enable

Negotiated ppp bundle values

    negotiated mru                  1500

    negotiated mtu                  1518

ip info

    ipaddr                          11.205.205.205

    netmask                         255.255.255.0

[f1x0r4t3d]

Here is the interface status of the 3200

Router#show interfaces

Displaying interfaces...

t1 1/1 is UP

  Receiver has no alarms

  T1 coding is B8ZS, framing is ESF

  Clock source is line, FDL type is AT&T

  Line build-out is 0dB

  No remote loopbacks, No network loopbacks

  Acceptance of remote loopback requests enabled

  Tx Alarm Enable: rai

  Last clearing of counters 00:13:39

    loss of frame  : 1, last occurred 00:13:39

    loss of signal : 0

    AIS alarm      : 0

    Remote alarm   : 0

  DS0 Status: 123456789012345678901234

              NNNNNNNNNNNNNNNNNNNNNNNN

  Status Legend: '-' = DS0 is unallocated

                 'N' = DS0 is dedicated (nailed)

  Line Status: -- No Alarms --

  5 minute input rate 8984 bits/sec, 11 packets/sec

  5 minute output rate 9200 bits/sec, 11 packets/sec

  Current Performance Statistics:

    0 Errored Seconds, 0 Bursty Errored Seconds

    0 Severely Errored Seconds, 0 Severely Errored Frame Seconds

    0 Unavailable Seconds, 0 Path Code Violations

    0 Line Code Violations, 0 Controlled Slip Seconds

    0 Line Errored Seconds, 0 Degraded Minutes

  TDM group 1, line protocol is UP

  Encapsulation PPP (ppp 1)

    8705 packets input, 876595 bytes, 0 no buffer

    0 runts, 0 giants, 0 throttles

    99 input errors, 99 CRC, 0 frame

    0 abort, 0 discards, 0 overruns

    8735 packets output, 902171 bytes, 0 underruns

ppp 1 is UP

  Configuration:

    Keep-alive is set (10 sec.)

    Multilink

      MTU = 1500, MRRU = 1520

    Multilink Interleave

    Multilink Fragmentation

    No authentication

    IP is configured

      unnumbered 11.205.205.5  255.255.255.0

  Link thru t1 1/1 is UP; LCP state is OPENED, negotiated MTU is 1500

    Actual Bandwidth is 1536 kbps

    Receive: bytes=876721, pkts=8709, errors=0

    Transmit: bytes=1802284, pkts=17446, errors=0

  5 minute input rate 8984 bits/sec, 11 packets/sec

  5 minute output rate 9200 bits/sec, 11 packets/sec

  Bundle information

    Aggregate Bandwidth is 1536 kbps

    Total receive: bytes=876721, pkts=8709, errors=0

    Total transmit: bytes=1802284, pkts=17446, errors=0

    5 minute input rate 8984 bits/sec, 11 packets/sec

    5 minute output rate 9200 bits/sec, 11 packets/sec

    Queueing method: weighted fair

    HDLC tx ring limit: 2

    Output queue: 0/1/540/64/0 (size/highest/max total/threshold/drops)

      Conversations  0/1/256 (active/max active/max total)

      Available Bandwidth 1152 kilobits/sec

    IP is UP, IPCP state is OPENED

      Unnumbered Address=11.205.205.5 Mask=255.255.255.0

      Peer address=11.205.205.205

      IP MTU=1500, Bandwidth=1536 Kbps

    LLDPCP State is STOPPED

eth 0/1 is UP, line protocol is UP

  Hardware address is XX:XX:XX:XX:XX:XX

  Ip address is 11.205.205.5, netmask is 255.255.255.0

  MTU is 1500 bytes,  BW is 100000 Kbit

  100Mb/s, negotiated full-duplex, configured full-duplex

  ARP type: ARPA; ARP timeout is 20 minutes

  5 minute input rate 3912 bits/sec, 5 packets/sec

  5 minute output rate 11608 bits/sec, 5 packets/sec

    Queueing method: fifo

    Output queue: 0/256/0 (size/max total/drops)

    Interface Shaper: NOT ENABLED

    1773 packets input, 151969 bytes

    1609 unicasts, 164 broadcasts, 0 multicasts input

    0 unknown protocol, 0 symbol errors, 0 discards

    0 input errors, 0 runts, 0 giants

    0 no buffer, 0 overruns, 0 internal receive errors

[Anonymous]

Well, my first observation without digging deeper is the multi-link part of the configuration on a single T1 service.  Having multi-link enabled itself may not be a problem, but I definitely think 'ppp interleave' could cause an issue if enabled on one side and not the other.  That said, since it's a single T1 none of the multi-link config should be necessary, unless, of course, you are planning on adding T1's to the bundle.

[f1x0r4t3d]

Removing the ppp multilink drops the PPP interface and leaves it in a down state. I have been able to remove the interleave and fragmentation while leaving the PPP in an up state. Not sure why it kills the PPP without multilink though since both the DS3 and Adtran config only have 1 T1.

[Anonymous]

So do you know how the upstream router is configured?  Is it a service provider or another site you manage directly?  Have you tried putting the IP on the PPP interface directly just to see if it works in that configuration?  Are you also constantly receiving errors on the T1 interface?  I just noticed now that while counters were showing cleared 13 minutes ago in your screen dump, input errors and CRC's were still reported.

  TDM group 1, line protocol is UP

  Encapsulation PPP (ppp 1)

    8705 packets input, 876595 bytes, 0 no buffer

    0 runts, 0 giants, 0 throttles

    99 input errors, 99 CRC, 0 frame

I find it odd that removing multilink breaks PPP link but that means the other side is likely configured for multilink.  Again, shouldn't be a bad thing or prohibit service from working like how you are experiencing.  As long as the configuration matches on both sides, you should be good.  The interface is also reporting a small amount of 2 way traffic, so that at least is a good sign that you are talking to something.  I did notice that your code is pretty old - showing ADTRAN, Inc. OS version 17.05.01.00.E in your running config.  You should probably upgrade.

I would look for and check off all the usual suspects before going further and running debugs, because that is probably the next step.  You will definitely want to talk to whomever manages the other side of this connection and make sure that IP, Netmask, and PPP configuration information is all correct.  Definitely make sure you aren't taking input and CRC errors when the T1 is UP with PPP UP.  That may be a sign of a framing problem elsewhere in the circuit.  It may also be worth making sure that ICMP isn't blocked on the gateway for some reason. 

[f1x0r4t3d]

I went ahead and deleted the QOS from both the DS3 and the Adtran. I was able to configure the PPP without multilink and the bundle came up but still no ping. I configured the PPP interface with the IP directly and still no ping. I have direct control of the DS3 (other side). I will have to go back to review the configuration without the QOS to see if it has any errors. Using a different non-Adtran router on the client (test) side allows ICMP packets so I don't think it would be anything external to the Adtran configuration. I think it is something I may be missing on the Adtran config. I even tried disabling IP Routing and enabling the IP default-gateway but still no ping. Thank you very much for your assistance by the way...I will let you know if I find any errors on the new config.

[f1x0r4t3d]

I re-configured the 3200 and see no errors. Here is the Bundle information from the DS3 side. On a side note...I am able to lock the circuit and perform a loopback test which results in no errors. Unfortunately, the Adtran device is out of warranty and I don't know where I can obtain an updated firmware package.

counters for the last five minutes

    Bytes Rx                 288391    Bytes Tx                 283941

    Packets Rx                   12    Packets Tx                 2653

    Err Packets Rx                0

    Up/Down States                0

########################################

Test Type:        BERT   Status:            LOCKED   Pattern:            QRW

Locked Seconds:    121   Pattern Loss Count:        0   Bit Error Count:      0

Configured Time:      0 minute

Elapsed Time:         2 min.  1 sec.

[Anonymous]

Are you trying to PPP on the DS3 itself, or have you configured a T1 channel inside the DS3 for this?

Would you mind posting configurations for both sides of the link?  I'd be more than happy to take a look.

[f1x0r4t3d]

Here is how the DS3 side is configured. It is a Channelized T3 connection where the T1 is configured as a bundle for an individual site.

interface  ethernet 1

    speed 100 full_duplex

    ip  address 11.205.205.205 255.255.255.0

    ip  multicast ospfrip2

    icmp

      exit icmp

    qos

      exit qos

    vrrp_mode 0

    aaa

      exit aaa

    exit ethernet

######

interface  bundle TEST

    link  ct3 1 18

    encapsulation ppp

    ppp mru 64-1518-4500

    ip  unnumbered ethernet1

    ip  multicast ospfrip2

    red

      exit red

    icmp

      exit icmp

    qos

      exit qos

    aaa

      exit aaa

    exit bundle

[f1x0r4t3d]

Here is the ADTRAN config.

! ADTRAN, Inc. OS version 17.05.01.00.E

! Boot ROM version 17.02.01.00

! Platform: NetVanta 3200, part number xxxxxx

! Serial number XXXXX

!

!

hostname "Router"

no enable password

!

clock timezone GMT-Dublin

!

ip subnet-zero

ip classless

ip routing

!

auto-config

!

event-history on

no logging forwarding

no logging email

!

no service password-encryption

!

username "admin" password "password"

!

!

no ip firewall alg msn

no ip firewall alg mszone

no ip firewall alg h323

!

no dot11ap access-point-control

!

interface eth 0/1

  ip address  11.205.205.5  255.255.255.0

  no shutdown

!

interface t1 1/1

  tdm-group 1 timeslots 1-24 speed 64

  no shutdown

!

interface ppp 1

  ip unnumbered eth 0/1

  no shutdown

  cross-connect 1 t1 1/1 1 ppp 1

!

!

ip route 0.0.0.0 0.0.0.0 ppp 1

!

no ip tftp server

no ip tftp server overwrite

ip http server

no ip http secure-server

no ip snmp agent

no ip ftp server

no ip scp server

no ip sntp server

!

!

no snmp-server enable traps

!

!

!

!

line con 0

  no login

!

line telnet 0 4

  login

  no shutdown

line ssh 0 4

  login local-userlist

  no shutdown

!

!

end

[f1x0r4t3d]

Here are the route tables for both the DS3 and the Adtran.

DS3 ROUTE TABLE:

Codes: C - connected, S - static, O - OSPF, R - RIP, B - BGP, A - Aggregate,

       D - directly connected, OA - OSPF intra area, IA - OSPF inter area,

       N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2,

       E1 - OSPF external type 1, E2 - OSPF external type 2, X - Redirect

IP Load balancing policy is per_flow

     Network            Next Hop        Interface    PVC# Distance   Metric

     -------            --------        ----------------- --------   ------

S  D 0.0.0.0/0          11.205.205.205  ethernet1         1          0

C    11.205.205.0/24    11.205.205.205  ethernet1         0          0

C    11.205.205.5/32    11.205.205.205  dalssc4           0          0

###################################################

ADTRAN ROUTE TABLE

S 0.0.0.0/0 [1/0] via 0.0.0.0, ppp 1

C 11.205.205.0/24 is directly connected, eth 0/1

C 11.205.205.205/32 is directly connected, ppp 1

[Anonymous]

On the Adtran side of things, the PPP interface configuration appears to me to be correct.

What is the other side - is that a Juniper router?  Have you verified that the Juniper configuration is correct?  It appears that you are still attempting to multilink PPP.  Is multilink necessary for your configuration?

You may also want to check the PPP MRU values on each endpoint.  I believe the Adtran default MRU is 1520.

I did a quick search online for Juniper DS3 to DS1 PPP configuration.  Here is what I found.  Can you or have you tried a configuration like this? (obviously changing certain parameters to meet your config criteria)

t1-2/0/1:20 {

encapsulation ppp;

unit 0 {

family inet {

address 10.0.4.40/32 {

destination 10.0.4.41;

[f1x0r4t3d]

Sorry for the late response. I contacted Adtran support and had one of their engineers troubleshoot the configuration live but they were unable to get it to work either. I am still waiting to hear something back as to what to try next.

[jayh]

There doesn't seem to be any problem with the layer 2 configuration or operation. There is some vendor gear that only does multilink on ppp so seeing a "bundle" of one isn't all that unusual. 

It looks like a routing issue to me.

Your unnumbered configuration has both sides referencing the same subnet of 11.205.205.0/24. Because your default route points to the interface which is on the same subnet as the local Ethernet, traffic will try to stay local.

If you must use ppp unnumbered, change one Ethernet subnet to something other than 11.205.205.0/24. Or use a numbered /31 (or /30 if the other side doesn't handle /31) for the ppp link. In any event having the same subnet on the Ethernet on both sides of the link is most likely your issue.

By the way, unless this is a US Department of Defense military network, 11.0.0.0/8 probably isn't your best choice. See RFC1918.

speedy:~ jay$ whois 11.205.205.0

NetRange:       11.0.0.0 - 11.255.255.255

CIDR:           11.0.0.0/8

NetName:        DODIIS

NetHandle:      NET-11-0-0-0-1

Parent:          ()

NetType:        Direct Allocation

OriginAS:

Organization:   DoD Network Information Center (DNIC)

RegDate:        1984-01-19

Updated:        2007-08-22

Ref:            http://whois.arin.net/rest/net/NET-11-0-0-0-1

[f1x0r4t3d]

Jayh,

I agree that it seems to be a routing issue. The IP's are different from the actual IP's used since I posted the config on the forum (I changed them before posting). I will try changing the subnet later today to see if that makes a difference but the IP's used were tested with a different client side router and the router could ping the DS3 and access the internet. The Adtran devices are the only ones that do not work. Basically, changing out the client side router causes routing to fail when using the same circuit, bundle configuration on the DS3 and IP addressing scheme. Here is the response I got from the Adtran engineer.

"All I can think of is a firmware upgrade and trying to use IRB for the PPP.  The protocol reject messages we were seeing the the PPP negotiation don't make alot of sense, since we see them after the LCP and IPCP are already up, but there is no way to capture more on those messages. I'm really curious if there is something additional in the PPP that the DS3 concentrator is trying to do."

Thanks

[jayh]

f1x0r4t3d wrote:

I agree that it seems to be a routing issue. The IP's are different from the actual IP's used since I posted the config on the forum (I changed them before posting). I will try changing the subnet later today to see if that makes a difference but the IP's used were tested with a different client side router and the router could ping the DS3 and access the internet.

If you have the same subnet on both sides of the unnumbered link, I would not expect routing to work. If it worked with another vendor's gear, it may have been an anomaly. To route effectively, the subnets to and from which you are routing should be different. I'm not a big fan of unnumbered serial links but that isn't likely to be your problem.

If you can't assign a different subnets to the two Ethernets, bridging would be the logical option, although friends don't let friends bridge networks.