Outbound calls occasionally receive fast busy signal - Please give any suggestions

[spza]

I recently began working for a small family-run business where the Network admin had left abruptly, and I inherited his mess. Throughout the quest to fix the problems he left for me, there has been one issue that remains unsolved, and that is that all polycom 706 phones on the network will get a fast busy signal when dialing to an outbound line about 15% of the time. So while most calls go through, for no real obvious reason some won't. I have researched this extensively and tried everything from increasing the timeout for the UDP ports, to forcing the phones to register before making an outbound call.

I have rebooted the 7100 many times, and next I will be upgrading the firmware to the latest extended release version available. However I am being told that will not fix the problem (even though nobody can tell me what will).

Has anyone encountered this before? Is there any advice anyone has for me in this situation? If someone really wants to dive into my config I will oblige, but I do not want to create large amounts of work for anyone, I was hoping that someone ran into this in the past and could steer me in the right direction.

Many thanks,

Jon

[spza]

I updated the latest firmware this afternoon, but the issue still exists. I had a period of about 15 minutes with no incoming/outgoing phone calls to try and find any pattern to when the outgoing calls fail, but nothing, It could be the first try, it could be the 5th try that fails, it could fail twice in a row, it could connect 6 times in a row (rare).

There is no record of the calls that fail. When I look at the call activity it only shows the calls that connected.

Here is the config:

Here is the config:

!

!

! ADTRAN, Inc. OS version R11.10.7.HA.E

! Boot ROM version A2.06.B1

! Platform: NetVanta 7100, part number 1200796E1

! Serial number

!

!

hostname "LandisLogisticNV7100"

enable password encrypted

!

!

clock timezone -5-Eastern-Time

!

ip subnet-zero

ip classless

ip routing

ipv6 unicast-routing

domain-name "specialai.com"

domain-proxy

name-server 10.x.x.x.x.x.x.x.x

!

!

no auto-config

!

event-history on

no logging forwarding

logging email on

logging email receiver-ip XXXt.exch0XX.serverdata.net auth-username XXXXX@landislogistics.com auth-password encrypted

logging email sender nv7100@landislogistics.com

!

!

no service password-encryption

!

portal-list "PHONES" ftp

!

username "polycomftp" portal-list "PHONES" password encrypted "3d35869bbb5d966d0231b48a8a1f24e4a871"

username "jsindall" password "XXXXXXXX"

username "Adtran001" password "XXXXXXX"

username "jspang" password "XXXXXXX"

!

!

no ip firewall alg msn

no ip firewall alg mszone

no ip firewall alg h323

!

!

!

!

!

!

!

!

!

!

!

no dot11ap access-point-control

!

!

!

!

!

!

!

ip dhcp database local

ip dhcp excluded-address 10.10.20.250 10.10.20.254

!

ip dhcp pool "VLAN2"

  network 10.10.20.0 255.255.255.0

  dns-server 10.x.x.x

  default-router 10.10.20.1

  tftp-server 10.10.20.1

  ntp-server 10.1.10.11

!

!

!

!

!

!

!

!

!

!

qos queue-type strict-priority

!

!

!

!

vlan 1

  name "Default"

!

vlan 2

  name "VoIP"

!

!

interface eth 0/0

  no ip address

  shutdown

  no lldp send-and-receive

!

!

interface eth 0/1

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/2

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/3

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/4

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/5

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/6

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/7

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/8

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/9

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/10

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/11

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/12

  spanning-tree edgeport

  no shutdown

  switchport access vlan 2

!

!

interface eth 0/13

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/14

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/15

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/16

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/17

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/18

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/19

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/20

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/21

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/22

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/23

  spanning-tree edgeport

  no shutdown

!

!

interface eth 0/24

  spanning-tree edgeport

  no shutdown

!

!

!

interface gigabit-eth 0/1

  description DATA UPLINK

  no shutdown

!

!

interface gigabit-eth 0/2

  description UPLINK to 1234

  no shutdown

  switchport mode trunk

!

!

!

!

interface vlan 1

  ip address 10.1.10.3 255.255.255.0

  media-gateway ip primary

  no shutdown

!

interface vlan 2

  ip address 10.10.20.1 255.255.255.0

  media-gateway ip primary

  no shutdown

!

!

interface fxs 0/1

  no shutdown

!

interface fxs 0/2

  no shutdown

!

!

interface fxo 0/1

  impedance z4

  tx-gain +3.0

  no shutdown

!

interface fxo 0/2

  tx-gain +3.0

  no shutdown

!

interface fxo 1/1

  impedance z4

  tx-gain +3.0

  no shutdown

!

interface fxo 1/2

  tx-gain +3.0

  no shutdown

!

interface fxo 1/3

  tx-gain +3.0

  no shutdown

!

interface fxo 1/4

  no shutdown

!

isdn-number-template 0 prefix "" subscriber 911

isdn-number-template 1 prefix "" subscriber NXX-XXXX

isdn-number-template 2 prefix "" national NXX-NXX-XXXX

isdn-number-template 3 prefix 011 international X$

isdn-number-template 4 prefix "" unknown NXX

isdn-number-template 5 prefix "" unknown NXXX

isdn-number-template 6 prefix 1 national NXX-NXX-XXXX

!

!

!

!

!

!

!

!

!

!

ip route 0.0.0.0 0.0.0.0 10.1.10.1

ip route 192.168.128.0 255.255.255.0 10.1.10.1

!

tftp server

tftp server overwrite

http server

http secure-server XXXX

no snmp agent

ip ftp server

ip ftp server default-filesystem cflash

no ip scp server

ip sntp server

ip sntp server send-unsynced

!

!

!

!

!

!

!

auto-link

auto-link server primary ats3.adtran.com

auto-link recontact-interval 86400

!

!

sip

sip udp 5060

sip tcp 5060

!

!

!

voice overhead-paging extension 800

!

!

!

!

!

!

!

!

!

!

!

voice dial-plan 1 always-permitted 9-911

voice dial-plan 2 internal-operator 0

voice dial-plan 3 extensions MXX

voice dial-plan 4 local 9NXX-NXX-XXXX

voice dial-plan 5 long-distance 9-1-NXX-NXX-XXXX

voice dial-plan 6 toll-free 9-1-800-NXX-XXXX

voice dial-plan 7 toll-free 9-1-888-NXX-XXXX

voice dial-plan 8 toll-free 9-1-877-NXX-XXXX

voice dial-plan 9 toll-free 9-1-866-NXX-XXXX

voice dial-plan 10 operator-assisted 9-0-NXX-NXX-XXXX

voice dial-plan 11 international 9-011-$

voice dial-plan 12 900-number 9-1-900-NXX-XXXX

voice dial-plan 13 900-number 9-1-976-NXX-XXXX

voice dial-plan 14 900-number 9-976-XXXX

!

!

voice email-list emergency

  description "911 call was sent"

  sender XXXX@landislogistics.com

  address XXXX@landislogistics.com

!

voice speed-dial 1 918XXXXx VeraCore

voice speed-dial 2 914XXXXX Rob Cell

voice speed-dial 3 917XXXXXX Jason Cell

voice speed-dial 4 914XXXXX Jen Cell

voice speed-dial 5 91XXXXXX DORMIFY

!

!

voice class-of-service normal_users

  override-passcode 6789

  default-level

  aa-dnd

  block-caller-id

  call-privilege extensions

  call-privilege local

  call-privilege long-distance

  call-privilege operator-assisted

  call-privilege specify-carrier

  call-privilege toll-free

  camp-on

  disable-callwaiting

  dnd

  door-phone

  external-fwd

  forward

  hold

  hotel

  logout-group

  message-waiting

  overhead-paging

  park

  pickup

  program-user-speed

  redial

  remote-fwd

  retrieve-park

  return-last-call

  station-lock

  system-speed

  transfer

  user-speed

  deny-template 911

!

voice class-of-service public_phones

  override-passcode 1234

  call-privilege extensions

  call-privilege local

  call-privilege toll-free

  hold

  overhead-paging

  park

  retrieve-park

  transfer

!

voice class-of-service executive_users

  aa-dnd

  aa-initiate-permit $

  block-caller-id

  call-privilege extensions

  call-privilege international

  call-privilege local

  call-privilege long-distance

  call-privilege operator-assisted

  call-privilege specify-carrier

  call-privilege toll-free

  camp-on

  disable-callwaiting

  dnd

  door-phone

  external-fwd

  forward

  hold

  hotel

  logout-group

  message-waiting

  overhead-paging

  park

  pickup

  program-user-speed

  redial

  remote-fwd

  retrieve-park

  return-last-call

  station-lock

  system-mode

  system-speed

  transfer

  unlock-door

  user-speed

!

voice class-of-service "door phone"

  call-privilege extensions

!

voice codec-list g711_first

  default

  codec g711ulaw

  codec g729

!

!

!

voice trunk T01 type analog supervision loop-start

  description "ANALOG"

  no reject-external

  caller-id

  trunk-number 500

  connect fxo 0/1

  connect fxo 0/2

  connect fxo 1/1

  connect fxo 1/2

  connect fxo 1/3

  connect fxo 1/4

  rtp delay-mode adaptive

!

!

voice grouped-trunk ANALOG_FXO_TRUNKS

  trunk T01

  accept NXX-XXXX cost 0

  accept 1-NXX-NXX-XXXX cost 0

  accept 1-800-NXX-XXXX cost 0

  accept 1-888-NXX-XXXX cost 0

  accept 1-877-NXX-XXXX cost 0

  accept 1-866-NXX-XXXX cost 0

  accept 1-855-NXX-XXXX cost 0

  accept 011-$ cost 0

  accept 411 cost 0

  accept 611 cost 0

  accept 911 cost 0

  accept NXX-NXX-XXXX cost 0

  reject 976-XXXX

  reject 1-900-NXX-XXXX

  reject 1-976-NXX-XXXX

  reject NXX-976-XXXX

  reject 1-NXX-976-XXXX

!

voice autoattendant "CS_AA" extension 501

  entry-filename "aa501.xml"

!

voice autoattendant "DefaultAA" extension 8200

  entry-filename "defaultAA.xml"

!

!

voice autoattendant "MAIN_AA" extension 500

  entry-filename "aa500.xml"

!

voice directory "SYSTEM"

  description "The system directory"

!

voice coverage go_to_voicemail

  default

  coverage vm

!

!

voice mail extension 850

!

voice mail leave-extension 854

!

voice mail max-login-attempts 3

!

!

voice mail class-of-service normal_voicemail

  default-level

  prompt-delete

!

!

voice mail class-of-service executive_voicemail

  greeting-length-max 120

  greeting-quota 5

  message-length-max 600

  message-quota 30

  prompt-delete

!

!

!

voice ring-option "System Default"

  description "System default ring option"

  ring-type immediate

!

!

!

!

!

voice music-on-hold mode internal

!

!

voice music-on-hold player System

  default

  file 5 JazzClub.wav

  file 10 DancingAtBalajo.wav

  file 15 FourInABar.wav

  file 20 ALittleNightMusic.wav

  file 25 LightOfDay.wav

  file 30 ThereAndBack.wav

!

!

!

no sip authenticate

!

!

!

sip registrar

!

!

!

!

!

!

!

!

!

!

!

ip rtp quality-monitoring

ip rtp quality-monitoring sip

!

line con 0

  login

  password encrypted

!

line telnet 0 4

  login local-userlist

  shutdown

line ssh 0 4

  login local-userlist

  no shutdown

!

sntp server 0.north-america.pool.ntp.org

!

!

!

!

!

!

end

[Anonymous]

are you able to replicate the problem?  If so then go into cli and issue commands:

debug sip stack messages

debug sip cldu

debug voice verbose

debug interface fxo

if you are not able to replicate and it is random, then you can do persistant debug logging, see here on how to do that:

Enabling Persistent Debug Logging

-Mark

[spza · Accepted solution]

Hi Mark,

God bless you for offering help. Coincidentally I ended up researching the configurations for the 7100, and came to the conclusion that everything was correct.

I called the carrier, and low and behold, after speaking to 5 different techs, they resolved the problem behind the scenes.

Massive struggle, but sometimes that is how it goes.

Thanks,

Jon

[spza]

long story short, there was a nationwide outage for landline phones for comcast business customers, and when they were resolving it they "inadvertantly" reset, and removed configurations for lines that were previously configured. Also, another fun fact, if you have analog lines, and they "threw in" voicemail on all the lines, and you never knew about it or used it, and over time there were enough opportunities to have someone leave a voicemail on that line (outages, trunks full, carrier screws all your settings up, etc) and once the mailbox fills you cannot dial out on it any longer.

Hope this helps someone.

[Anonymous]

Jon,

Thanks for the update and info for letting others know of the problem. I did not know about the voicemail full stopping calls. That is crazy. 

-Mark

[spza]

Mark,

You are telling me. They said that because of the full voicemail, they had to run a signal cleaner on each line. This made absolutely no sense to me. But low and behold the dB level for those two trunks returned to 22 and 23 instead of z4? and no more reorder tone. If we would have not been able to get calls on the two trunks as well then it would have been really easy to say "Hey these two lines are the problem". Instead I had to research it intensely to get enough knowledge to be able to say "I know it is these two trunks, and even though we can receive calls, we cannot make calls on them....fix it". 

Anyways, I have a new appreciation for the adtran 7100 at least, and can administrate over it properly now. So there is always silver lining.

Thanks,

Jon