LNS switching - Open 14 Aug 2012 17:00:00
Details
14 Aug 2012 15:10:30

We have not done an LNS switch for some time, and it is usually a routine thing when we do s/w upgrades so not even posted on planned works. However, after the issues with a BT fibre yesterday resulted in some unexpected effects, we are planning some updates.

As some of you will know, the same effect, only lasting a few minutes, happened today as well. This was caused by a minor configuration change, and was unexpected.

It seems that we have found what triggers these problems. We need to investigate in more detail, and we will be doing tests on the test LNS. When we have a proper fix we will update the live LNSs. In the mean time we will avoid the config change that caused this.

However, right now, one of the LNSs is "stuck' in this broken state. It is only affecting some lines, and they have been moved to another LNS already. We will however be clearing the remaining lines (around 10% of customers) this evening. We can then restart the LNS in the morning and be back to normal.

The effect will be a PPP restart and should only be a few seconds downtime for those affected (but depends on your router).

Update
14 Aug 2012 17:06:36

It looks like we managed to rectify the problem without clearing lines off the LNS or restarting it. This provides more clues as to the cause. Thank you for your patience.

Update
14 Aug 2012 17:32:09

We are doing a few other upgrades before 6pm though, but they should not have any noticable impact.

Started 14 Aug 2012 17:00:00
Previously expected 14 Aug 2012 18:00:00