Order posts by limited to posts

Currently Open Posts

Email and Web Disk Storage Maintenance - Open 5 Mar 21:00:00
Details
5 Mar 13:49:51

Please see http://status.aa.net.uk/1750 for information regarding planned work that will affect web hosting on the evening of March 7th.

Started 5 Mar 21:00:00

Maidenhead Core Switch Upgrade Sunday 10th Feb - Open 10 Feb 13:00:00
Details
15 Jan 14:19:37

We will be performing a swap of the core network switches in our Maidenhead datacentre on the afternoon of Sunday 10th February.

The work is expected to take up to half an hour, during which there will be periods of time when service is affected.

The affected services will be:

Email, both incoming and outgoing
VoIP calls
Ethernet services terminated in Maidenhead
Web page hosting
Control panel and Billing system access
Customer hosted servers

General internet connectivity over DSL and Ethernet terminated in London will be unaffected by this work.

This staus page will be updated during the work.

Update
10 Feb 12:25:39

This work will be done a little earlier than initially scheduled. The work will take place between 12:30pm and 2pm, but actual outage is only expected to be a couple of minutes.

Started 10 Feb 13:00:00

At Risk - Carrier Transit Work - Open 15 Jun 2012 00:01:00
Details
14 Jun 2012 17:54:03

One of our carriers that provide us connectivity in Maidenhead have planned (short notice) maintenance on parts of their network that provide us connectivity.

This will happen between midnight and 2pm.

We are not expecting this to impact customers, but is to be considered 'at-risk'.

Started 15 Jun 2012 00:01:00 by Datacentre

Database Server Maintenance - Open 01 Jun 2012 17:00:00
Details
01 Jun 2012 13:29:22

We'll be rebooting one of our database servers shortly after 5pm today. This is to replace a faulty disk drive. 

There will be a period of a few minutes where some usage/logs won't be viewable from our control pages.

Update
01 Jun 2012 17:09:52

This is happening now, it should take about 10 minutes.

Update
01 Jun 2012 17:12:52

The server has booted up ok.

Started 01 Jun 2012 17:00:00

IPv6 changes - Open 21 Apr 2012 12:00:00
Details
21 Apr 2012 13:55:09

Apologies for some minor distruption with IPv6 today in relation to services we run in the Maidenhead Data Centre. There have been a few minutes during today where routing has not been quite right for IPv6 for some of the services.

We have renumbered our office on to a separate /48 to improve native IPv6 routing. (A /48 is visible to more of the Internet).

Over the next few days or weeks we will be renumbering services in the data centre from 2001:8b0::/48 to 2001:8b0:1::/48 addresses. Thanks to a customer (Lawrence) for allowing us to change is allocation to free that up.

If you want to trust an IPv6 as being from A&A infrastructure you should be able to trust 2001:8b0::/47 as this includes the /48 was have in London and the /48 we have in Maidenhead and our offices.

At present there may be a handful of machines which are not technically A&A infrastructure within this space that will be renumbered this week as well. A&A infrastructure should have reverse DNS under aa.net.uk as well.

We aim to parallel run the old and new IPv6 during DNS changes so that there are no issues with any services. If anyone has any issues please contact support.

We are not planning any IPv4 changes.

Note, customers that have IPv6 on fibre from Maidenhead can now request a /48 if you need, routed via your existing /64 link.

Started 21 Apr 2012 12:00:00
Previously expected 01 May 2012

All Maidenhead Data Centre Planned Engineering Work Posts

Maidenhead transit planned work - Completed 31 May 2012 10:19:05
Details
25 May 2012 08:59:04

Pulsant are carrying out work on transit in Maidenhead.

This work will affect all services we host in Maidenhead, such as email, web and VOIP.

The work is scheduled for between:

23:00 30/05/2012 and 04:00 31/05/2012

A 10 minute disruption to service is expected.

Started 30 May 2012 23:00:00 by Datacentre
Previously expected 31 May 2012 04:00:00
Closed 31 May 2012 10:19:05

Email and Web Server Disk Storage Change - Completed 29 Mar 2012 20:12:03
Details
22 Mar 2012 16:35:18

Email and web servers will have about 30 minutes of down time as we move the file server that they use.

During this time access to email and web pages will not be available.

Date: Thursday 29th
Starting time: 8pm
Reason: Moving to secondary file server to allow for software updates 

Update
29 Mar 2012 19:52:27

This work will be starting shortly.

Update
29 Mar 2012 20:00:33

Web and incoming email (pop3/imap) servers will be offline for about 30 minutes form now.

Update
29 Mar 2012 20:08:51

Our webserver is now back online.

Update
29 Mar 2012 20:11:29

Email services are back up now.

Started 29 Mar 2012 20:00:00 by AAISP Staff
Previously expected 29 Mar 2012 21:00:00
Closed
29 Mar 2012 20:12:03

The move has been completed as planned, services were restored within about 11 minutes.


UPS Work (No user impact) - Completed 16 Jan 2012 23:59:00
Details
09 Jan 2012 12:32:21

We have been informed by the Maidenhead datacentre that they have some planned work on their UPS systems.

 

They will be carrying out a replacement exercise on end-of-life capacitors in the UPS.

The unit will be taken off-line for the duration of the work however due to the configuration of the installation there will be no impact to the electrical supply or resilience to equipment 

 

The work will be carried out on Monday 16th January, starting at 21:00 and should last 5 hours.

This work is factory advised and forms part of their robust Planned and Preventative maintenance regime. 

Started 16 Jan 2012 21:00:00
Closed 16 Jan 2012 23:59:00

Server Moving - Not Customer Affecting - Completed 19 Jan 2012 13:00:00
Details
18 Jan 2012 14:48:38

We'll be moving some servers around between racks in the Maidenhead datacentre on 19th January. These servers are mainly related to email services, but we are not expecting customers to notice anyting whilst the moves take place.

The servers moving will be:

tertiary-mx.co.uk (the backup email relay)
A couple of the Spam checking servers (there are many, so one being down at a time won't cause a problem)
One of the outgoing SMTP servers (which is offline at the moment)

Started 19 Jan 2012 11:00:00
Closed
19 Jan 2012 13:00:00

This work has been completed.


Email and Web Server Work - Completed 20 Nov 2011 11:29:06
Details
17 Nov 2011 16:09:45

On Sunday morning we'll be moving over the storage server that the email and web services use. The work should take less than 30 minutes, but as the work is carried out access to email and web sites will be unavailable.

We aim to make this move as quickly as possible.

Update
20 Nov 2011 11:01:03

FTP & RSYNC access to our web server has been stopped. 

The work of moving over the storage servers will begin shortly. We anticipate this to take less than 30 minutes.

Update
20 Nov 2011 11:04:20

The Work is starting now, access to websites we host and email will be unavailable whilst this is carried out.

 

Update
20 Nov 2011 11:23:16

Web pages are now being served again.

Update
20 Nov 2011 11:24:28

Email is back up

Update
20 Nov 2011 11:28:02

FTP and rsync access to our web server is now running.

Update
20 Nov 2011 11:30:38

This work is almost complete, customers should be back on email and their web pages being served again.

 

Started 20 Nov 2011 11:00:00
Previously expected 20 Nov 2011 12:00:00
Closed 20 Nov 2011 11:29:06

Moving Servers - Legacy Email, Primary DNS, Wiki - Completed 23 Sep 2011 15:50:12
Details
07 Jun 2011 09:54:26

We'll be moving a couple of servers between datacentres. Their IP addresses will not be changing, it's just a physical move.

The servers are:

A.Hopeless - One of our legacy email servers
-Access to receiving email during this time will not be possible.

Primary-dns.co.uk -  One of our internet facing DNS resolvers
We don't anticipate that service will be affected as the secondary DNS server will be available.

Customer Wiki
Access to wiki.aaisp.org.uk will be unavailable during this time

A couple of other internal use servers will be moved at the same time.

Start Time: 17:30
Duration: 1 hour 

Update
10 Jun 2011 18:15:40

This work is nearly complete - just waiting for various email services to start up.

Started 10 Jun 2011 17:30:00 by AAISP Staff
Closed 23 Sep 2011 15:50:12

At risk - router upgrade - Completed 19 Jul 2011 17:38:58
Details
19 Jul 2011 17:25:55

We are again upgrading a router this evening - it should have little or not impact as the system should fall back to the secondary router. There is, as always, a risk.

These upgrades, when complete on both routers (not both done together!) will mean faster fallback in the event of a failure in future as we are upgrading to support VRRP3 with sub second timing.

Update
19 Jul 2011 17:34:25

Arrrg, why is this never simple.

Update
19 Jul 2011 17:39:06

Abandoned for now - maybe later.

Update
19 Jul 2011 18:17:34

All sorted

Started 19 Jul 2011 17:30:00
Previously expected 19 Jul 2011 17:35:00
Closed 19 Jul 2011 17:38:58

Router upgrade (short notice) - Completed 17 Jul 2011 19:08:56
Details
17 Jul 2011 18:45:47

We will be upgrading one of the main routers this evening to latest release. Sorry for short notice. As usual this hsould have little or no impact on services.

Update
17 Jul 2011 19:05:24

Not playing the game quite - so may have a few seconds disruption...

Update
17 Jul 2011 19:09:04

Completed

Started 17 Jul 2011 19:00:00
Previously expected 17 Jul 2011 19:05:00
Closed 17 Jul 2011 19:08:56

Scheduled Power Systems Maintenance 10 March Evening - Completed 10 Mar 2011 23:00:00
Details
09 Mar 2011 11:02:56

Please be aware that testing of the redundant power ATS (Automatic Transfer Switch) equipment at the maidenhead datacentre bill be carried out on Thursday 10th March at 19:00 and conclude by 23:00 on the same day.

Whilst the work taking place is non-intrusive and power redundancy will still be available at all times, customers should treat this as an at risk period.

Started 10 Mar 2011 19:00:00 by Datacentre
Closed 10 Mar 2011 23:00:00

Urgent router maintenance - Completed 11 Mar 2011 17:04:54
Details
11 Mar 2011 16:31:37

We are expecting to do some work on routers in Maidenhead. This should have minimal impact as we can work on one at a time.

Sorry for the very short notice.

Update
11 Mar 2011 17:28:54

We are actually doing another restart now.

Started 11 Mar 2011 17:00:00
Closed 11 Mar 2011 17:04:54

Web Server Disk Storage Work - Completed 30 Jan 2011 22:54:32
Details
26 Jan 2011 11:08:57

We will be doing some work on the storage servers that are used by our  Web Server on Sunday. This will mean a couple of hours where FTP and RSYNC access will be disabled.

Update
30 Jan 2011 21:26:13

This work is currently being started. FTP and rsync access to our webserver will be unavalable for the next couple of hours.

Previously expected 30 Jan 2011 23:00:00 (Last Estimated Resolution Time from AAISP)
Closed
30 Jan 2011 22:54:32

This work has been completed. The webserver is now using new storage severs.

Please report any problems to support.


Router restart - at risk - Completed 11 Oct 2010 17:11:51
Details
11 Oct 2010 11:52:45

We are restarting one of the routers in Maidenhead this evening. It should be seamless in terms of routing though we have seen blips on IPv6 when doing this in the past so there is a risk of disruption for a few seconds.

Maindenhead handles ethernet customers, our offices, and access to many of our servers including VoIP for call set up and recorded calls.

Closed 11 Oct 2010 17:11:51

Switch Reboot - Completed 02 Mar 2010 19:10:00
Details
02 Mar 2010 19:05:36

We are just about to reboot a switch in our Maidenhead datacentre. This will affect a few hosted customer servers and some AAISP servers. It's expected to only mean a few minutes of downtime. Sorry for the short notice.

Started 02 Mar 2010 19:06:07
Previously expected 02 Mar 2010 19:10:00
Closed 02 Mar 2010 19:10:00