Hosting365 Status

Type:         Scheduled  Maintenance
Impact:      Ticketing System Unavialable
Services impacted:    Customer Portal and Ticket Respnse

Window Start     21st February 2010 22:00
Window End      22nd February 2009 08:00
Maintenance duration:    10 Hours

Please do not reply to this email any questions or queries should be referred to our NOC on the following:
By email:     noc@hosting365.com
By Phone:     01 467 3640

Additional Information:

Dear Customer,

Please be advised that Hosting 365 will be carrying out a major software upgrade to our Ticketing system. During this time we will be unavailable to respond to tickets and the customer ticketing portal will also be unavailable - if your request is urgent please call our Operations team on 01 467 3640.

Thankyou for your patience during this process

Engineers are onsite investigating the cause and extent.

Update: 1745: There appears to have been a major failure of the primary carrier in Dublin 17, and the failover to secondary routes is incomplete (currently some INEX peered routes appear to be working ok).

Update: 1815: Engineers are continuing to work on the issue. It appears there is an issue with routing to the Dublin 17 AS via Smart Telecom, and issues with the other carriers filtering the routes out. Smart are reporting a major problem on the T50 fiber ring, which is also impacting their ability to resolve this issue. Many INEX peered routes are working fine, and are unaffected by the higher level filters in place. We continue to work to resolve this serious issue and will post regular updates.

Update: 1845: All services have been restored. A full RFO and report will be provided to all effected customers. We apologise for any impact this incident may have caused.

We will be carrying a change to our INEX peering on Thursday 26th November at 17:30.  This change will be transparent to our customers and will improve the way we manage our peering arrangements with other INEX members.

We have received the following Maintenance Notification from one of our carriers - we are not expecting any impact during this maintenance - However in the event of this carrier failing all routes will be propogated via the alternative carriers on our network.

At-Risk Maintenance Notification

Type: At Risk Maintenance: DUBLIN
Provider: PacketExchange
Impact: None expected
Services At Risk: Dublin Metro Network

Window #1:
START: 22rd June 2009 23:00 hrs IST
END: 23rd June 2009 07:30 hrs IST

Window #2:
START: 24th June 2009 23:00 hrs IST
END: 25th June 2009 07:30 hrs IST

Fallback: Commencing 29th June 2009 (same times)

Information:
Dear Customer,

PacketExchange will be performing capacity upgrades to our Dublin WDM metro network. No impact is expected during the maintenance, as service will be routed via the protected path.

Type:         Emergency  Maintenance
Impact:      INEX LAN 1 Peering will be impacted for the duration, LAN 2 peering and upstream carriers will be unaffected.
Services impacted:    Network connectivity.

No customer services should be impacted by this work.

Window Start     1600 GMT - Tue 17th Feb
Windows Finish  1615 GMT - WORK COMPLETE

Maintenance duration:    0.25 Hours

Please do not reply to this email any questions or queries should be referred to our NOC on the following:
By email:     noc@hosting365.com
By Phone:     01 467 3640

Additional Information:

Dear Customer,

Please be advised that Hosting 365 are planning to carry out emergency maintenance one of our resilient INEX connections to the edge network device at the time stated above.We have been experiencing higher than usual latency on the LAN 1 INEX Peers and need to take the connections offline in order to re-introduce peers and diagnose the problem fully.

This maintenance carries minimal risk to the network service as INEX Lan 2 peering and all other uplinks remain unaffected. There may be a brief period of latency while routes stabilise.

We sincerely apologies for any inconvenience this may cause.

Type:         Single Carrier Outage
Impact:      No service disruption.
Services impacted:    Network connectivity.

Issue Start     16th February 2009 1700 GMT

Issue Stop     16th February 2009 1718 GMT

Please do not reply to this email any questions or queries should be referred to our NOC on the following:
By email:     noc@hosting365.com
By Phone:     01 467 3640

Additional Information:

Dear Customer,

Please be advised that we are seeing a complete outage of upstream routes from EUnetworks, one of the carriers on our meshed network. Customers may have noticed increased latency while routes corrected, otherwise there is no customer impact.

EU are back up, routing returning to normal , optimised paths.

Type:         Scheduled  Maintenance
Impact:      No service disruption expected.
Services impacted:    Network connectivity.

No customer services will be impacted by this routine maintenance.

Some customers using Layer 2 connections via e-Net / DEG will experience some impact, and have been directly notified.

Window Start     17th February 2009 06:00 GMT
Window End      17th February 2009 08:30 GMT
Maintenance duration:    2.5 Hours

Please do not reply to this email any questions or queries should be referred to our NOC on the following:
By email:     noc@hosting365.com
By Phone:     01 467 3640

Additional Information:

Dear Customer,

Please be advised that Hosting 365 are planning to carry out maintenance one of our resilient INEX connections to the edge network device at the time stated above. This maintenance carries minimal risk to the network service.  This work is essential maintenance to ensure our ongoing commitment to service availability.

We sincerely apologies for any inconvenience this may cause.

We have been informed by our facility partner, at site 2, Park West, Dublin that essential emergency maintenance is underway on their power infrastructure.

The facility is currently under generator power and no services are impacted.

Customers with colocation or servers in this site should not experience any service impact while this work is ongoing.

For further detail, please contact your account manager.

UPDATE: 16:47 - We have received notification that all systems are now operating normally under utility power and any issues have been resolved, there was no impact to services.

UPDATE 1 - 00:00 Services have now started to be powered down

UPDATE 2 - 00:20 Power to PW Suite 3 will be isolated in 10 minutes

UPDATE 3 - Power down 00:30 - work on EPO removal commencing

UPDATE 4 - 00:35 UPS Board has now been isolated

UPDATE 5 - 01:35 Work is still ongoing within the UPS board time for restore still 04:00

UPDATE 6 - 02:33 EPO has now been removed from the UPS board (A thorough inspection and test will now take place)

UPDATE 7 - 03:15 The UPS board has now been stripped all connections within the board have been tested and tightened - power will now be restored to the board - however power will remain off to the racks during this test

UPDATE 8 - 03:24 Power is now restored to the racks and services will start to be brought back online.

Read the rest of this entry »