Connectivity up and down (Resolved)



AssessedAbout 4 hours ago

Summary

  • Chorus, Unison and other fibre and internet infrastructure providers are reporting rolling outages in their networks across the North Island
  • These outages are affecting customers on our network

Date \ Time

  • Started approx 3.37 PM today

Service Impact

  • Internet services and Datacenter 

Customer Impact

  • Internet services may be unavailable

Workaround

  • No work around is available

Estimated Time of Repair

  • Unknown. We must await the vendors to correct the issues

Next Update

  • Tomorrow AM

Effects - This issue does not effect your relevant products/services
Affecting Other - internet issuse
Priority - Critical
Date - 11/03/2021 17:24 - 13/08/2021 19:36
Last Updated - 11/03/2021 22:00

Emergency reboot due to software issue (Resolved)

Emergency reboot 

Wc30 Rebooted due to software issues and could be down for 20 minutes 

Back online at 9.26 pm

Cpanel are looking into the cause of the issue and updates to come

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Critical
Date - 16/11/2020 21:00 - 16/11/2020 21:20
Last Updated - 11/03/2021 21:54

Domain Registry Outage (Resolved)

2:15pm UPDATE
This issue has now been resolved

------
We are currently experiencing issues connecting with the central domain registry services. This affects purchase, updates and renewals of all .nz domains.

We are currently investingating the cause and will hopefully restore services ASAP

Effects - This issue does not effect your relevant products/services
Affecting System - .nz Domain Registry Services
Priority - Critical
Date - 06/09/2020 09:02 - 07/09/2020 00:00
Last Updated - 07/09/2020 14:23

Barracuda Black List (Resolved)

We are investigating a problem with  emal / Barracuda Black List

We are awaiting there support could take up to 48 hours to take affect

resolved  Tuesday 2.20 pm


Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Medium
Date - 30/08/2020 11:30 - 01/09/2020 02:20
Last Updated - 02/09/2020 11:19

Cpanel Wc30 (Resolved)

We are aware there is problems with WC30 Cpanel hosting Server  and our techs are onto it


updates will follow

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Critical
Date - 19/02/2020 21:03 - 19/02/2020 21:15
Last Updated - 19/02/2020 21:39

Some Sites showing Down (Resolved)



We are currently experiencing an issue with some sites not displaying . The problem is being investigate and we hope to restore full functionality again ASAP

Please drop us email at support@webconnect.nz


R
egards Team Webconnect

Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - Medium
Date - 06/08/2019 08:58 - 13/08/2019 15:32
Last Updated - 13/08/2019 11:18

Mail being blocked when sent (Resolved)

3.7.2019 8.45am

Update we have made some changes and are seeing maill flowing again 

--------------------------------------------------------------------------------------------------------------------

2.7.2019  8.13am

Customer Impact

Emails may be bounced back to sender, or directed to the recipients SPAM folder.
Alternatively please contact our Customer Support team https://www.webconnect.nz/submitticket.php?step=2&deptid=2


R
eason

Ip placed  on a black list 




Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Medium
Date - 02/07/2019 08:13 - 06/08/2019 09:58
Last Updated - 03/07/2019 09:49

WC30.webconnect.nz (Resolved)

Hazard Notice - Wc30 - 13/06/19 9.30am

 

Summary

  • Recently an exploit was announced that we received a report of a potential remote exploit from Cpanel , the server email subsystem. This could allowed malicious users unauthorised access to the email system to send SPAM.
  • This means that certain emails send via our servers may be bounced back to sender, or directed to the recipients SPAM folder. 

We are working with our vendors to mitigate this issue, and hope to restore normal services ASAP

Customer Impact












Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - High
Date - 13/06/2019 09:31 - 13/06/2019 16:05
Last Updated - 17/06/2019 12:54

Server Outage (Resolved)

One of our servers: wc10.webconnect.nz has gone offline. Our engineers are working to restore it ASAP

***UPDATE***
Issue resolved - all services are functioning correctly

Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - Critical
Date - 22/02/2018 15:53 - 22/02/2018 16:30
Last Updated - 22/02/2018 17:00

wc30.webconnect.nz (Resolved)

Wc30 failed on a backup

server restarted and looks to be working as it should



Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - High
Date - 12/02/2018 21:55 - 22/02/2018 15:54
Last Updated - 12/02/2018 22:14

server problem webmail redirected you too man (Resolved)

Wc30 webmail redirected you too many times

we are looking into this please use this link  https://wc30.webconnect.nz:2096

U
pdate will be Coming soon 




11/09/2017 12:18pm


Tonight we are scheduling a update to resolve the issues .

Cause lite speed not working correctly due to a security fix




11/092017   8.30-9.30 

updates appied and redirect fixed

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Medium
Date - 11/09/2017 10:38 - 12/09/2017 00:00
Last Updated - 12/09/2017 08:25

Heads up server in Auckalnd RELAY email (Resolved)

Heads up server in auckalnd RELAY email , Remote IP - 112.109.81.129 (NZ/New Zealand/winplesk13.openhost.net.nz)

domain coffeevending.co.nz  from user sarah@coffeevending.co.nz
has been compromised .

 

Webconnect have blocked the ip for now and open host has been advised and the will get back to us.

Effects - This issue does not effect your relevant products/services
Affecting Other - compromised server in Auckland
Priority - High
Date - 01/05/2017 14:00 - 01/05/2017 14:45
Last Updated - 05/05/2017 08:36

Degraded connectivity (Resolved)

New Incident Status: Resolved

 
Issue fixed.
Apr 24, 13:33 NZST
 
Previous Updates
Update
Unison turned up at 12pm plugged in unit and faulty , head back for replacement at 12.45pm
Apr 24, 12:49 NZST
Update
Unison is sending out tech team onsite, they will be onsite and try to fix it before 1pm.
Apr 24, 10:45 NZST
Identified
The Unison ONT for this connection has failed. We are in the process of raising a fault with Unison.

Will update in 1 hour or earlier when we get feedback from Unison on ETR
Apr 24, 09:28 NZST
Investigating
Monitoring has alerted that the primary unison path connecting the Web Connect data centre has gone offline.

Traffic has failed over automatically to the secondary Chorus path. This means there has been no loss of service to services provided from this location.

================ Date \ Time ================
- 22/03/2017 - @ 4:50am

================ Service Impact ================
- No services have been impacted. Network is in a degraded state in that only the secondary network path is operational.

================ Customer Impact ================
- There is currently no known customer impact

================ Next Update ================
- The next update will be provided in 1 hour
Apr 24, 08:31 NZST

Effects - This issue does not effect your relevant products/services
Affecting Other - primary unison path went of line
Priority - Medium
Date - 24/04/2017 22:21 - 24/04/2017 00:00
Last Updated - 28/04/2017 22:29

Congestion on one international IP Transit Pa (Resolved)

Congestion on one international IP Transit Path due to DDoS - 28/04/17 - 1:04pm - 1:38pm

 
Incident Report for New Zealand Technology Group
 
New Incident Status: Resolved
During this time window we saw much higher than expected traffic levels across one of our international IP transit paths.

Post review detailed a DDoS using UDP traffic directed to the Web Connect environment.

================ Date \ Time ================
28/04/17 - 1:04pm - 1:38pm

================ Service Impact ================
IP transit across one of our international paths saw higher than usual traffic level and some congestion during the peaks

================ Customer Impact ================
Customers connecting to some (not all) international destinations may have seen slower than normal or intermittent connectivity problems.

================ Next Update ================
As the DDoS has finished there is no further updates to provide.

We have documented the target host involved and will communicate with the customer.
Apr 28, 18:06 NZST

Effects - This issue does not effect your relevant products/services
Affecting System - DDoS
Priority - Medium
Date - 28/04/2017 22:26 - 28/04/2017 00:00
Last Updated - 28/04/2017 22:28

Mail Scanner Failed on update (Resolved)

Mail Scanner failed to restart after update


8 am  No mail was lost just Queued

9am   mail q is  releasing

9.52   Mail Queue is under high load

Effects - This issue does not effect your relevant products/services
Affecting Server - wc35
Priority - Medium
Date - 07/07/2016 06:07 - 08/07/2016 00:00
Last Updated - 24/09/2016 09:55

Upstream Network Issues (Resolved)

There is currently an issue with connectivity further upstream. Some customers may be experiencing slow connections, and those on Spark's network may not be able to reach us.

Engineers are investigating the issue

UPDATE 14:57 04/05/2016

A number of NZ IPs are affected b this issue. Engineers are working on a solution

Effects - This issue does not effect your relevant products/services
Affecting Other - Connectivity
Priority - High
Date - 04/05/2016 09:33 - 04/05/2016 16:30
Last Updated - 04/05/2016 16:29

server stop responding (Resolved)

Server stopped responding after setting up new records for emails


on and of for last 25 mins


rebooted from at 12.50 

keeping a eye on

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Critical
Date - 09/04/2016 12:27 - 04/05/2016 09:33
Last Updated - 09/04/2016 13:03

Bnca30 (Resolved)

We are aware there is problems with bnca30 and our techs are onto it


updates will follow

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - High
Date - 25/01/2016 07:34 - 31/01/2016 18:12
Last Updated - 31/01/2016 18:12

BNCA10 Outage (Resolved)

This issue has now been resolved

--------

We are currently experiencing an issue with one of our hosting servers BNCA10. The problem is being investigate and we hope to restore full functionality again ASAP

Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - Critical
Date - 18/12/2015 11:20 - 18/12/2015 11:25
Last Updated - 18/12/2015 12:19

Network Maintenance Service outage (Resolved)

Maintenance work has been scheduled by our upstream network provider which will impact all services for up to 2hrs

This is scheduled to take place on 29 October between Midnight and 4am

We apologise for any inconvenience this will cause


Regards
Web Connect Network Team

Effects - This issue does not effect your relevant products/services
Affecting Other - Upstream Connectivity
Priority - High
Date - 29/10/2015 00:00 - 18/12/2015 11:22
Last Updated - 22/10/2015 08:48

cloudmail (Resolved)

We are investigating a problem with cloudmail

Update to come

serives is running again looking into problem 1.05pm

Effects - This issue does not effect your relevant products/services
Affecting Server - Web Connect Cloudmail
Priority - Critical
Date - 18/10/2015 12:45
Last Updated - 22/10/2015 08:41

Server issues (Resolved)

We are aware there is problems with bnca30 and our techs are onto it


updates will follow

Cause Routine backup failed

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - Critical
Date - 18/10/2015 11:40 - 18/10/2015 11:52
Last Updated - 18/10/2015 11:59

Possible loss of connectivity (Resolved)

Our upstream provider has reported a need for urgent maintance to replace faulty equipment. There may be minimal loss of connectivity to our systems during this period

Effects - This issue does not effect your relevant products/services
Affecting System - Upstream Connection
Priority - Critical
Date - 13/08/2015 01:00 - 31/08/2015 12:28
Last Updated - 12/08/2015 16:39

Server issues (Resolved)

we have detected a problem with server timing out .

fixed , problem schedule backup cause the server to lockup

Effects - This issue does not effect your relevant products/services
Affecting Server - wc30
Priority - High
Date - 26/07/2015 09:55 - 12/08/2015 16:52
Last Updated - 26/07/2015 10:13

Connection Problems (Resolved)

we are aware of problems connecting to us

Effects - This issue does not effect your relevant products/services
Affecting Other - Down Time
Priority - Critical
Date - 07/03/2015 19:48 - 18/03/2015 10:30
Last Updated - 07/03/2015 21:18

ZImbra Email server down (Resolved)

We are currently experiencing problems with our Zimbra email service. Our techincians are attempting to resolve the issue and restore service ASAP

Effects - This issue does not effect your relevant products/services
Affecting Server - Zimbra
Priority - Critical
Date - 10/10/2014 15:02
Last Updated - 10/10/2014 17:50

Zimbra Maintenance (Resolved)

Maintenance will be performed on the Zimbra server tonight. There will be intermittent outages during the scheduled period

Effects - This issue does not effect your relevant products/services
Affecting Server - Zimbra
Priority - Medium
Date - 07/10/2014 20:00 - 10/10/2014 17:50
Last Updated - 07/10/2014 19:08

Service Upgrade (Resolved)

An important update is required on our Zimbra servers and will be performed tonight. You may experience issues in accessing email via Zimbra during this time

Effects - This issue does not effect your relevant products/services
Affecting Server - Zimbra
Priority - Critical
Date - 03/10/2014 19:30 - 07/10/2014 17:57
Last Updated - 03/10/2014 16:09

Web Hosted Server under high load (Resolved)

We have noticed over the weekend our server is under very high load due to Dos attacks and our team are onto it

service was up and down


Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - Critical
Date - 29/09/2014 07:52 - 29/09/2014 00:00
Last Updated - 30/09/2014 10:19

Emails rejected xtra.co.nz blacklisted (Resolved)

Extra Server mta02.xtra.co.nz  is still blacklist and causing bounce backs from our system due to them being black listed

Extra need to sort there system out for you to accept mail if it is resent chances are the will be sent though another server somtimes its just bad luck to get this server.

this is not a fault of our system but a fault the person sending to you the need to contact extra to fix this or move them.



Effects - This issue does not effect your relevant products/services
Affecting Other - mta02.xtra.co.nz
Priority - High
Date - 23/06/2014 13:48 - 29/09/2014 09:52
Last Updated - 07/08/2014 14:24

Urgent Outage - Napier POP - Wednesday 25/6 (Resolved)

Our up Stream Provider is upgrading  a core switch

Effects - This issue does not effect your relevant products/services
Affecting System - Core Router upgrade
Priority - Medium
Date - 25/06/2014 02:00 - 27/06/2014 09:42
Last Updated - 23/06/2014 16:53

Server using High Resources (Resolved)

We have Noticed bnca10 server is using higher amouts of cpu we are onto it

server is back to norm we are not sure why it spiked as of yet

Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - High
Date - 23/06/2014 15:12 - 24/06/2014 09:43
Last Updated - 23/06/2014 16:41

Web Server Outage (Resolved)


Bnca10 Web Server NOD has crashed after a routine service check we should be backup with in the hour Regards Team BigNoise Group

Regrads Team BigNoise

Effects - This issue does not effect your relevant products/services
Affecting Server - wc10
Priority - High
Date - 25/04/2014 20:01 - 26/04/2014 13:56
Last Updated - 25/04/2014 20:25

Internet issues (Resolved)

We have Detected upstream Provider issues and are aware of this


monitoring software was added to our block list and now have been lifted


We are back to Norm at 8am and further problems will be listed

Regards BigNoise Team

Effects - This issue does not effect your relevant products/services
Affecting Other - Upstream Provider
Priority - High
Date - 24/03/2014 11:24 - 12/04/2014 23:09
Last Updated - 25/03/2014 15:20

Speed Issues international (Resolved)

We are aware of international speed issues and our team are looking into this , if you are using cloudflare with us this wont afect you , but for those that arent please loginto hosting panel and search cloudflare


BigNoise Team

Effects - This issue does not effect your relevant products/services
Affecting Other - Network
Priority - Medium
Date - 12/02/2014 12:44 - 12/02/2014 11:56
Last Updated - 12/02/2014 23:29

Under high load due to attacks (Resolved)

We are looking into the attacks and are aware of outatages

looks to be under control now our team will be keeping an eye on it



Effects - This issue does not effect your relevant products/services
Affecting Server - BNCA20
Priority - Critical
Date - 28/12/2013 14:14
Last Updated - 07/01/2014 16:25

Small Outages (Resolved)

Small Outages tonight while updating our core net work in new Server Pod, this was un for seen outages



Effects - This issue does not effect your relevant products/services
Affecting System - Core Router update
Priority - Medium
Date - 28/11/2013 18:52 - 28/11/2013 19:05
Last Updated - 29/11/2013 00:51

Up Stream internet issues (Resolved)

We are experiencing upstream packet lose  from one off our suppliers , we have switch to fail over pipe till issue is resolved

Update will be post 9am 20.8.2013

resolved 10am 20.8.2013

Team BigNoise support






Effects - This issue does not effect your relevant products/services
Affecting Other - All servers
Priority - Medium
Date - 20/08/2013 00:32 - 20/08/2013 00:32
Last Updated - 28/08/2013 23:27

Outage on our core switch (Resolved)

5-10 min outage Due to a ups self test it failed in doing so the core network switch shut down Problem Resolved ......................

Effects - This issue does not effect your relevant products/services
Affecting System - Core network switch
Priority - Critical
Date - 03/11/2012 00:27 - 03/11/2012 00:35
Last Updated - 03/11/2012 00:35

Network drop offs (Resolved)

We are experiencing drop outs in our napier branch and are switching to fail over


update guys have found a issue with a upstream provider and are working on it 12.20pm

Resolved

Effects - This issue does not effect your relevant products/services
Affecting System - Napier POP
Priority - Medium
Date - 25/07/2012 10:40 - 00/00/0000
Last Updated - 26/07/2012 09:04

upstream speed issues (Resolved)

Update 4.25pm operation back to NORMLY -- fauly was hamiltion fibre pop failed

We are having upstream problems and we are currently on fail over pipe will keep you posted. you can expect slower speeds till resolved

Effects - This issue does not effect your relevant products/services
Affecting Other - upstream speed issues
Priority - Medium
Date - 21/12/2011 11:01 - 21/12/2011 16:27
Last Updated - 21/12/2011 16:30

 

rss View RSS Feed

Our official partners