2006 - Archived MOTD

12/29/2006 1:38:00 PM — This morning at approximately 9:29AM, Telehouse experienced an issue with a UPS that went offline momentarily without switching to bypass at their 25 Broadway location. Tellurian Network`s equipment is powered by this specific UPS and lost power. When power was restored, our core router at this location would not come back online. After some troubleshooting, we isolated the problem to an interface in the router causing the problem. We were able to get the router back online without all interfaces permitting limited services through the router and began adding interfaces back into the router until all service was restored. We will be further troubleshooting the issue during a maintenance window to determine specifically which interface is preventing our routing from booting when it is in the chassis. All services were completely restored at approximately 1:00PM. We sincerely apologize for any inconvenience this outage may have caused.

10/31/2006 11:51:00 AM — Verizon found and replaced a bad card in the central office. Our DS3 to Princeton is now running clean. All connectivity issues to the Princeton area should be resolved. If you still have issues, please contact us at 973-940-6100. Thank you for your patience while we resolved this matter.

10/31/2006 9:55:00 AM — We are presently experiencing packet loss to our Princeton POP. The DS3 that is feeding this POP is taking errors. We have a ticket opened with Verizon and they are presently working to repair the circuit. More information will be posted as it is received. We apologize for any inconvenience this may cause.

10/29/2006 1:54:00 AM — The work at our 25 Broadway POP is complete total downtime for Philadelphia & southern NJ dialup customers was less than 5 minutes. No other customers were affected. We will begin the work in Jersey City at 2:30AM EST.

10/28/2006 7:54:00 PM — Tellurian will add a new card to one of our routers at 25 Broadway and install a new router for additional capacity. Dialup customers in Philadelphia and Southern NJ using Focal numbers will experience a brief service interruption tonight from 1:00AM EST until 1:30AM EST. Verizon Frame relay customers in northern NJ LATA 224 will experience a brief outage lasting less than 30 minutes from 2:30AM EST until 3:00AM EST while we reconfigure a router in Jersey City.

10/28/2006 4:28:00 PM — Verizon has resolved the issue with our channelized DS3. They have replaced several line cards and adjusted the buildout of the circuit. We have been monitoring the circuit and have not seen any more errors for several hours now. Should you have any issues, please contact our Network Operations Center at 973-940-6100. Thank you!

10/28/2006 8:38:00 AM — We are presently experiencing a network outage to T1 customers in the New York City area who are connected to our POP at 32 Old Slip. Customers served out of our 25 Broadway POP are unaffected. This appears to be some sort of carrier outage with Verizon. The DS3 which these circuits terminate on is up and running, yet all T1 circuits are unreachable. We have a ticket opened with Verizon who is presently working on ths issue. We apologize for any inconvenience this may cause.

10/7/2006 2:34:00 PM — We experienced a switch failure at our POP in the Embarq Newton, NJ central office today. This mostly affected DSL customers in Northwestern NJ who have Embarq as their local telephone company. We have isolated the cause of the problem and restored service. We are presently working to add a redundant path around the switch should a failure like this occur again. We apologize for any inconvenience this may have caused you and thank you for your patience while we restored service.

9/8/2006 8:30:00 AM — DSL customers in and around Blairstown, NJ, are currently without service due to a Sprint equipment problem. Sprint anticipates repair will be completed on 9/10/06 at 6:00AM

8/13/2006 9:00:00 PM — Tellurian will be conducting service affecting maintenance to most of our servers this evening. Some servers will be unavailable while these security updates are performed.

8/8/2006 3:34:00 PM — Tellurian Networks will be performing service affecting maintenance on our Newton, NJ node on Wednesday, August 9th beginning at 3:00AM. This maintenance involves configuration changes that affect traffic distribution between core routers in Newton as well as traffic to one of our colocation switches. We expect the actual changes to take no longer than 15 to 30 minutes. During this maintenance, customers may experience intermittent connectivity and suboptimal routing. We apologize for any inconvenience this may cause and will work to minimize service impact during this maintenance window. Thank you.

7/17/2006 5:21:00 PM — Due to a bug introduced in a maintenance release of our mail server software, spam filtering effectiveness was drastically reduced on our primary mail server. You use this server if your email address ends in @tellurian.net/.com, @garden.net, @rtonline.net, @nji.com, @cybercomm.net, @csionline.net/.com, or @shorenetworks.net/.com or @lsa.net. We caught this issue early this morning and rolled back the maintenance release to the prior version that did not contain this bug to correct the issue. We apologize for the temporary influx of spam that some users may have experienced as a result of this software glitch.

6/24/2006 4:18:00 PM — UPDATE - As of approximately 3:45PM, Verizon replaced a bad card in the central office that was affecting our ATM DS3 circuit in Princeton. After doing this, all errors on the circuit have cleared. Both Verizon and Tellurian are showing the circuit in proper operating condition. Please contact Tellurian Networks if you have any further problems with you service in the Princeton, NJ area. Thank you.

6/24/2006 12:00:00 PM — We are currently taking errors on our ATM DS3 circuit in the Princeton area. All services out of this area are affected by this issue. We have a ticket opened with Verizon who will be testing the circuit to isolate the issue. More information will be posted here as it becomes available.

5/4/2006 11:36:00 PM — Tellurian Networks will be performing scheduled maintenance on many of our servers this evening. Customers may notice brief periods of services being unavailable provided by these servers such as web sites, email, and authentication services. We thank you for your understanding as we perform upgrades to ensure continued quality and reliable service.

4/22/2006 9:24:00 PM — Today at approximately 2:58PM EST, the backup UPS in our Newton datacenter experienced an internal failure. Because of the way our UPS units are linked together for redundancy, this failure cascaded and caused the primary UPS unit to fail which resulted in a dropped load condition. Our technicians and our electricians attempted to bypass the backup unit, but an internal switch failure prevented them from doing so. The failed unit was completely disconnected and power was routed around the failed unit. The primary unit was brought back online and power restored to all equipment in the datacenter at 4:34PM.

4/20/2006 12:09:00 AM — We have completed an upgrade of our capacity to Sprint`s network. This upgrade affects all DSL customers in Sprint territory and will improve DSL response time and throughput, especially during peak usage times during the day.

3/15/2006 8:45:00 AM — Some DSL customers in the Sussex/Wantage, NJ area currently are currently without service. This is due to a problem with Sprint equipment in the area, which they are working to correct. Updates will be posted as they become available.

2/17/2006 3:56:00 PM — Veroxity has replaced a suspect GBIC in their router that is thought to have been causing the issues. They believe the issue is resolved. Everything is testing good. We have turned up our BGP session with Veroxity again at 12:00PM and everything is working as expected.

2/16/2006 9:09:00 PM — Beginning around 8:28PM, we started seeing problems with one of our transit providers, Veroxity. Our BGP session with Veroxity kept flapping causing route instability in reaching our network from some locations. We have since manually shut down our BGP session with Veroxity and have an opened trouble ticket with them. We will be bringing the transit back online once we are assured the problem is corrected.

1/1/2006 11:43:00 PM — Thanks to one of our clients with a great idea, the MOTD is now available as an RSS feed. Just use http://www.tellurian.com/scripts/motd.xml Thanks for the idea Greg!

1/1/2006 11:21:00 PM — Happy New Year! Our scheduled electrical upgrade/maintenance is now complete. We will have more upgrades to announce in late January.

1/1/2006 7:29:00 PM — Happy New Year! Our scheduled electrical maintenance is almost complete. We will post details here when we finish.