DNS outage with jenkins-ci.org

13 thoughts on “DNS outage with jenkins-ci.org”

1. As the follow-up post from Tyler in the linked thread indicates, the problem is fixed now (and it’s resolving for me.) Depending on how your upstream DNS updates its cache, it might take a few more hours for some people.

2. It still doesn’t work. None of the Jenkins site work and we are not able to Upgrade Jenkins to its latest version.
   Adding the DNS as mentioned above restricts us from accessing other important URLs.

3. Are you sure it’s a DNS problem? What does “nslookup jenkins-ci.org” report?

4. Hi, the nslookup command gives:

   ——————————————–

   C:\Users\>nslookup jenkins-ci.org
   Server: hostnamexx
   Address: 192.168.9.x

   *** hostnamexx can’t find jenkins-ci.org: Server failed

   ——————————————–

   However, for any other website it says:

   ——————————————–

   C:\Users\>nslookup google.com
   Server: hostnamexx
   Address: 192.168.9.x

   Non-authoritative answer:
   Name: google.com
   Addresses: 209.85.147.105
   209.85.147.103
   209.85.147.106
   209.85.147.104
   209.85.147.99
   209.85.147.147

   OR,

   C:\Users\>nslookup gmail.com
   Server: hostnamexx
   Address: 192.168.9.x

   Name: gmail.com
   Addresses: 74.125.230.150
   74.125.230.151
   74.125.230.149

   ——————————————–

   Previously, the site used to work without any issues. I still assume it to be the DNS problem.

5. @Kavi
   What’s your upstream DNS? Who provides that?

6. We are not aware of the upstream DNS :)..however, we are on the internet and access websites through the SSL certificates.. and I am sure that this was working pretty well before the outage occurred, since we had upgraded to version 1.443 of Jenkins.

7. @Kavi
   Given that your DNS is in 192.168/16 range, it’s most likely set up by your admin to delegate to the DNS provided by your upstream network. The reason I ask is so that we can better understand where the cause is — I’m trying to see if it’s a misconfigured DNS server or something more fundamental.

8. I pined the IP of the website, 63.246.20.93 : jenkins-ci.org and got the following results:

   —————————————
   Ping test for 63.246.20.93

   PING 63.246.20.93 (63.246.20.93) 56(84) bytes of data.

   — 63.246.20.93 ping statistics —
   10 packets transmitted, 0 received, 100% packet loss, time 9001ms

   256
   —————————————

   I derived the IP of the website from http://www.selfseo.com/find_ip_address_of_a_website.php.

   The IP was pinged from the Internet, the link to test it was: http://www.pingtest.co.uk/63.246.20.93?ip=
   http://www.pingtest.co.uk

   This could be a location specific issue. But adding the DNS allows me to access the website externally, but Jenkins still cannot be upgraded.

   ——————–
   Installing Plugins/Upgrades
   Preparation

   * Checking internet connectivity
   * Checking update center connectivity
   * Failed to resolve host name updates.jenkins-ci.org. Perhaps you need to configure HTTP proxy?
   *

   java.net.UnknownHostException: updates.jenkins-ci.org
   at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:158)
   at java.net.Socket.connect(Socket.java:546)
   at java.net.Socket.connect(Socket.java:495)
   at sun.net.NetworkClient.doConnect(NetworkClient.java:174)
   at sun.net.www.http.HttpClient.openServer(HttpClient.java:409)
   at sun.net.www.http.HttpClient.openServer(HttpClient.java:530)
   at sun.net.www.http.HttpClient.(HttpClient.java:240)
   at sun.net.www.http.HttpClient.New(HttpClient.java:321)
   at sun.net.www.http.HttpClient.New(HttpClient.java:338)
   at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:935)
   at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:876)
   at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:801)
   at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1139)
   at hudson.model.UpdateCenter$UpdateCenterConfiguration.testConnection(UpdateCenter.java:732)
   at hudson.model.UpdateCenter$UpdateCenterConfiguration.checkUpdateCenter(UpdateCenter.java:585)
   at hudson.model.UpdateCenter$ConnectionCheckJob.run(UpdateCenter.java:879)
   at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
   at java.util.concurrent.FutureTask.run(FutureTask.java:166)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
   at java.util.concurrent.ThreadPoolExecutor$Worker
   ———————–

9. @Kavi
   I can confirm that the server doesn’t respond to ping. But your error is still that your server (not your client) is failing to resolve the host name. Or Java might be caching DNS records in-process and you might have to restart it or something. I don’t know.

10. Do you suggest that the main Jenkins server should be rebooted? We have a linux master and the following was added to /etc/resolv.conf
    ‘nameserver 140.211.15.121′

    It should have considered the changes with immediate effect (as it did on my local machine). I shall contact my network team and check the issue.

    Thanks for your help.

11. This has been resolved. There was a caching problem.
    Thanks!

12. Hi,
    Kavi what are the caching problem ?
    From your client (internet cache from IE or FF) or from your server ?
    thx.

13. I’m still getting this error when trying to install the plugin. Below is the stack trace that i got when trying to instal the plug in.

    Installing Plugins/Upgrades
    Preparation •Checking internet connectivity
    •Checking update center connectivity
    •Failed to resolve host name updates.jenkins-ci.org. Perhaps you need to configure HTTP proxy?
    •java.net.UnknownHostException: updates.jenkins-ci.org
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178)
    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:157)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
    at java.net.Socket.connect(Socket.java:579)
    at java.net.Socket.connect(Socket.java:528)
    at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
    at sun.net.www.http.HttpClient.(HttpClient.java:203)
    at sun.net.www.http.HttpClient.New(HttpClient.java:290)
    at sun.net.www.http.HttpClient.New(HttpClient.java:306)
    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:995)
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:931)
    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:849)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1299)
    at hudson.model.UpdateCenter$UpdateCenterConfiguration.testConnection(UpdateCenter.java:746)
    at hudson.model.UpdateCenter$UpdateCenterConfiguration.checkUpdateCenter(UpdateCenter.java:595)
    at hudson.model.UpdateCenter$ConnectionCheckJob.run(UpdateCenter.java:910)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
    at java.lang.Thread.run(Thread.java:722)

    NUnit Plugin Failure – Details
    hudson.util.IOException2: Failed to download from http://updates.jenkins-ci.org/download/plugins/nunit/0.14/nunit.hpi
    at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:668)
    at hudson.model.UpdateCenter$DownloadJob._run(UpdateCenter.java:1008)
    at hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:1157)
    at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:987)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
    at java.lang.Thread.run(Thread.java:722)
    Caused by: java.net.UnknownHostException: updates.jenkins-ci.org
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1664)
    at sun.net.www.protocol.http.HttpURLConnection$6.run(HttpURLConnection.java:1662)
    at java.security.AccessController.doPrivileged(Native Method)
    at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1660)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1243)
    at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:638)
    … 9 more
    Caused by: java.net.UnknownHostException: updates.jenkins-ci.org
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:178)
    at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:157)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
    at java.net.Socket.connect(Socket.java:579)
    at java.net.Socket.connect(Socket.java:528)
    at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:378)
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:473)
    at sun.net.www.http.HttpClient.(HttpClient.java:203)
    at sun.net.www.http.HttpClient.New(HttpClient.java:290)
    at sun.net.www.http.HttpClient.New(HttpClient.java:306)
    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:995)
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:931)
    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:849)
    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1299)
    at sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConnection.java:2660)
    at java.net.URLConnection.getHeaderFieldLong(URLConnection.java:639)
    at java.net.URLConnection.getContentLengthLong(URLConnection.java:511)
    at java.net.URLConnection.getContentLength(URLConnection.java:495)
    at hudson.model.UpdateCenter$UpdateCenterConfiguration.download(UpdateCenter.java:637)
    … 9 more