Reg: dhcp service unresponsive frequently

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Reg: dhcp service unresponsive frequently

Purva Rawan

Hi,

We are using ISC-DHCP version is 4.1.1 on centos 6.4 .DHCP service started becoming unresponsive once every week . The server itself is up and running, but the DHCP service was unresponsive.We restarted the service. But after few days dhcp service stopped working. No entries were written to the dhcp log, and there was nothing helpful in any event log.We observed that Load on server ,CPU utilization ,HDD utilization,network traffic are normal during service get freeze.

How to fix this issue?

Regards,

Purva 



For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users
Reply | Threaded
Open this post in threaded view
|

Re: Reg: dhcp service unresponsive frequently

Bill Shirley-2

Run a tcpdump on the network interface looking for DHCP traffic.  Are there any responses?
# IPv4
tcpdump -vv -e -n -i lan10 'portrange 67-68'
# IPv6
tcpdump -X -l -vv -e -n -i wifi 'portrange 546-547'

Who is handling your logging? systemd-journald? rsyslogd?

Bill

On 1/20/2020 12:17 AM, Purva Rawan wrote:

Hi,

We are using ISC-DHCP version is 4.1.1 on centos 6.4 .DHCP service started becoming unresponsive once every week . The server itself is up and running, but the DHCP service was unresponsive.We restarted the service. But after few days dhcp service stopped working. No entries were written to the dhcp log, and there was nothing helpful in any event log.We observed that Load on server ,CPU utilization ,HDD utilization,network traffic are normal during service get freeze.

How to fix this issue?

Regards,

Purva 



For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users
Reply | Threaded
Open this post in threaded view
|

Re: Reg: dhcp service unresponsive frequently

Purva Rawan

1.Rsyslogd is used for logging.

2.We faced the same issue again and captured logs for tcpdump command as suggested by you.It is observed that
unresponsive dhcp server received only request in tcpdump but the same request is not logging in rsyslogd during the incident.

In working dhcp server ,we received both request and reply in tcpdump logs.

One more thing, we have ldap backend for dhcp configuration.

Here,I attached logs of tcpdump command for freeze dhcp service and working dhcp service.

Regards,

Purva

 

 


On January 21, 2020 at 5:31 AM Bill Shirley <[hidden email]> wrote:

Run a tcpdump on the network interface looking for DHCP traffic.  Are there any responses?
# IPv4
tcpdump -vv -e -n -i lan10 'portrange 67-68'
# IPv6
tcpdump -X -l -vv -e -n -i wifi 'portrange 546-547'

Who is handling your logging? systemd-journald? rsyslogd?

Bill

On 1/20/2020 12:17 AM, Purva Rawan wrote:

Hi,

We are using ISC-DHCP version is 4.1.1 on centos 6.4 .DHCP service started becoming unresponsive once every week . The server itself is up and running, but the DHCP service was unresponsive.We restarted the service. But after few days dhcp service stopped working. No entries were written to the dhcp log, and there was nothing helpful in any event log.We observed that Load on server ,CPU utilization ,HDD utilization,network traffic are normal during service get freeze.

How to fix this issue?

Regards,

Purva 



For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

  _______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users


For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

tcpdump_logs_unresponsive_dhcp_server.txt (2K) Download Attachment
tcpdump_logs_working_dhcp_server.txt (2K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Reg: dhcp service unresponsive frequently

Bill Shirley-2
In reply to this post by Bill Shirley-2

I stumbled upon your reply in my INBOX which I seldom check for this email account.  I don't
know which email client you're using but for Thunderbird you should use "Reply List".

Your tcpdump of the traffic for the working client is on the same subnet as your DHCP server:

10.208.39.250.bootpc > 10.208.38.1.bootps


However, the two non-working clients appear to be off-subnet:

10.208.8.1.bootps > 10.208.0.27.bootps
10.208.16.1.bootps > 10.208.0.27.bootps

Are you using relays?  What IP addresses does your DHCP server have?
ip -o -4 addr

Bill

On 1/20/2020 7:01 PM, Bill Shirley wrote:

Run a tcpdump on the network interface looking for DHCP traffic.  Are there any responses?
# IPv4
tcpdump -vv -e -n -i lan10 'portrange 67-68'
# IPv6
tcpdump -X -l -vv -e -n -i wifi 'portrange 546-547'

Who is handling your logging? systemd-journald? rsyslogd?

Bill

On 1/20/2020 12:17 AM, Purva Rawan wrote:

Hi,

We are using ISC-DHCP version is 4.1.1 on centos 6.4 .DHCP service started becoming unresponsive once every week . The server itself is up and running, but the DHCP service was unresponsive.We restarted the service. But after few days dhcp service stopped working. No entries were written to the dhcp log, and there was nothing helpful in any event log.We observed that Load on server ,CPU utilization ,HDD utilization,network traffic are normal during service get freeze.

How to fix this issue?

Regards,

Purva 



For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users
Reply | Threaded
Open this post in threaded view
|

Re: Reg: dhcp service unresponsive frequently

Purva Rawan
In reply to this post by Purva Rawan

We have not configured dhcp relay agent in both dhcp server's configuration .

In one of the server ,dhcp service listening on each interfaces.
For another dhcp server ,dhcp relay agent is serving through Layer 3 switch.

But we are facing this issue for both the servers.

Regards,

Purva 


On January 23, 2020 at 8:52 AM Bill Shirley <[hidden email]> wrote:

I stumbled upon your reply in my INBOX which I seldom check for this email account.  I don't
know which email client you're using but for Thunderbird you should use "Reply List".

Your tcpdump of the traffic for the working client is on the same subnet as your DHCP server:

10.208.39.250.bootpc > 10.208.38.1.bootps


However, the two non-working clients appear to be off-subnet:

10.208.8.1.bootps > 10.208.0.27.bootps 10.208.16.1.bootps > 10.208.0.27.bootps

Are you using relays?  What IP addresses does your DHCP server have?
ip -o -4 addr

Bill

On 1/20/2020 7:01 PM, Bill Shirley wrote:

Run a tcpdump on the network interface looking for DHCP traffic.  Are there any responses?
# IPv4
tcpdump -vv -e -n -i lan10 'portrange 67-68'
# IPv6
tcpdump -X -l -vv -e -n -i wifi 'portrange 546-547'

Who is handling your logging? systemd-journald? rsyslogd?

Bill

On 1/20/2020 12:17 AM, Purva Rawan wrote:

Hi,

We are using ISC-DHCP version is 4.1.1 on centos 6.4 .DHCP service started becoming unresponsive once every week . The server itself is up and running, but the DHCP service was unresponsive.We restarted the service. But after few days dhcp service stopped working. No entries were written to the dhcp log, and there was nothing helpful in any event log.We observed that Load on server ,CPU utilization ,HDD utilization,network traffic are normal during service get freeze.

How to fix this issue?

Regards,

Purva 



For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users

  _______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users


For assimilation and dissemination of knowledge, visit cakes.cdac.in

150th Anniversary Mahatma Gandhi

------------------------------------------------------------------------------------------------------------
[ C-DAC is on Social-Media too. Kindly follow us at:
Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ]

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
------------------------------------------------------------------------------------------------------------
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users
Reply | Threaded
Open this post in threaded view
|

Re: Reg: dhcp service unresponsive frequently

Niall O'Reilly
On 24 Jan 2020, at 7:14, Purva Rawan wrote:

> We have not configured dhcp relay agent in both dhcp server's
> configuration .

That would be right; see below: the relay belongs to the network, not to
the
server.

> In one of the server ,dhcp service listening on each interfaces.
> For another dhcp server ,dhcp relay agent is serving through Layer 3
> switch.
>
> But we are facing this issue for both the servers.

It may help to think about this from the client back to the server,
rather than from the server(s) outwards.

I don't have a good picture of your network topology, or where the
relays and servers are sitting, or what experience you have, so I may
be explaining at the wrong level. If so, apologies.

Each client is connected to a layer-2 network, and needs a local DHCP
service on this network.

The local DHCP service must be provided either by a relay or by a
server;
it's unusual to have a server connected to every client network.

The relay is typically part of the router configuration.

Each relay must be configured with the address of one or more servers;
one is enough; a second gives resilience; I wouldn't suggest more.

The server(s) can be on a network where no clients are connected; except
for very simple topologies, I prefer to keep the server on a non-client
network.

Each relay must be able to reach, and be reachable from, the server(s);
access lists and routing errors can obstruct reachability, perhaps
asymmetrically.

Each client network must be specified in the server configuration.

Log entries on the server will show you what the server thinks is going
on.
You should see the DORA sequence: DISCOVER, OFFER, REQUEST, ACK; for
renewals, you'll normally just see REQUEST, ACK.

If you know or expect that the client is sending DISCOVER, but don't see
it in the server log, then you'll need to look at your network and work
out why the DISCOVER is not reaching the server either from the relay or
from a client on the same network as the server.

If you see OFFER in the server logs, but no REQUEST, you'll need to look
at the network in the opposite direction, and work out why the OFFER is
not reaching the client or relay.

I hope this helps.

Niall O'Reilly
_______________________________________________
dhcp-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/dhcp-users