udp: use a separate rx queue for packet reception
under udp flood the sk_receive_queue spinlock is heavily contended. This patch try to reduce the contention on such lock adding a second receive queue to the udp sockets; recvmsg() looks first in such queue and, only if empty, tries to fetch the data from sk_receive_queue. The latter is spliced into the newly added queue every time the receive path has to acquire the sk_receive_queue lock. The accounting of forward allocated memory is still protected with the sk_receive_queue lock, so udp_rmem_release() needs to acquire both locks when the forward deficit is flushed. On specific scenarios we can end up acquiring and releasing the sk_receive_queue lock multiple times; that will be covered by the next patch Suggested-by:Eric Dumazet <edumazet@google.com> Signed-off-by:
Paolo Abeni <pabeni@redhat.com> Acked-by:
Eric Dumazet <edumazet@google.com> Signed-off-by:
David S. Miller <davem@davemloft.net>
Showing
- include/linux/udp.h 3 additions, 0 deletionsinclude/linux/udp.h
- include/net/udp.h 2 additions, 7 deletionsinclude/net/udp.h
- include/net/udplite.h 1 addition, 1 deletioninclude/net/udplite.h
- net/ipv4/udp.c 123 additions, 15 deletionsnet/ipv4/udp.c
- net/ipv6/udp.c 2 additions, 1 deletionnet/ipv6/udp.c
Please register or sign in to comment