Bowling club members say they feel they've been "stabbed in the back" over plans to build housing on their bowling green.
But members of the rugby club's bowling section say they feel let down and forgotten by the club.
Georgina Webber, 81, from New Barn, Longfield, said the bowling club had been based at the site for 92 years but members had been told they would have to leave the site by the end of November.
"It's going to stop a lot of enjoyment," she said. "Apparently they can't put in planning permission until we're off the bowling green, and they're saying we've got to be off by November 30. We're not very happy, but there's not a lot we can do. The committee at the rugby club have decided that's what they want to do .
"Really we've been stabbed in the back. It's spoiling a lot of people's enjoyment to just build a few houses. The bowling green at Windmill Hill has gone. There are others around, but not everyone wants to go somewhere else.
"We've got about 50-60 members but other clubs play there too."
Mrs Webber added: "We're disappointed with the way we've been treated. They could have told us about this a lot earlier and we could have fought the decision. We're part of the club and we've been stabbed in the back."
Mike Cubitt, president of Gravesend Rugby Club, confirmed the club had decided to close the bowling section and explained the decision.
"The impact of Covid has pushed the situation further down the line than we would have liked," he said. "Over the years we've been in discussion with the landlord, who's seeking for us to release part of the lease.
"Possibly if Covid hadn't come along it wouldn't have got to this situation, but we've struggled to keep our heads above water - in fact we've not even got our heads above water."
He said it had been a tough decision for the club, which also offers cycling, cricket, a pigeon section, an all weather sports facility used by various hockey teams, petanque and of course rugby.
"Our main goal is to ensure Gravesend Rugby Club is here for other generations to come," added Mr Cubitt. "We have about 300 children who play here - we had to weigh up the benefits and losses.
'We've struggled to keep our heads above water - in fact we've not even got our heads above water...'
"It's quite a sad thing but it's a decision made by our committee and the reason is to protect the whole site.
"We've tried to re-site them but nothing has come to fruition. This could have been left to next year but we decided it would be unfair on the people that play bowls to leave it until March when they're season starts.
"It would be unfair of us to let the bowlers maintain the bowling green through the winter and tell them in March or April we're not continuing.
"We're giving them a chance to join other clubs. All the bowlers that want to continue playing can be accommodated at other facilities around the borough."