The 41-year-old saw his side slump to a fourth defeat in a row on Tuesday night, losing 2-0 away at struggling Oldham.
The Saddlers saw the biggest turnover of players in the EFL in the summer, with 22 leaving the club and 16 joining.
But in his latest warning to his players, Clarke says he is set to move players on if there isn't an improvement before the transfer window opens, including some players he brought in this year.
“I have some weak minded players at the minute, they won’t be at the club long," he said.
“Not with me, not the way I work.
“We’ll keep working with them and when we can freshen up we’ll freshen it up.
“They have a lot to prove, a hell of a lot to prove.
“I don’t think it’s a strong division so that make’s my players even weaker because we’re poor.
“It’s a case of changing personnel, they have 10/11 games in the league before the window opens and they’ll be gone.
“They’ll be on the transfer list and that’s whether I’ve signed them in the summer or not.
“I need a lot more but I take full responsibility for where we’re at.
“I’ve been a successful manager but I’m having a terrible run.
“I know what it takes to be a successful team and I’ll take the hit, some of my signings haven’t worked.
“They haven’t been good enough, I’ll take that.
“We had the biggest turnaround in the EFL, my top goal scorer wanted to leave, my captain wanted to leave, my other scorer wanted to leave.
“They have 10/11 games for them to show me something different otherwise I’ll be moving them on.
“Put them on the list and some other manager can deal with them because I’m not having it.
“I go away weekends, I don’t sleep after Saturday, I won’t sleep tonight.
“Because I care, I want to do well for the football club."
Mat Sadler was sent off in the Oldham loss for a deliberate handball, to stop an attacker from racing through on goal.
And while Clarke agreed with the decision, he felt Adebayo should have been awarded a penalty in the first half.
The striker went down after trying to cut onto his left foot and evade the defender as he went through on goal.
“The referee has made two big calls, obviously Sadler’s is a sending off, but it’s a blatant penalty as well, which we’re disappointed in," Clarke added.
“Adebayo gets on the inside of him, catches him, it’s a penalty all day.
“We can’t go over that, it’s not good enough.
“The fans know it’s not good enough, we have to do more.
“We have to stick together.
“What can go wrong, is going wrong.
“We have injuries galore, sending offs, suspensions.
“We have to get on with it.
“Take the stick, which is thoroughly deserved.
"The only way you turn it around is by winning football matches."