N’dam, 32, recently lost in the opening round of the Rio 2016 Olympic tournament but remains handily rated by the World Boxing Organisation as current belt holder Saunders lines up a first defence.
The Cameroonian, along with the likes of Rob Brant, Macej Sulecki, Artur Akavov and Ryota Murata are among the contenders Saunders can choose from, although N’dam is sure the 27 year-old will avoid him for Cardiff on October 22.
“I don’t think we will fight because I think he fears me and wants to take easy option for that fight,” N’dam exclusively told World Boxing News.
“I think today Saunders wants to just have easy opponents. But when we go around saying we are a champion, we must face the real boxers who can give you a headache.
“Saunders says he wants to fight with Gennady Golovkin next but is that because he has already proven himself as a champion or is it just because he knows he will get a large purse if he faces GGG?”
An announcement regarding Saunders next move could be made as early as this week following the recent confirmation that the Hatfield man will appear at the Motorpoint Arena.
Saunders was initially due to appear on the Tyson Fury v Wladimir Klitschko undercard on October 29 until that card collapsed leaving Frank Warren with only one date left for his 160 pound titlist.