The castle itself has defense capacity even if no troops are inside. So you might see a defense number on the castle up to 70K (for a very high level castle) but that does not mean there are any troops. Look for one with at least 90K.
No troops, no honor, as Saimaidar suggests. You will still be able to loot resources - this is known as farming a castle.