It got me thinking about my system. Sometimes, I do ability checks and sometimes I just go by whether you have the skill or not. The main reason for this was actually a game reason. If the consequences of the check were low, then I would just let you check whether you have a skill or not as I did not want you wasting time rolling over a few silver florins or 1 point of Will or Vitality. However, I will think carefully about when you need to do a roll now.
In book 3 of Legend of the Wayfarer, you are given the chance to find some treasure after beating some bandits. I made it an ability roll with the perception, but if you have enough time to search the clearing, then why bother rolling? Maybe, with enough time, you find it without any skill or maybe it is so well hidden that it doesn't matter how long you take - if you don't have Perception, you can't find it. Maybe a roll is appropriate if you have little time to do the search.
I will think more carefully about where I place my skill rolls now. Maybe they should only be the result of bad decisions or sub-optimal conditions and this will reward good play more. For this reason, I need to make decisions meaningful and leave enough clues to make sure people can work out which decision is best.