Skill test modifiers?

Hello, I'm reading the rules for the first time in ages and creating characters. Do you use all the circumstial modifiers during play or do you just go with, let's say a single +/- 10, 15, 20 for speed of play? There are a lot of modifiers.