The only areas you should use the caliper grease are on the back side of the brake pad and the top surface of the piston that presses against it, along with the outer diameter of the metal part of the brake pad. Just make sure not to get any on the friction material itself.
You're right to be cautious about where to use the grease when it comes to brake parts.