I see your concern, and how you think this might be a contradiction. The other answerers are giving the correct answer, but they are overlooking half of your question.
Remember that the simplest form of Newton's law of gravitation ONLY applies to what are known as POINT MASSES. That is to say, objects that are SO SMALL geometrically, compared to how far apart they are spaced.
It is a problem of CALCULUS to officially determine anything else.
And indeed, there are people who have proven that in the case of external points of SPHERICALLY SYMMETRIC bodies, you can officially "get away with" treating the bodies as if they are point masses. There is a calculus proof to this, that is a common problem in a college sophomore level class of multivariable Calculus.
Earth certainly isn't a point mass.
And neither is Earth, a spherically symmetric body. Earth is approximately spherically symmetric, and for most purposes, you can get away with such an approximation.
The material that makes up MT. Everest, certainly isn't spherically symmetric with the rest of Earth
And neither is the material that makes up the ocean. In fact, at the bottom of the Marianas Trench, the ocean mass immediately above, would actually be pulling up on you.
None of this really is that significant. And I can make a density argument as to why.
The Earth's greatest density is in its CORE layers. And this density is much less in the mantle and crust.
In terms of water's density being defined as 1 gram/cm^3, here are the relative densities of each layer.
Inner core: 13 gram/cm^3 (0 to 19% of Earth's radius, 2% of Earth's total mass)
Outer core: 11 gram/cm^3 (19% to 55% of Earth's radius, 30% of Earth's total mass)
Mantle: 5 gram/cm^3 (55% to 98% of Earth's radius, 51% of Earth's total mass)
Crust: 2.5 gram/cm^3 (final 98% to 100% of Earth's radius)
Ocean water: 1.03 gram/cm^3
https://upload.wikimedia.org/wikipedia/commons/8/89/RadialDensityPREM.jpg
Mountains are primarily made out of crust-like material. Therefore, the local factors will be much less significant than the bulk factors. 82% of Earth's total mass is in the interior layers, and is much denser than Mt Everest.
So my assessment is definitely that there is less gravity at mountain tops, and more gravity at deep ocean depths. Local factors are assumed negligible.