1. It doesn't matter what the absolute sizes are; the probability is the ratio of the area of the circle to the area of the triangle.
Let's make it the unit circle, radius 1 (so apothem 1 for the triangle) so area
.
We can get the area of the triangle a couple of different ways; we'll compare.
Let's call the side of the equilateral triangle s and its height h.
Since the incenter is the centroid for an equilateral triangle, the height is three times the apothem, so h=3. The sides of the right triangle made by the altitude are s/2 and s, so
![(s/2)^2 + h^2=s^2](https://tex.z-dn.net/?f=%28s%2F2%29%5E2%20%2B%20h%5E2%3Ds%5E2)
![h^2 = \frac 3 4 s^2](https://tex.z-dn.net/?f=h%5E2%20%3D%20%5Cfrac%203%204%20s%5E2)
![s^2 = \frac 4 3 h^2](https://tex.z-dn.net/?f=s%5E2%20%3D%20%5Cfrac%204%203%20h%5E2)
![A =\dfrac{\sqrt{3} s^2}{4} = \dfrac{\sqrt{3} h^2}{3}](https://tex.z-dn.net/?f=A%20%3D%5Cdfrac%7B%5Csqrt%7B3%7D%20s%5E2%7D%7B4%7D%20%3D%20%5Cdfrac%7B%5Csqrt%7B3%7D%20h%5E2%7D%7B3%7D)
We have h=3 so the triangle area is
and the probability we seek is
Answer: ![p = \dfrac{\pi}{3 \sqrt{3}}](https://tex.z-dn.net/?f=p%20%3D%20%5Cdfrac%7B%5Cpi%7D%7B3%20%5Csqrt%7B3%7D%7D)
That's approximately 0.605
2. P(not in circle | in triangle) = 1 - P(in circle | in triangle)
![p = 1 - \dfrac{\pi}{3 \sqrt{3}} = 1 - \pi \sqrt{3}{9}= \dfrac{9 - \pi \sqrt{3}}{9}](https://tex.z-dn.net/?f=p%20%3D%201%20-%20%20%5Cdfrac%7B%5Cpi%7D%7B3%20%5Csqrt%7B3%7D%7D%20%3D%201%20-%20%5Cpi%20%5Csqrt%7B3%7D%7B9%7D%3D%20%5Cdfrac%7B9%20-%20%5Cpi%20%5Csqrt%7B3%7D%7D%7B9%7D)
Answer: ![\dfrac{9 - \pi \sqrt{3}}{9}](https://tex.z-dn.net/?f=%5Cdfrac%7B9%20-%20%5Cpi%20%5Csqrt%7B3%7D%7D%7B9%7D)
That's approximately 0.395
Edit: I forgot to do the area another way. I'll add that.
If we connect the tangent points of the incircle, by symmetry we get four congruent equilateral triangles. Any of the three chords makes an isosceles triangle with two radii and included angle 120 degrees. By the law of cosines, the chord length, which is the side of the small equilateral triangle, is
![s^2 = 1^2 + 1^2 - 2 (1)(1) \cos 120^\circ = 2 - (2)(-1/2) = 3](https://tex.z-dn.net/?f=s%5E2%20%3D%201%5E2%20%2B%201%5E2%20-%202%20%281%29%281%29%20%5Ccos%20120%5E%5Ccirc%20%3D%202%20-%20%282%29%28-1%2F2%29%20%3D%203)
so a total triangle area of
which agrees with the previous calculation.