Skip to main content
Sandbox Physics
From planet catalogs to populations

AC24 · L3

From a few detections to a population

A small discovery count can describe a large population when the chance of finding each planet is low. The calculation needs two ingredients: an integer catalog and the effective search exposure for a declared population shape. A probability model then states how uncertain the inferred rate remains.

Say which planets the rate counts

Choose a region BB in period PP, measured in days, and radius RR, measured in nominal equatorial Earth radii. Let fBf_B count planets in that region per searched star. It can exceed one because a star can host several planets.

The number alone does not specify how planets are distributed inside the region. Let h(P,R)h(P,R) be a normalized shape: integrating it over the chosen region gives one. If the shape is uniform in logarithmic period and radius, a fixed multiplicative interval receives the same probability wherever it lies inside the bounds.

A logarithmic coordinate changes by dln⁡P=dP/Pd\ln P=dP/P, so a density that is constant in logarithms has factors 1/P1/P and 1/R1/R when written in the linear coordinates. These factors are the change-of-variable weights, sometimes called Jacobian factors. They prevent wide linear cells from receiving an unintended population model.

h(P,R)=1PRln⁡(Pmax⁡/Pmin⁡)ln⁡(Rmax⁡/Rmin⁡),∫Bh(P,R) dP dR=1h(P,R)=\frac{1}{PR\ln(P_{\max}/P_{\min})\ln(R_{\max}/R_{\min})},\qquad \int_B h(P,R)\,dP\,dR=1
These finite bounds and logarithmic shape specify the population assumed in this calculation.

Reading: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates · IAU 2015 Resolution B3 nominal conversion constants

Turn the search into an expected count

For searched star jj, let qj(P,R)q_j(P,R) be the probability that a planet enters the final catalog. Average this probability using the population shape, then add over every searched star. The result EBE_B is an effective searched-star exposure.

Suppose the independent number of planets around each star follows a Poisson distribution. Selecting each planet with its modeled probability thins that Poisson process. Summing the selected counts over stars gives a Poisson discovery count with mean fBEBf_BE_B.

This assumption is convenient for the synthetic experiment, where planet counts, orbital directions and measurement noise are generated independently. Real system architectures can produce correlated transit opportunities. A model of planets per star and a model of planetary systems should therefore be identified separately.

EB=∑j=1N⋆∫Bqj(P,R)h(P,R) dP dR,p(n∣fB,EB)=(fBEB)ne−fBEBn!E_B=\sum_{j=1}^{N_\star}\int_B q_j(P,R)h(P,R)\,dP\,dR,\qquad p(n\mid f_B,E_B)=\frac{(f_BE_B)^n e^{-f_BE_B}}{n!}
The observed count nn is an integer. The effective exposure counts weighted searched stars. Observing duration has already entered each star’s selection probability.

Reading: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates

Normalize the uncertainty in the rate

A likelihood describes how the integer count changes as the possible rate changes. To turn it into a posterior density for that rate, supply a prior and normalize. Use a Gamma prior with positive shape α\alpha and rate β\beta. Its density is proportional to fBα−1e−βfBf_B^{\alpha-1}e^{-\beta f_B} on positive rates. Its total probability after normalization is one, so this is a proper prior.

Multiplying the prior by the Poisson likelihood adds nn to the exponent that determines the shape and adds EBE_B to the exponential rate. The resulting Gamma distribution is normalized by its Gamma-function factor. The word rate here names the Gamma distribution’s second parameter, which is different from the planet occurrence being inferred.

In the default synthetic record, five thousand searched stars produce 3,038 generated planets and 79 detections. The effective exposure is about 121121 stars. The prior has shape and rate one half. The posterior median is about 0.6510.651 planet per star, with a central 95-percent interval about [0.518,0.805][0.518,0.805]. The generating mean 0.6000.600 lies inside that interval. One successful example is not a general coverage test.

fB∣n,EB∼Gamma⁡(α+n,β+EB)f_B\mid n,E_B\sim\operatorname{Gamma}(\alpha+n,\beta+E_B)
For EB>0E_B>0, or for EB=0,n=0E_B=0,n=0, the posterior follows directly from multiplying and normalizing. A positive count with exactly zero selection has zero likelihood and signals a broken model or input.
Frozen synthetic records, the same 5000 searched stars
CaseDetected planetsSupported exposurePosterior median
Shallow transits hide79791211210.6510.651
Quieter detector97971431430.6770.677
Longer season98981421420.690.69
Repeated gaps616195.495.40.6380.638
True radius valley96961421420.6760.676

Noise changes retain the generated population; the valley preset changes its generating shape. The likelihood uses integer detections.

Reading: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates

A doubtful candidate still has an integer true state

Suppose three candidate classifications have externally supplied probabilities 0.90.9, 0.60.6 and 0.20.2 of being planets. Each object’s true state is still zero or one. Under independent classifications, multiplying their two-state probability polynomials gives the probabilities of zero, one, two and three true planets: 0.0320.032, 0.3440.344, 0.5160.516 and 0.1080.108.

The expected count is 1.71.7, but that expectation is not the observed integer count in a Poisson likelihood. One conditional approach computes the normalized posterior for each integer catalog and averages those posteriors with the external classification probabilities. The result is a mixture of Gamma densities, not a Gamma density obtained by putting a fractional count into the shape.

This is a modular calculation: the classifications are treated as supplied information and are not updated by the inferred occurrence. A joint generative model must instead describe how planets and false events enter the candidate sample. For example, a Poisson count with mean fBEB+ηf_BE_B+\eta cannot separately determine occurrence and a false-event mean η\eta from one total alone. An independently modeled control sample can add the missing information.

p(fB∣external classifications,EB)=∑n=0Ncandπn Gamma⁡(fB;α+n,β+EB)p(f_B\mid\text{external classifications},E_B)=\sum_{n=0}^{N_{\rm cand}}\pi_n\,\operatorname{Gamma}(f_B;\alpha+n,\beta+E_B)
πn\pi_n are normalized probabilities over integer catalogs. Independence and the origin of the external probabilities must be stated.

Reading: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates · Reliability Correction is Key for Robust Kepler Occurrence Rates

Zero information should stay uninformative

When no planet is detected but the exposure is positive, the data favour smaller rates and give a finite upper credible limit under the stated prior. When both the count and exposure are zero, the likelihood is constant in occurrence: the posterior stays exactly the prior.

An uncalibrated region is different from a region known to have zero recovery. The real tutorial calculates exposure where its empirical response has support. Elsewhere it allows any recovery probability from zero to one. The resulting minimum and maximum exposures are carried through the normalized integer-catalog mixture.

The endpoints give a family of conditional posteriors. Their outer 95-percent quantiles form an envelope across those conditions. There is no probability distribution over the unknown response, so this envelope should not be read as one uniquely defined 95-percent posterior interval. Its breadth shows what the measured calibration has left unresolved.

Reading: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates

Radius uncertainty moves planets between cells

A radius estimate can scatter across a bin edge. The probability that a planet from true cell ii appears in observed cell jj forms a migration matrix MjiM_{ji}. Include outside cells as well, so the probabilities for each true cell sum to one. Predict the observed cells by applying this measurement model after survey selection.

Planets around the same star share its radius uncertainty. Moving that stellar radius changes every associated planet radius together. It also changes geometric transit probability and the depth predicted for a fixed physical planet. Changing only catalog membership while holding selection fixed misses part of this effect.

The synthetic radius display gives half the log-radius variance to a shared host term and half to independent planet terms. Its total-count calculation uses every detection. Radius migration redistributes the plotted bins and preserves that total. The real tutorial separately shifts stellar radii and recomputes both membership and exposure; unavailable stellar/transit covariance remains an explicit limitation.

Reading: The California-Kepler Survey III. A Gap in the Radius Distribution of Small Planets · Shallower radius valley around low-mass hosts

Exercises and explanations

  1. A program reports a sharply measured occurrence in a cell with zero exposure and zero detections. How do you diagnose it?

    Read the explanation

    The data provide no rate information in that cell. With a proper prior, the posterior must equal the prior. Check for an imposed rate floor, an unjustified extrapolated selection probability, or a normalization error.

  2. Why does using the sum of classification probabilities as a Poisson count differ from the integer-catalog mixture?

    Read the explanation

    The mixture averages normalized densities with several different integer shapes. A density at the average shape generally differs from that average of densities. The full joint planet/false-event model is another explicitly specified calculation.

Try the prediction

Change the detector and watch the missing planets

  1. Compare the default posterior with the known generating mean.
  2. Set the season to eight days. Explain why a proper prior remains when no three-event opportunity exists.
  3. Switch to the true-valley population and increase radius scatter. Distinguish a blurred radius distribution from a change in the total detected count.

Sources and calculation scope

  1. A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates

    Version 1906.03575v4, sections II–VI, Equations 10–12 and Appendix B: externally weighted integer catalogs and occurrence likelihoods.

  2. Reliability Correction is Key for Robust Kepler Occurrence Rates

    Version 2006.15719v1, sections II–III and Figures 4–5: classification reliability, scores and catalog sensitivity.

  3. The California-Kepler Survey III. A Gap in the Radius Distribution of Small Planets

    Version 1703.10375v2, Figure 7, sections II–V and Appendix C: selected CKS population, weighted radius distribution and synthetic checks.

  4. Shallower radius valley around low-mass hosts

    Version 2401.12378v2, Equations 1–6, Figures 4–8 and section 3.3: normalized valley contrast, host dependence and radius-cell migration.

  5. IAU 2015 Resolution B3 nominal conversion constants

    IAU 2015 Resolution B3 conversion constants, version 1510.07674v1.

FeedbackSomething broken, confusing, or missing on this page?Tell us
What kind of feedback?

Sent with this page’s address, its Lab ID, the site language and your device type. Please leave out personal details. Feedback is kept for up to 12 months.Privacy policy