Where is everybody? · Working papers

Red team, round 2: the rebuilt model

These are the critics’ reports as filed. The critics were separate runs of Claude given opposing briefs; none is a human specialist. File names refer to the project’s working folder. Where a report cites a brief by subject, such as “the abiogenesis brief”, it means one of the project’s summaries of the published literature. Notes about where working files were stored have been removed; the findings are unedited.

Critic: a statistician

Overall verdict

Claim 1 is the only headline the model earns, and it needs its numbers corrected. Claim 2 ("three live answers, roughly equal") is an artefact of the base priors and should be withdrawn. Under the site convention the base posterior on the six surviving classes equals "delete the contradicted class and renormalise the prior" to within 0.08 in every class (0.03 bits of information). Each of the three answers is a monotone function of one unevidenced prior: P(none other ever) tracks the prior P(N_ever<1); "stuck" tracks the upper bound of W (0.02 to 0.54 across W ranges); "unnoticed" is about 0.9 times p_nonevident. In the project's own 400-draw scan the three are within a factor 2 of each other in 12% of draws (site) and 21% (SSA). Round 1's point-mass objection was moved, not fixed: "unnoticed" requires a median of 10^4.4 independent expansion waves per galaxy to be low-footprint together, and falls from 0.19 to 0.04 if each wave has its own chance of being evident. The base prior w_fast = 0.4 is the abiogenesis brief's posterior after the early-life datum, so L_early counts that datum twice; using the brief's pre-data values (0.09 to 0.23) gives P(none other ever) of 0.64 to 0.74 (site) and 0.45 to 0.61 (SSA) instead of 0.53 and 0.33. The SIA split is again the ratio of prior atoms. The single most important change is to replace claim 2 and Table B's point values with three curves (each answer against its controlling prior), scan bands, and the what-you-must-believe table.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Were the round 1 fixes made?

Fixed: (3) late-stage hard floors are replaced by a hierarchical per-universe p_exp, which also represents convergent restraint; (4) the local term now has p_here and the surveys use a limit curve built from the two studies; (9) classes are defined by mechanism and their boundaries are harmless (I tested Poisson versions); (10) the HWO likelihood includes f_site and false positives; (11) the 1/m! factor is in; the base is labelled 'modeller's judgement' in the camps table; a joint scan exists. I also checked the new SSA denominator integral and could not break it.

Moved, not fixed: (7) the point masses. q_feasible, doom and stealth became p_nonevident = 0.25 and p_stealth = 0.02, both universe-wide; 'unnoticed' is the prior times 1.1 to 2.2 exactly as 'infeasible' was the prior times 2.3, and the behavioural brief's conditional shares are still not used as a calibration target (model 0.41 for unnoticed against the brief's 0.08). (2) The single posterior vector became three vectors and a headline (claim 2) that restates the base vector; the scan bands and a must-believe table are not in the draft.

Not fixed: (1) the SIA split is still the ratio of prior atoms, the posterior still sits at the prior's 99.6th percentile of N, and the ESS is 0.15%; the draft labels the split as prior-set in claim 11 but prints two-figure SIA numbers in Table B and claim 2. (5) w_fast = 0.4 is still the abiogenesis brief's posterior used as a prior with L_early applied on top. (8) The existence-conditioned variant is computed in the results file but absent from the draft, so the empty-universe 0.20 still carries an unstated assumption of a universe at least 10^40 times the observable volume. (6) The scan exists but is off-centre, omits several knobs and its SIA rows are noise.

Over-corrected or newly created: the local term now carries the whole inference and the surveys almost none, partly because harvesting became an all-or-nothing atom per universe; the expansion prior's upper bound of 30 decades now decides the 'stuck' class in the way the 1e-4 floor used to decide 'restraint', in the opposite direction (stuck 0.25 to 0.33 where restraint was 0.01); the new artefact-survey row is arithmetic on a hard-coded 0.5.

Missing explanations

Critic’s own estimate of each answer

Presentation advice

Lead with four exhibits in place of Table B's point values and claim 2.

Exhibit 1, the data's whole contribution. Likelihood by class (site): evident settlement 0.004; all others 0.35 to 0.69. One sentence: on the surviving classes the posterior is the prior with the contradicted class deleted, to within 0.08 (0.03 bits); under SSA the spread is a factor 5 and the shift up to 0.15.

Exhibit 2, three curves, each answer against the prior that controls it. P(none other ever) against prior P(N_ever<1). 'Stuck' against prior P(p_exp<1e-5): 0.04, 0.10, 0.25, 0.33, 0.50 at tail mass 0, 0.08, 0.28, 0.38, 0.75. 'Unnoticed' against p_nonevident: 0.03, 0.09, 0.19, 0.27, 0.35 at 0.03, 0.10, 0.25, 0.40, 0.60, with a second line for per-wave evidentness (0.04 at 0.25).

Exhibit 3, scan bands (5/50/95%, project's 400 draws at n = 100,000). Site: empty universe 0.01/0.11/0.30; rare 0.18/0.36/0.49; en route 0.02/0.04/0.07; stuck 0.06/0.17/0.36; unnoticed 0.07/0.26/0.56; hidden 0.003/0.017/0.10; excluded 0.002/0.004/0.009; none other ever 0.26/0.52/0.74. SSA: empty 0.004/0.05/0.20; rare 0.07/0.21/0.36; en route 0.01/0.04/0.08; stuck 0.05/0.20/0.44; unnoticed 0.12/0.40/0.72; hidden 0.005/0.03/0.14; excluded 0.005/0.016/0.04; none other ever 0.10/0.30/0.56. SIA (ESS median 175, do not publish as numbers): stuck 0.00/0.09/0.52; unnoticed 0.34/0.80/0.98; hidden 0.006/0.05/0.32. My wider scan (240 draws; adds W_min, p_here, p_harvest_nonev, f_c floor, per-wave evidentness). Site: none other ever 0.26/0.57/0.81; stuck 0.10/0.28/0.57; unnoticed 0.004/0.04/0.30; hidden 0.001/0.013/0.23; empty 0.01/0.12/0.34. SSA: 0.11/0.35/0.67; 0.12/0.37/0.69; 0.006/0.06/0.42; 0.002/0.03/0.32; 0.004/0.06/0.25.

Exhibit 4, what you must believe (site unless stated).

Other points. Never print SIA class shares to two figures. Add the existence-in-volume column. Print the implied quantiles of p_exp (5% 2e-16, 25% 2e-6, median 0.007, 75% 0.13, 95% 0.67) instead of 'mean 0.12'. State next to every ablation number that it is for one ordering and one prior. Say in the text that no biological camp is favoured over another by more than about 3 and that the direction reverses between site and SSA.

Critic: the code audit

Overall verdict

The code is sound: model3.py does what it says to within about 0.015 on every site and SSA class, and no bug I found changes a headline number by more than that. A rerun of the 3M base matches the saved JSON exactly, and my independent re-implementation agrees to 0.0006 (site) and 0.0008 (SSA) on all seven classes. The weak points are in what is printed and claimed, not in the engine. The single most important change is to replace "three live answers, roughly equal" and the two-decimal point estimates with the ranges from the project's own 400-draw scan: the three answers are within a factor of 2 of each other in only 54 of 400 draws (site) and 82 of 400 (SSA), and P(none other ever in the Galaxy) spans 0.26 to 0.74. Second, the SIA column is not converged: a 50-times more efficient sampler gives 0.03 / 0.32 / 0.60 / 0.06 where the draft prints 0.03 / 0.33 / 0.59 / 0.05, the stored Monte Carlo s.d. is three times too small, and camp SIA rows are wrong by up to 0.05. Third, Table B and claim 1 carry transcription errors (prior mass of the excluded class is 0.31, not 0.27). The one modelling inconsistency with a visible effect is the early-life term in the no-hard-steps branch, worth +0.02 (site) to +0.04 (SSA) on P(none). All scripts are in the critic’s working folder (mine.py is the re-implementation; exactchain.py is the exact stage calculation).

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Were the round 1 fixes made?

Fixed. (1) The local 'nobody here' term now does the work (0.34 -> 0.51) and the draft says which terms are inert. (2) The galaxy-survey term uses covering-fraction curves built from the two studies (the cold curve equals the sum of 3 / limit from the fundamental-plane and Tully-Fisher results, zero above 0.93). (3) The early-life term is rate-based. (4) 1/h! is applied and only steps below 0.3 count as hard. (5) The HWO likelihood includes f_site. (6) Expanders from other galaxies, an en-route class and a continuous expansion prior replace the three atoms. (7) The SIA weight counts G-hosted civilisations only. (8) grabby.py and sdo.py are superseded by cosmo_tables, which I verified by brute force.

Not fixed. (1) SIA is still plain sampling (round 1 asked for pooling or stratifying); ESS is 4,702, the stored s.d. is three times too small, and the non-comparable SIA 'evidence' (1.1e6) is still saved. (2) The earliness likelihood exists only in the SSA column; the site column still has no host-star or date term. (3) The STUDY convergence tag is still attached to weights the study does not give, and the new 'Convergence-study steps' camp uses the withdrawn first-pass figures. (4) The existence-conditioned variant is computed in the JSON but absent from the draft.

Over-corrected or newly introduced. (1) Counting only 'still hard' steps on long windows makes saturated steps instantaneous, which inflates civilisations-to-date on K and M hosts (effect on classes about 0.01). (2) The gated branch's early-life term contradicts its own fixed delay (+0.02 to +0.04 on P(none)). (3) The head-start factor is now double-counted with the birth tables. (4) The SSA columns of three ablation rows are numerical garbage.

Presentation advice

  1. Lead with ranges from the 400-draw scan, not two-decimal base values, and show which four priors drive them (number and width of hard steps, P(fast abiogenesis), expansion-prior width, P(low-footprint)).
  2. State the numerical accuracy honestly: site and SSA classes are good to about +/-0.015 once model approximations are included (Monte Carlo error is 0.001); SIA to +/-0.002 only with the tilted sampler.
  3. Present SIA as a three-number function of the expansion and evidentness priors, and say that biology drops out entirely. A back-of-envelope check reproduces it: at N of about 1e9, P(p_exp below 1/N) is about 0.16 under the hierarchical prior, against 0.25 for low-footprint and 0.02 for stealth.
  4. Split claim 1's likelihood table into 'silence only' and 'timeline only' columns; the silence column (1.00 / 0.93 / 0.67 / 0.83 / 0.87 / 1.00 / 0.006) makes the point better than the combined one.
  5. Give the predictive probability beside every future-observation row and mark the artefact row as an assumption.
  6. Remove the SSA and SIA columns from ablation rows without the local term, and drop SIA from the scan table unless rerun.
  7. Generate every table in the report from the JSON by script; the draft already has four hand-copied errors.

Critic: a specialist in reasoning from our own existence

Overall verdict

The three columns are implemented correctly as far as they go, but the draft's framing of them is not defensible. 'site' is not a neutral or "existence as precondition" position: it is numerically identical (largest class difference 0.005) to SSA with a reference class of civilisations on Sun-like hosts, and the true precondition reading gives a very different table (0.28 on the class the draft says is ruled out). The headline "nobody else ever in the Galaxy: about 0.5" is therefore the answer of the one reference class that maximises it; across the SSA family I get 0.20 to 0.53, under SIA 0.00, and a credence-weighted blend of 0.17 to 0.29. The SIA column's leading answer ("settled but not evident", 0.6) rests on a universe-wide behavioural switch that makes a median of 10^7.7 independent expander origins all invisible; one claiming origin per million cuts it to 0.31. The model still has no observer-weighted (Doomsday) SSA and no constructed-observer class, both requested in round 1, and its "prospects" output (mean_p_exp about 0.09 in all three columns) is a pooled prior echo that hides a spread from 1e-9 to 0.04 for evident expansion. The single most important change: relabel the columns as reference classes, replace "about 0.5" with a school table plus a stated blend (about 0.2 to 0.3), and add the finding that the schools make different testable predictions (P(HWO biosignature among 25 planets) 0.19 / 0.26 / 0.83), which is what stops the fork from being paralysing.

Objections

Verdict on each headline claim

Claims that survive

Code errors

Missing explanations

Critic’s own estimate of each answer

Were the round 1 fixes made?

Fixed: (9) early-life likelihood is now rate-based; (11) SIA and SSA count Sun-like-host civilisations only; (12) intergalactic pre-emption via the LambdaCDM kernel; (8) the SSA column now carries the earliness argument and future-observation rows are run in all three schools. Partly fixed: (1) three co-equal columns exist, but claim 2 still headlines the 'site' value and 'site' still charges for pre-emption without an existence weight; I find it equals SSA with a Sun-like-host class, so it is a legitimate school under the wrong name. (2) Claim 11 concedes the SIA split is prior-set, yet claim 2 still prints 0.6 and no grid is shown. (4) An existence-conditioned variant is computed at one universe size and left out of the draft. (7) SIA still sits at the prior ceiling (N_ever 10^8.7) with no importance sampling. Not fixed: (3) no p_preempt parameter, and the local term is now load-bearing (0.34 to 0.51), which is the exposure round 1 warned about; (5) no observer-weighted SSA and no usable prospects axis; (6) no constructed-observer class and no presumptuous-philosopher caveat; (10) 'evidence' still shares one key across schools. Over-corrected: the SSA column now folds host typicality and far-future earliness into one undisclosed factor that moves the answer from 0.44 to 0.28 before any data; and the non-evident regime as a universe-wide switch gives SIA an escape that needs about 10^7.7 expander origins to be uniformly invisible.

Presentation advice

  1. Put the fork as one plain question: "Is Earth a random habitable planet that happened to produce us, or is it singled out because it produced us?" The first reading is self-indication: our existence is strong evidence that civilisations are common. The second is self-sampling: it is no evidence, and the answer then depends on whom we compare ourselves with.

  2. Say that the fork moves one number, P(no other civilisation has ever arisen in the Galaxy), and print it per school with my suggested credences:

School Credence P(alone in Galaxy)
Self-indication (SIA, full non-indexical conditioning) 0.40 0.00
Self-sampling, Sun-like-host civilisations (the old 'site') 0.15 0.53
Self-sampling, every civilisation past and future (the old 'ssa') 0.12 0.33
Self-sampling, civilisations to date 0.08 0.42
Self-sampling, observer-weighted (Doomsday), R = 1e6 0.10 0.23
Bare precondition / minimal class 0.05 0.40
None of the above (constructed observers, framework fails) 0.10 not computed

Blend over the computed schools: 0.22 (0.26 / 0.17 / 0.10 at SIA credence 0.3 / 0.5 / 0.7). Full blended class table: empty 0.08, rare 0.13, en route 0.04, stuck 0.33, unnoticed 0.38, hidden 0.03, claimed-remnant 0.02; with heterogeneous expanders 0.09 / 0.15 / 0.05 / 0.53 / 0.15 / 0.01 / 0.03. Fix the credences as inputs and label the blend as the project's all-things-considered figure.

  1. Lead with what no school disputes: evident claiming settlement of most sites is under 2%; deliberate hiding under 6%; expanders en route 2% to 6%; and, given others arose, the choice between 'expansion fails' and 'unnoticed' is a prior, the same in every school.

  2. Do not print a seven-way SIA split as a finding. Print "others certainly exist; which barrier is set by the prior" with the range (unnoticed 0.19 to 0.91 across camps), and add two sentences: SIA reaches this from the armchair (96% of its mass is the top 6.5% of the prior), and the same logic favours constructed observers.

  3. Add the bet: P(at least one biosignature among 25 HWO planets) is 0.19 / 0.26 / 0.83 and P(second origin in the Solar System) 0.54 / 0.69 / 0.96 by school. This is the answer to "paralysing": the columns are rival forecasts that the next two decades can score.

  4. Drop 'prospects for humanity' as a single number. If kept, give P(becoming an evident, system-claiming expander): 0.04 (Sun-like SSA), 0.03 (universal SSA), about 1e-9 (SIA), below 3e-4 (observer-weighted SSA), and say it is prior plus anthropics.

  5. Give each SSA column its own caveat: the universal class infers planetary lifetimes from typicality (0.72 that planets die within 15 Gyr); the Sun-like class discards the host-star evidence the project's own M-dwarf study measures; 'empty universe' needs a universe of 1e40 or more galaxy-equivalents.

Citations from memory, not re-checked for this review: Bostrom 2002 (Anthropic Bias; presumptuous philosopher), Neal 2006 (full non-indexical conditioning), Carlsmith 2021 (SIA versus SSA essays), Armstrong (anthropic decision theory), Grace 2010 (SIA doomsday), Gerig, Olum and Vilenkin 2013. The PhilPapers 2020 Sleeping Beauty split (roughly 28% thirder, 19% halfer, remainder undecided, as I recall it) is my basis for putting SIA-like views near 0.4 and not treating either school as the default.

Critic: the camp that holds “it only takes one”

Overall verdict

From this lens the draft headline "three live answers, roughly equal" is not defensible as worded; "any confident answer is a statement of priors" is, and more strongly than the draft says. Two of the three answers are hand-set prior masses passed through: "not evident" is the world-level coin p_nonevident = 0.25 (posterior 0.19, about 0.75 times the prior), and 0.16 of the 0.25 for "stuck" is the prior tail P(p_exp < 1e-8) = 0.17 multiplied by 1.7; under SIA the whole column is the normalised ratio of those masses. The non-evident class is a monoculture: its posterior worlds contain a median of 27,000 independently arisen expander lineages (interquartile range 218 to 6 million; 5 million Milky-Way-born under SIA), all assumed low-footprint by a single draw, with the chance of being evident capped at 0.3 however many there are. If each lineage chooses for itself, "not evident" falls from 0.19 / 0.28 / 0.59 to 0.04 / 0.05 / 0.06 (site / SSA / SIA) and P(no other civilisation ever in the Galaxy) rises from 0.53 to 0.62. That is the single most important change: make evidentness a per-lineage property plus an explicit common-cause prior, and report "stuck" split into a universal barrier (which also stops us) and "a few others, none happened to expand". My own position is weaker than Hart's: with priors I would defend, P(none other ever) is 0.61 (site) and 0.42 (SSA), ranging 0.48 to 0.74 as the two common-cause priors are varied, and it reaches 0.87 only if expansion is also assumed easy. Human-anchoring the expansion prior changed almost nothing numerically (stuck 0.250 to 0.251), because the model's 30-decade tail already behaves like a barrier prior of about 0.17; that objection is about labelling and derivation, not numbers. All scratch code and logs are in the critic’s working folder (model3x.py reproduces the base case exactly with hooks off).

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Were the round 1 fixes made?

Round 1 had no critic on this side, so I checked the adjacent ones. Fixed: expanders from other galaxies and an 'en route' class (Hansonian 1, 9); the floors on will and harvesting removed (sceptic 1, SETI optimist 2); an explicit evidentness term and an 'unnoticed' class (sceptic 2, optimist 3); a per-term ablation table; camps that change one lever each (sceptic 8c). Not fixed: (i) 'the split among universal-barrier classes is input, not output' (sceptic 4, Hansonian 6, optimist 9): the three atoms were replaced by a tail mass P(p_exp < 1e-8) = 0.17 and a regime coin of 0.25, and the stuck barrier part (0.161) is still prior times likelihood over evidence, with the SIA column exactly the atom ratio; (ii) Hansonian 7, an output for humanity's own prospects, is absent, and the prior moved further from the human-calibrated one in the longevity brief; (iii) sceptic 10, the barrier class has no observable consequence, still true, and my attempt to add one from the flyby data had no effect; (iv) the camps are no longer confounded with biology, but the two Hart-side levers are never crossed. Over-corrected: (a) the will floor of 1e-4 became a 30-decade prior; the sceptic asked for a range 'mirroring hard_step_decades', which in version 3 is 2-8, so expansion is now wider than any hard step; (b) low-footprint settlement was given 0.25 with the evident chance capped at 0.3, against 0.08 (0.01-0.30) in the project's behavioural brief, and as a world-level coin where that brief prescribes (1 - e)^N plus a common-cause Bernoulli; (c) the round-1 sceptic's own test showed that scatter between civilisations shrinks the barrier classes, and version 3 dropped scatter; (d) 'restraint is crushed' was replaced by 'nothing but evident expansion is discriminated', which is the opposite overstatement.

Presentation advice

Show the reader the three priors that carry the late-stage result as a prior-to-posterior table: universal barrier (0.17 implicit, posterior part of stuck 0.16), universal low footprint (0.25, posterior 0.19), deliberate hiding (0.02, posterior 0.02), for site, SSA and SIA, and say that the SIA column is their normalised ratio. Add one two-way table or figure: barrier prior (0.05-0.30) against low-footprint prior (0.02-0.25), shaded by P(none other ever); from my grid it runs 0.48 to 0.71 (site) and 0.29 to 0.53 (SSA). Split 'stuck' into three rows (universal barrier 0.161, many civilisations without a barrier 0.044, few civilisations 0.046) and rename the first 'a universal barrier stops sustained expansion, for us too'. Next to 'unnoticed', print how many independent expander lineages the class contains (median 27,000; 4.8 million Milky-Way-born under SIA) and the one-line requirement: fewer than about 1 lineage in 100,000 may be of the evident kind. Report P(humanity becomes a sustained expander) and P(p_exp < 1e-6) overall and by class; a reader who sees 'stuck 0.25' should be told it carries a median of 5e-11 for us. State the head-start limit in the form (per-planet probability) x (evident fraction) < 1e-9, and the flyby result as 'in a settled Galaxy the chance that a passing settled system leaves an evident presence must be below 2e-5'. Present the per-lineage variant as a second column beside the base table, not as a footnote; the table I would print is: preferred (per-lineage evidentness, low-footprint common cause 0.05, stealth 0.02, barrier 0.15, otherwise log-uniform 1e-5 to 1) site 0.228 / 0.358 / 0.043 / 0.290 / 0.055 / 0.020 / 0.005, none-ever 0.614; SSA 0.151 / 0.243 / 0.047 / 0.407 / 0.093 / 0.034 / 0.025, none-ever 0.419; SIA 0 / 0 / 0.021 / 0.678 / 0.215 / 0.086 / 0.001. Hawkish (0.02, barrier 0.05, log-uniform 1e-4 to 1, claiming favoured): site 0.290 / 0.414 / 0.050 / 0.179 / 0.030 / 0.030 / 0.008, none-ever 0.740; SSA none-ever 0.569. Concessive (0.10, barrier 0.30, log-uniform 1e-6 to 1): site 0.182 / 0.311 / 0.035 / 0.394 / 0.062 / 0.013 / 0.004, none-ever 0.512; SSA 0.318. Crossed with the biology-optimist camp the preferred package gives none-ever 0.12 and stuck 0.62, of which 0.57 is the barrier, which is the clearest way to show that optimistic biology plus non-exclusivity means a filter ahead. Correct the 0.27 in the base table to 0.31.

Critic: an expansion sceptic

Overall verdict

Version 3 delivered most of what this lens asked for in round 1, and under the site convention the three-family picture is defensible: P(no other civilisation ever in the Galaxy) stayed between 0.47 and 0.63 in every variant I ran. But the draft overstates what the data and the original studies do. The posterior is the prior with one class deleted, then tilted by Earth's timeline: that two-step calculation reproduces every class to within 0.02, the Tully-Fisher and fundamental-plane limits carry exactly zero weight (removing them or making them 100 times stronger changes nothing at three decimals), and the fill-time and head-start inputs move no class by more than 0.012. Two structural choices carry the headline split and both are over-corrections toward my own camp. First, 'not evident' is a universe-wide rule with prior 0.25; allowing a minority of expanders to be of the claiming kind, with the same ignorance prior used for expansion itself, cuts 'unnoticed' from 0.19 to 0.075 (site) and from 0.59 to 0.23 (SIA). Second, claiming settlement is assumed evident with probability exactly 1; under SSA a leak of one unclaimed site in a million brings the 'contradicted' class back at 0.12 to 0.33. Claim 4 quotes numbers its own referee withdrew and omits its conditions, and claim 5 calls limits 'first' that Annis 1999 and Zackrisson 2015 already had. The single most important change is to replace the two universe-level switches (claiming or non-evident; evident with certainty) with continuous quantities, a claiming fraction and a pocket fraction, with the SSA reference class made consistent, and to present 'stuck', 'unnoticed' and 'hidden' as one prior-split family.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Were the round 1 fixes made?

Item by item against the round-1 requests from this lens.

  1. Continuous treatment of self-sustaining, persistent, evident expansion: partly delivered. The floor on the will to expand and the feasibility switch are gone, replaced by one hierarchical p_exp prior, which is what I asked for as a minimum. Not delivered: any reproduction-number structure, bubble reach, or split by mode; p_exp is independent of regime, and 'persistent' and 'evident' are defined in, not modelled. In effect it is still a barrier with prior P(p_exp < 1/N) of 0.24 at N = 1e6.
  2. A class for 'settled or probed but unnoticed': delivered and over-corrected. It is a universe-wide rule with prior 0.25 and mean evidentness 0.047, so it passes through at 1.78 times its prior; a claiming minority cuts it to 0.03-0.12.
  3. Finite persistence: not delivered. Tested here: 0.07-0.10 of site mass if departed waves leave no trace.
  4. Hop-range-dependent fill time: under-delivered (speed-dependent only, capped at 1 Gyr) but immaterial in version 3. The round-1 expectation of +0.08 on restraint no longer holds because the propensity prior now spans dozens of decades; a 5 Gyr fill time moves 'stuck' by 0.01.
  5. Survey limits as curves: delivered in form. The warm curve is mis-sourced and the cold curve is a sum of unlike samples, but the term went from carrying the whole result in version 2 to +0.016 (+0.003 after the fix). The round-1 objection that the local term was inert is reversed: it now does all the work, by the assumption p_here = 1.
  6. Misleading study tags: the flyby tag on feasibility is gone and the head-start study now has a report. Remaining: the cold-curve tag implies weight the studies do not have (zero), and the warm curve cites Lacki 2016 for the wrong temperature band. Also fixed: per-term ablation table; hand-entered barrier Bernoullis removed; the sceptic camp changes one lever. Not fixed: the barrier class still has no observational test except a Galaxy-wide technosignature census. New in version 3: the SSA column is valid only when claiming settlement is evident with probability exactly 1.

Critic’s own estimate of each answer

Presentation advice

Lead with the four-row decomposition, not the class table: prior; minus the contradicted class; times Earth's timeline; all terms (P(none other ever) 0.44, 0.61, 0.505, 0.53). It shows the reader in one glance that one assumption and one data set do the work.

Say plainly what the original studies did and did not do. The head-start, flyby, Tully-Fisher and fundamental-plane studies close loopholes (not enough time; cold waste heat) but move the posterior by at most 0.012 and 0.000. A sophisticated reader will find this out; it is better stated by the authors.

Show 'stuck', 'unnoticed' and 'hidden' as one family, 'common but not expanding or not evident' (0.45 site), with a prior-determined split, and give each class as a prior-posterior pair. Quote the scan's 5-95% ranges next to every base number.

Rename 'stuck' to something like 'a shared barrier stops sustained expansion' and print the median propensity inside it (5e-11 per civilisation; 1e-15 under SIA) so nobody reads it as restraint by choice.

Add two rows beside the headline table: the claiming-minority row (unnoticed 0.19 to 0.075) and the tail-depth row for the expansion prior (stuck 0.08 to 0.33 as the maximum width goes from 8 to 60 decades).

Flag the SSA column as conditional on claimed galaxies having no unclaimed pockets, or fix the reference class and show both.

Report P(another civilisation in the Galaxy now): 0.22 site, 0.39 SSA. It is the number a SETI reader wants and the draft omits it.

In claims 4 and 5 use the refereed numbers and name the prior work (Lineweaver 2001, Zuckerman 2026, Annis 1999, Zackrisson et al. 2015).

Critic: an astrobiologist

Overall verdict

Version 3 delivered most of what my lens asked for in round 1, and the site column is robust to every biological correction I could run (0.50 to 0.58 for "no other civilisation ever in the Galaxy"). Three things are not defensible as drafted. First, the SSA column, and with it claim 7 and the "0.33 to 0.53 by anthropic convention" in claim 2, is an artefact of assuming that a K-dwarf planet is about 9 times (interquartile 3 to 44) more likely than an Earth twin to produce a civilisation; with defensible habitability assumptions SSA gives 0.52 to 0.55, the same as site. Second, claims 7, 8 and 9 and one named camp quote numbers that the project's own studies withdrew or that their referees rejected ("ceiling", "4.6 to 942", the 0.35/0.39/0.20/0.06 step posterior, "K dwarfs keep us in the first 1%"). Third, the headline 0.5 is the biological prior restated: in every camp I ran, the posterior is the prior plus 0.03 to 0.10, and defensible biologists span 0.24 to 0.82. The most important single change is to fix the long-lived-host treatment (persistence, abiogenesis and ultraviolet over 20 to 45 Gyr windows, and the cap prior) and then present claim 2 as conditional on a stated biological prior, with the prior printed beside it.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Presentation advice

Lead the biology with the 2x2 table that already exists in integrate3_results.json (fast or slow abiogenesis by gated or hard-stepped evolution): the cells disagree completely (fast and gated: none-ever 0.00; slow and hard-stepped: 0.87), and the reader should see that the cell weights are judgement.

Print the prior beside every posterior and say in one sentence that the observations move 'nobody else ever in the Galaxy' by 0.03 to 0.10 in every biological camp.

State the implied biological prior in plain numbers so it can be challenged. As coded: P(technological civilisation | rocky habitable-zone planet) has median 10^-9, 5-95% range 10^-48 to 10^-3 and a 1% chance of exceeding 1%; given an inhabited habitable planet, median 10^-4, range 10^-13 to 10^-1.5. The prior I would defend: P(life | habitable planet) bimodal, 0.4 (0.2 to 0.6) near 1 and the rest spread over 3 to 100 decades; P(technology | inhabited planet that stays habitable) median about 10^-3.7 with a 90% range of 10^-12 to 0.1 and a 6% chance of exceeding 10%; combined per rocky habitable-zone planet, fast-camp median 10^-4, overall 4% chance of exceeding 1%. It is about 46 decades wide. Swapping it in moves the site column from 0.53 to 0.51, so the table is robust to the centre of the biological prior and sensitive only to its camps (0.24 Mills-leaning, 0.82 Carter-leaning).

Split 'alone' into a sterile Galaxy (0.25) and an inhabited Galaxy with no other technology (0.24). Drop 'empty universe' as a headline number or give it as 0.08 to 0.29 with its driver named.

Mark the SSA column as conditional on the productivity of long-lived hosts until the model is fixed, and show the corrected value beside it.

Give every future-observation row its forecast probability and its false-positive assumption.

Do not attach a study tag to a prior the study does not support: the step-count weights and p_M_class are judgement.

Were the round 1 fixes made?

Fixed: rate-based abiogenesis with a timing likelihood derived from the same rate (a small exponent slip remains, effect under 0.01); fewer and shallower hard steps (prior mean 1.3, depth 2-8 decades) with a named Carter camp; the 1/m! ordering factor; f_site and the oxygen step in the HWO likelihood (forecast now 19%, a null is weakly informative); x_now set to 0.70-0.85; a host-star likelihood, though only inside the SSA weights; existence conditioning for the empty-universe row; the 2x2 table, which is computed but absent from the draft.

Partly fixed: the double-counted habitability factors (f_hz and f_rare merged into f_site, but f_persist and f_gate still multiply in the gated branch; removing f_persist there changes nothing, so this is cosmetic); the sterile against microbial split (computed as side statistics, not shown as a split of 'alone'); the M-dwarf ultraviolet penalty (folded loosely into h_M, none on lambda, none for K dwarfs).

Not fixed: the hybrid branch of hard steps plus gated delay; a late-arrival likelihood for the gated branch tied to a gate-time distribution; f_c charged on top of a cognitive last step; lithopanspermia in the second-genesis row.

Over-corrected or newly wrong: the 'Convergence-study steps' camp adopts the step posterior that round 1 took from the first-pass study and that the study has since withdrawn. The new K-dwarf class answers the host-star request but gives long-lived hosts a per-planet yield about 9 times Earth's (interquartile 3 to 44), which now drives the whole SSA column. The implied per-planet prior is almost unchanged from version 2 (median 10^-9.2 against 10^-9; P(above 1%) 1.1% against 2%); the headline moved from 0.75 to 0.53 mainly through the expansion prior, not through biology.

Critic: the studies as quoted in the draft findings

Overall verdict

The eight studies are sound and reproducible: I reran five pipelines in a scratch copy (timing, convergence, seti_meta, tf_kiii, mdwarf_early) and every output table matched the published one exactly, and I confirmed the flyby, headstart and fundamental-plane headline arithmetic independently. The draft findings are not faithful to them. Claims 4, 5, 7, 8 and 9 mostly quote first-pass numbers and phrases that each study's own referee struck and the revised report withdrew: "at any waste-heat temperature", "first limits", "11.1 +- 0.5", "72.5% (69 to 76%)", "ceiling", "4.6 to 942", "four or more", and a mislabelled "Sun-like hosts only" rank. Claim 5 as titled is false by its own study's revised text. Inside the model the studies carry almost no weight: deleting the two optical galaxy studies changes no posterior at three decimals, the head-start table changes P(none other ever in the Galaxy) by at most 0.004, and the radio and M-dwarf inputs by at most 0.02. The galaxy-survey step that does move the result comes mostly from a published near-CMB limit (Lacki 2016) applied to the wrong temperature branch. The one study-tagged input that matters is the hard-step prior, which the studies explicitly say they cannot constrain, and a posterior the convergence study withdrew is still run as a named camp. The single most important change is to rewrite claims 4 to 9 from the revised report.md texts with their conditions and prior-art credits, and to describe the studies as bounding and scoping the inputs rather than driving the answer.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Presentation advice

Ranking of the eight studies by new, defensible insight:

  1. timing: exact reproduction; the Snyder-Beattie table check (pending confirmation with the authors), the one-formula account of how Kipping's odds fall with more hard steps, and the two-convention split are new and feed the model's most sensitive data input.
  2. mdwarf_early: the table of critical M-dwarf weight against step count and the K-dwarf-cut dependence are new and honestly conditional.
  3. fp_kiii: the only new measurement at scale (114,000 galaxies), defensible if scoped to uniform dimming.
  4. flyby: the rendezvous-limited settlement calculation with measured velocities and its failure regimes are new; the rate and the exposure argument are not.
  5. seti_meta: a careful unified synthesis whose conclusion is known in outline.
  6. convergence: mainly a negative result, sensitive to grouping.
  7. tf_kiii: a larger repeat of Zackrisson et al. 2015 with the same unvetted limit.
  8. headstart: a reproduction of Lineweaver, and inert in the model.

Lead the report with timing and mdwarf_early, because they bear on the two levers that move the answer, and use fp_kiii as the showcase new measurement with its scope stated. Present flyby plus headstart as a conditional argument with prior-art credit.

State plainly that the original studies bound and scope the inputs rather than drive the result: deleting any of them changes P(none other ever in the Galaxy) by 0.02 or less, while the hard-step prior and the fossil-versus-LUCA dating move it by 0.06 to 0.18.

Most embarrassing finding a hostile expert would raise, per study:

Use the revised report.md files as the only source for quoted numbers, and show effective sample sizes beside every anthropic column.

Were the round 1 fixes made?

Fixed: the single cold-survey number (2,000 galaxies) was replaced by a covering-fraction curve built from the two optical studies' actual limits, and the three zero-count equivalents are correct to within 5%. Fixed but now inert: the head-start factor comes from the study, but it is misapplied to a count of arisen civilisations and changes results by at most 0.007. Over-corrected: round 1 asked for the convergence study's step posterior as a camp; version 3 added it, but the study has since withdrawn that posterior, so the camp name now misattributes a retracted result. Not fixed: study tags still present modeller judgement as study output (hard-step weights, M-dwarf class probability), and the cold curve carries the withdrawn 'any temperature' label. Not fixed and newly visible: the infrared survey curve is assigned to the wrong temperature branch, which accounts for most of the survey step in the ablation. Unchanged and fine: the M-dwarf and radio rows show almost no effect, and that held under every variant I ran. The misleading flyby tag flagged in round 1 is gone; the flyby study now enters only through the expansion-speed floor, which its results support down to about 1.6e-4 c.

Critic: a believer in expanding aliens (Robin Hanson’s “grabby aliens”)

Overall verdict

Version 3 delivered most of what round 1 asked for, and the cosmological machinery is sound: the tables reproduce the mdwarf_early ranks (n=4, 30 Gyr K window: 1.01% against the study's 1.03%), N_reach agrees with Kipping 2026 (6.9e5 at 0.1c, abstract fetched), and under Hanson's own premises the SSA column lifts P(expanders hold at least 1% of the universe) from 0.03 to 0.35. The draft headline claims are not defensible as worded from this lens, for three reasons. First, the SSA column is a "why a G star" calculation, not an earliness one: giving K dwarfs the same 5.6 Gyr window as G stars returns SSA P(none other ever in the Galaxy) to 0.53 (site 0.53), a date-only SSA gives 0.49, and switching the expander deadline off moves no SSA class by more than 0.012. So the "0.33 to 0.53 by anthropic convention" range is one astrophysical assumption about late-K planets. Second, "expanders en route" at 0.04 is the prior (0.033) on a two-decade slice of x; P(expanders hold at least 1%) is 0.18 / 0.25 / 0.42 (site / ssa / sia) and is not in the draft, and 42% of it has intergalactic speeds below 0.01c, where the smooth kernel is unphysical. Third, the "stuck" answer (0.25 to 0.33) is the tail of the expansion prior (median p_exp 5e-11) and falls to 0.01-0.05 under the project's own expansion brief. The single most important change is to split and relabel the SSA column (date-only next to date-plus-host, with a prior on K-dwarf habitability and window) and to report P(expanders hold at least 1%) by regime and speed in every table. Scripts are in the critic’s working folder (model3x.py is an instrumented copy that reproduces the base run exactly). model3.py was edited at 04:50 UTC during my run (Wexp added to the kept samples); results were identical before and after.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Presentation advice

Lead the expansion section with one number per convention that the draft currently omits: P(expanders hold at least 1% of the universe) = 0.18 / 0.25 / 0.42, then split it by regime (claiming 0.03 / 0.04 / 0.02; low-footprint or hidden 0.15 / 0.21 / 0.40) and by speed (v at least 0.1c: 0.05 / 0.07 / 0.10). Say plainly which rows are priors restated: en route (prior 0.033, posterior 0.041), stuck (the tail of the expansion prior below 1e-6), unnoticed (proportional to the 0.25 low-footprint prior). Show the SSA column twice, date-only and date-plus-host, and name the K-dwarf window assumption next to it. Add a short "prospects for humanity" box: median model-implied chance of ever becoming a sustained expander 4e-4 (site) or 1e-4 (ssa), mean 0.09; P(fewer than one civilisation in a million ever expands) 0.36-0.42; P(no other civilisation ever in the volume we could reach) 0.23-0.27 (site), 0.14-0.16 (ssa); P(no expander has yet started in it) 0.61-0.66, 0.50-0.54, 0.22-0.25 (sia); median time to an even chance of meeting claiming expanders, where they exist, 13-15 Gyr, with one in five such worlds never meeting us. Add the expansionist camp table from the sixth objection and state its lesson: expansionist priors give Hart and Tipler (alone in the Galaxy at 0.84) or ubiquitous low-footprint expanders (0.47-0.63), and give Hanson's en-route world (0.25-0.32) only with several hard steps, long-lived planets and SSA together. Rename the "contradicted" row or redefine it so that it cannot carry posterior mass. Print the speed prior beside any statement about speed; the posterior P(v > 0.3c) among claiming en-route worlds equals the prior.

Were the round 1 fixes made?

Fixed and correct: (1) expanders from other galaxies now pre-empt us through x = RHO_GAL v^3 p_exp q_ig sum(W K0); the kernel and N_reach check out against Kipping 2026. (5) The Bayes factor is gone. (6) The feasibility, doom and will atoms are replaced by one continuous prior on p_exp. (10) Carter terms count only steps that are still hard (p < 0.3 over the window). (9, partly) An en-route class exists and hidden or unnoticed arrivals may come from another galaxy.

Fixed but mislabelled or over-corrected: (2) A birth-date and host likelihood exists and reproduces the study's ranks, but it is implemented as the G-host share, so the date contributes nothing (none-ever 0.515 with host not conditioned, against site 0.532) and the host does everything. (3) K dwarfs were added as round 1 asked, but as a certainty with a step at 0.75 Msun and a fixed 5.6 Gyr for every G-class planet; that one assumption now produces the entire site-to-SSA gap. (4) Two anthropic branches exist, but the SSA branch's deadline does nothing at base (classes move by at most 0.012 with it switched off). (6) The continuous p_exp prior reaches 1e-30, which round 1 asked for, but the draft now reports its tail (the stuck class, median 5e-11) as a finding instead of labelling it as prior, which round 1 also asked for. New hand-set atoms have replaced the old ones: p_cap_short 0.5, q_ig 0.6, p_nonevident 0.25.

Not fixed: (1, part) the speed prior: round 1 asked for uniform 0.1-0.99c or log-uniform 0.01-0.99c; version 3 uses log-uniform from 1e-4 c for intergalactic travel, and q_ig is 0.6 instead of about 0.8. (7) Humanity's prospects: mean_p_exp is in the results file but nothing is in the draft, and P(first expanders in our reach volume) is not computed. (8) The visibility module is right only above 0.075c and the speed prior is not printed beside speed statements (harmless numerically). (9) No meeting-time distribution; "empty universe" still uses the observable universe rather than the reach volume (0.20 against 0.23-0.27 for the reach volume, so the difference is small); P(expanders hold at least 1%) is computed but not reported per camp in the draft. Correlated timing is still absent.

Critic: claims of novelty and the citations

Overall verdict

The draft headline claims are not defensible as written from this lens, mainly because FINDINGS_DRAFT.md (02:52) predates the revised study reports (05:02) and still carries first-pass numbers and novelty claims that the project's own referees and revised reports withdrew. Claims 4, 5, 7, 8 and 9 each contain at least one statement the corresponding report.md now contradicts. The worst is claim 5: "the first limits that do not depend on the waste-heat temperature" is false, because Annis 1999 and Zackrisson et al. 2015 published temperature-independent optical limits and the project's own Tully-Fisher limit weakens above about 250 K. Most "original data" tags should read "reproduction with new data" or "new in degree"; the three items that look new after my searches are the fundamental-plane search at 1e5-galaxy scale, the apparent e^-k / 10^-k slip in Snyder-Beattie et al. 2021 Tables 2-3, and the clustered reanalysis of Vermeij 2006. One model input is mis-cited: warm_curve applies Lacki 2016's limit for screens just above CMB temperature (an unrefereed preprint) to waste heat at 100-600 K. None of this moves the posterior by more than about 0.02, and I tested that removing the project's optical limits or rescaling the head-start fraction moves P(no other civilisation ever in the Galaxy) by 0.001. The single most important change is to rewrite section C from the revised study reports with a prior-work credit on every claim, and to say plainly that the original studies check inputs and do not drive the answer.

Objections

Claims that survive

Verdict on each headline claim

Code errors

Missing explanations

Critic’s own estimate of each answer

Presentation advice

Use three fixed novelty labels and apply one to every claim: 'reproduction with new data', 'new in degree', 'new'. By my searches only three items earn 'new': the fundamental-plane search at scale, the Snyder-Beattie table inconsistency, and the clustered Vermeij reanalysis. Put a prior-work table in the report with four columns: claim, closest published result and its number, this project's number, change in P(no other ever in the Galaxy) when the input is removed. The last column is the honest answer to 'what did the original research add': 0.001 for the optical galaxy limits, 0.001 for the head-start census, 0.00 to 0.02 for radio. Mark every unrefereed source as a preprint at the point of use (Lacki 2016, Kipping 2025b and 2026, Curtis et al. 2026, Olson & Ord 2021, Sandberg, Drexler & Ord 2018). State the temperature regime beside every galaxy limit: near-CMB (Lacki), 100-600 K (Griffith, Curtis), far-infrared (this project). Never write 'first' without naming Annis 1999 and Zackrisson et al. 2015 in the same sentence. For the Snyder-Beattie finding, write 'apparent', say the authors were not contacted, and contact them before release. Generate section C from the study result files so stale numbers cannot recur.

Were the round 1 fixes made?

Round 1 had no literature lens, so I checked the round-1 objections that touch citations and survey limits. Fixed: the single 'N = 2,000 at any temperature' cold limit was replaced by a covering-fraction curve built from the fundamental-plane and Tully-Fisher effective samples, zero above 0.93 (line 73); expanders from other galaxies were added, and the kernel reproduces Kipping 2026's published thresholds to within 15% when I feed it his assumptions. Fixed in the wrong place: the study reports absorbed their referees' novelty corrections (Zuckerman 2026, Fernandez-Puig 2026, Hanson 2021, Lineweaver, Legassick, Lacki 2019, Bains & Schulze-Makuch), but FINDINGS_DRAFT.md did not; 'any temperature' was withdrawn in tf_kiii yet survives in claim 5 and in the model3.py comment. Mis-implemented: round 1 asked for 'the Lacki/Griffith curve (warm)', and v3 did exactly that, which bakes in a temperature-regime error that started in gaps_and_corrections.md section 7; Lacki's curve belongs to near-CMB screens. Not fixed, but immaterial: round 1 noted the Milky Way analogue is a disc while the fundamental-plane sample is early types; the cold curve still sums both, and using Tully-Fisher alone changes site P(none) from 0.532 to 0.531. Not fixed: the synchronised-timing hypothesis (Annis; Cirkovic & Vukotic) raised in round 1 has no variable in model3.