<?xml version="1.0" encoding="UTF-8"?>
<article xmlns:xlink="http://www.w3.org/1999/xlink">
<front><article-meta>
<title-group><article-title>Adversarial-Aware Population Search for Cybersecurity Decision Tuning with a Finite Attack Surrogate</article-title></title-group>
<contrib-group>
<contrib contrib-type="author"><name><surname>Harrison</surname><given-names>David R.</given-names></name><xref ref-type="aff" rid="aff1"/></contrib>
<contrib contrib-type="author"><name><surname>Saleh</surname><given-names>Aisha B.</given-names></name><xref ref-type="aff" rid="aff2"/></contrib>
<contrib contrib-type="author"><name><surname>Iyengar</surname><given-names>Vikram</given-names></name><xref ref-type="aff" rid="aff3"/></contrib>
<contrib contrib-type="author"><name><surname>Hoffmann</surname><given-names>Lea</given-names></name><xref ref-type="aff" rid="aff4"/></contrib>
<aff id="aff1">Department of Computer Science, University of Cape Town, Cape Town, South Africa.</aff>
<aff id="aff2">College of Engineering, Qatar University, Doha, Qatar.</aff>
<aff id="aff3">Department of Computer Science and Engineering, Indian Institute of Technology Bombay, Mumbai, India.</aff>
<aff id="aff4">CISPA Helmholtz Center for Information Security, Saarbrucken, Germany.</aff>
</contrib-group>
<abstract><p>Cybersecurity decision thresholds and ensemble weights can be tuned under an adversarial loss, but doing so requires an explicit attacker and evaluation protocol. This manuscript describes Adversarial-Aware Population Optimization (AAPO), an outer population search using differential-evolution, particle-swarm and Lévy-style updates. Its supplied pseudocode evaluates each candidate through an average of projected-gradient attack losses across batches and restarts. That finite surrogate is below the exact constrained worst-case loss on the same inputs; it is not a certificate for the stated min–max objective or a demonstrated query-limited grey-box adversary. In the supplied MNIST summaries at an L∞ budget of 0.1, robust accuracy is 80.1% for AAPO and 74.2% for the Madry-PGD-trained comparator, a difference of 5.9 percentage points. Reported pairwise statistics and sensitivity values are retained as source observations, but their test units, raw ranks and execution inputs require reconciliation. In particular, the seven published mean ranks total 29.90 rather than 28, and the stated Nemenyi critical difference of 1.94 does not follow from seven methods and eight independent blocks. Source figures and tables also disagree on several comparator accuracies. The method is consequently presented as a proposed decision-layer tuning procedure with preliminary, unverified benchmark summaries; publication-level superiority, certified L∞ robustness and optimizer guarantees await code, data and corrected statistical outputs.</p></abstract>
<kwd-group kwd-group-type="author"><kwd>Adversarial machine learning</kwd><kwd>Population optimization</kwd><kwd>Decision thresholds</kwd><kwd>Finite PGD attack</kwd><kwd>Intrusion detection</kwd><kwd>Statistical comparison</kwd></kwd-group>
</article-meta></front>
<body>
<sec id="sec-1"><label>1</label><title>Introduction</title>
<p>Decision parameters such as ensemble weights and alarm thresholds influence the behavior of machine-learning security pipelines. Particle swarm optimization <xref ref-type="bibr" rid="ref-1">[1]</xref>, differential evolution <xref ref-type="bibr" rid="ref-2">[2]</xref> and SHADE <xref ref-type="bibr" rid="ref-3">[3]</xref> offer population updates for nonconvex tuning, but using a clean-input objective does not evaluate evasion risk. Evasion can reduce classifier accuracy under a specified set of feasible input changes <xref ref-type="bibr" rid="ref-4">[4–7]</xref>. Whether a new outer optimizer improves upon matched baselines is an empirical question about the actual decision variables, attack access and evaluation budget, not a consequence of its population-based construction.</p>
<p>A robust-optimization formulation minimizes an expectation of an inner constrained maximum <xref ref-type="bibr" rid="ref-5">[5]</xref>. A finite projected-gradient attack finds a feasible candidate and therefore only a lower estimate of that maximum on the evaluated inputs. The source algorithm additionally averages losses over separate restarts rather than selecting the highest-loss restart. This distinction changes the optimization target. Gradient-free search can handle mixed or discontinuous decision components, although its performance and computational cost must be established with identical base classifiers, attacker access and budgets <xref ref-type="bibr" rid="ref-1">[1-3]</xref>.</p>
<p>We examine four elements of the supplied research record. First, we state the decision-layer objective and distinguish the proposed grey-box deployment threat model from the candidate-specific gradient access used for offline tuning. Second, we describe the outer operator portfolio and its restart-mean attack surrogate. Third, we retain the reported CICIDS2017 and MNIST summaries, clearly separating feasible-attack accuracy from Gaussian L2 smoothing results <xref ref-type="bibr" rid="ref-8">[8–10]</xref>. Fourth, we audit the comparison arithmetic, rank analysis, source images, cost accounting and claimed suboptimality estimate. Raw per-seed outputs, executable code and a defined input-feature feasibility model are needed to reproduce and validate the numerical claims.</p>
<p>The contribution is a specified workflow for decision-layer tuning against a finite attack search, together with a testable account of what evidence would support a robust advantage. It is not a general security guarantee. Section 2 introduces the relevant attack and comparison methods; Sections 3–5 give the objective, search sketch and recorded evaluation design; Section 6 presents the supplied observations with their unresolved conflicts; Sections 7–9 delimit interpretation and requirements for validation.</p>
</sec>
<sec id="sec-2"><label>2</label><title>Background and Related Work</title>
<sec id="sec-3"><label>2.1</label><title>Adversarial Machine Learning: Attacks and Defences</title>
<p>Adversarial examples expose classifier sensitivity to crafted inputs <xref ref-type="bibr" rid="ref-4">[4]</xref>, <xref ref-type="bibr" rid="ref-11">[11]</xref>. Projected Gradient Descent (PGD) evaluates a first-order attack inside a chosen feasible set <xref ref-type="bibr" rid="ref-5">[5]</xref>, while Carlini–Wagner methods and AutoAttack supply complementary empirical challenges <xref ref-type="bibr" rid="ref-6">[6]</xref>, <xref ref-type="bibr" rid="ref-10">[10]</xref>. Weak or obfuscated gradients can mislead empirical assessment <xref ref-type="bibr" rid="ref-12">[12]</xref>. Madry-style adversarial training modifies classifier weights and differs from subsequent tuning of fixed decision thresholds. Ensemble adversarial training is another classifier-level approach <xref ref-type="bibr" rid="ref-13">[13]</xref>. Gaussian randomized smoothing supplies certificates for a separately defined smoothed classifier against L2 perturbations, conditional on its probability estimation procedure <xref ref-type="bibr" rid="ref-8">[8]</xref>; it does not directly certify the L∞ classifier and attack used in the tables.</p>
</sec>
<sec id="sec-4"><label>2.2</label><title>Population-Based and Evolutionary Methods in Adversarial ML</title>
<p>Differential evolution, SHADE and particle-swarm updates are established search components <xref ref-type="bibr" rid="ref-1">[1-3]</xref>. Their use in Adversarial-Aware Population Optimization (AAPO) does not itself prove a new saddle-point algorithm or convergence on a mixed decision space. The relevant methodological distinction is the candidate scoring rule: a finite PGD attack is embedded in each outer fitness evaluation <xref ref-type="bibr" rid="ref-5">[5]</xref>. Its interpretation depends on whether gradients follow the full candidate-specific prediction pipeline, how invalid feature perturbations are repaired, and whether the same evaluation budget is applied to each comparator. Those implementation details are absent from the supplied execution record.</p>
</sec>
<sec id="sec-5"><label>2.3</label><title>Robust Intrusion Detection</title>
<p>CICIDS2017 is a relevant source dataset for network intrusion detection <xref ref-type="bibr" rid="ref-9">[9]</xref>. The manuscript also presents MNIST image classification as a second benchmark, but feature-vector perturbations for network flows need validity constraints beyond a simple L∞ box to correspond to realizable packets. The author reports an additional UNSW-NB15 analysis in an appendix that is not present in this supplied document. No cross-dataset result is therefore used here. The deployed decision layer, base-model weights, feature preprocessing and attack feasibility must be archived to interpret a cybersecurity benefit.</p>
</sec>
<sec id="sec-6"><label>2.4</label><title>Statistical Methodology for Algorithm Comparison</title>
<p>For genuinely independent problem blocks, the Friedman and Nemenyi procedures compare ranks across algorithms; Demšar gives the reference critical-difference construction <xref ref-type="bibr" rid="ref-14">[14]</xref>. Repeated random seeds on the same datasets or classes are not automatically independent datasets. Paired tests, effect sizes and bootstrap intervals require the raw paired observations and an explicit sampling unit. Holm correction must state its test family and whether exact or asymptotic p-values were used <xref ref-type="bibr" rid="ref-15">[15]</xref>. The supplied rank and pairwise summaries are treated as reported values until those inputs are recovered. Morris elementary effects screen input sensitivity through one-factor changes along trajectories <xref ref-type="bibr" rid="ref-9">[9]</xref>; a trajectory for eight parameters uses nine model evaluations, not nine for each parameter.</p>
</sec>
</sec>
<sec id="sec-7"><label>3</label><title>Problem Formulation</title>
<sec id="sec-8"><label>3.1</label><title>Threat Model and STRIDE Mapping</title>
<p>The intended attacker perturbs deployment inputs within a stated L∞ budget and has limited query access. The source calls this setting grey-box because the attacker may know the classifier family but not the deployed decision vector. The specified PGD inner loop, however, differentiates a candidate-dependent loss using the optimizer&apos;s current w and true labels. That is a defender-side attack surrogate with stronger information, not an implementation of the unknown-w, Q-query deployment attacker. No exact Q value, query accounting or transfer test is supplied. Limited-query black-box evaluations require their own protocol <xref ref-type="bibr" rid="ref-16">[16]</xref>.</p>
</sec>
<sec id="sec-9"><label>3.2</label><title>Evasion vs Poisoning and the Limits of Grey-Box Defensibility</title>
<p>The scope is test-time input evasion <xref ref-type="bibr" rid="ref-7">[7]</xref>. Neither changing the training set nor compromising code is modeled. Gaussian smoothing, if implemented on a smoothed base classifier, offers an L2 statement for that classifier <xref ref-type="bibr" rid="ref-8">[8]</xref>. No white-box, L∞ or production-system certificate is established by the proposed decision-layer search. For CICIDS2017, normalized feature perturbations must additionally map to valid, causally consistent traffic records. Otherwise the experiment is a numerical feature-space stress test rather than a packet-level adversary.</p>
</sec>
<sec id="sec-10"><label>3.3</label><title>The Min–Max Formulation</title>
<p>Let w be a defender decision vector and δ an admissible input perturbation. The ideal loss and a specified L∞ feasible set are written below. The expectation is over the target data distribution, whereas an empirical finite-batch attack acts only on the provided sample. The admissible set must also enforce data-domain constraints where coordinates encode categorical values, counts or protocol relations <xref ref-type="bibr" rid="ref-5">[5]</xref>.</p>
<p>R(w; ε) = (x,y)∼ [maxℓ(g(h(x + δ; θ), w), y)] , Δε = {δ: ∥ δ ∥∞≤ ε}.</p>
<p>δ∈Δε</p>
<p>The ideal outer problem minimizes R(w; ε). A PGD return δ̂ is feasible, so its per-input loss is at most the exact inner maximum; this is a lower estimate, not the claimed stochastic upper bound <xref ref-type="bibr" rid="ref-5">[5]</xref>. Random starts and larger K may find a stronger feasible attack but give no uniform approximation guarantee. The scaling of estimation variance as 1/(B·R) would need independent losses or an explicit covariance model; restarts on the same input share dependence. The source&apos;s finite score is thus a training surrogate for the intended robust objective.</p>
</sec>
<sec id="sec-11"><label>3.4</label><title>Robust Fitness Aggregation</title>
<p>The source algorithm scores candidates by the mean loss over B inputs and R PGD restarts. For a fixed batch and returned attacks, restart mean ≤ maximum returned loss ≤ exact constrained maximum, sample by sample. Choosing the maximum returned loss usually produces a stronger empirical attack than taking the mean, though neither is an upper bound on the exact worst case. Averaging may smooth the observed score; it is not generally unbiased for the maximum. The source also describes a separate held-out attack batch without identifying that batch, its reuse, independence from outer selection or how trial and incumbent candidates share the same random draws. Those choices determine selection bias and score variance.</p>
<fig id="fig1"><label>Figure 1</label><caption><p>Source-supplied schematic of the AAPO proposal.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:3:66,450,537.1,696.4"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>Its right-hand operator box and some labels are cropped in the original bitmap. The figure shows an offline candidate-specific PGD surrogate and adaptive outer search; it does not document a query-limited deployment attack or a worst-case loss certificate. The original scientific image is retained unchanged pending the editable plotting source (<xref ref-type="fig" rid="fig1">Fig. 1</xref>).</p>
</sec>
</sec>
<sec id="sec-12"><label>4</label><title>Proposed Approach</title>
<sec id="sec-13"><label>4.1</label><title>Algorithm Overview</title>
<p>The source describes a population of 30 candidate decision vectors, up to 300 generations, and three operators. Each candidate is scored with a finite-batch, ten-restart PGD loss mean; reported operator credits then guide a softmax choice. Feasible projection and discrete ranking are described as repair operations. The exact update pseudocode, data-dependent attack gradient, candidate caching, common randomness and stopping logic require an executable implementation. A single candidate-specific gradient routine cannot be assumed to handle discontinuous rule priorities without a documented relaxation or surrogate.</p>
<p>A change in the current population does not by itself make a fixed objective nonstationary. Different attack batches, random starts, adaptive preprocessing or changing base models could make observed scores vary over generations. The rationale for recency-weighted operator credit is therefore a design hypothesis until the fitness sampling and controlled ablations are documented. Operator attribution also requires comparing accepted trial values against incumbent values under matched attack draws.</p>
</sec>
<sec id="sec-14"><label>4.2</label><title>Operator Portfolio and Credit Update</title>
<p>The proposed portfolio uses DE/rand/1 <xref ref-type="bibr" rid="ref-2">[2]</xref>, a particle-swarm update <xref ref-type="bibr" rid="ref-1">[1]</xref> and a Lévy-style trial perturbation. The source specifies α = 1.5 for the latter, recency factor γ = 0.7, and an operator softmax with temperature raised when population diversity declines. These are design parameters rather than derived optimum values. The variable x in the reported scale 0.05·(x_ub−x_lb) must be resolved against w coordinates, simplex projection and mixed discrete units. Without synchronized attacks on incumbent and trial, credit differences can reward favorable attack noise instead of genuine improvement.</p>
</sec>
<sec id="sec-15"><label>4.3</label><title>Diversity Management and Stopping</title>
<p>The source monitors ten-bin marginal entropy and mean pairwise L2 distance, stopping after both fall below five percent of initial values for 25 generations or at generation 300. These are population diagnostics, not proof of convergence. Initial entropy can be zero in a constrained dimension; bin edges, normalization and treatment of zero baselines must be specified. Marginal entropy and pairwise distance may also hide distinct high-dimensional search configurations.</p>
</sec>
<sec id="sec-16"><label>4.4</label><title>Pseudocode</title>
<p>Algorithm 1 records the author&apos;s search sketch. It evaluates each candidate by summing the losses from ten PGD restarts and dividing by their count, then uses a credit-weighted operator and accepts lower estimated scores. The notation PGD-Attack must state whether it differentiates through the candidate&apos;s decision rule, which true label it uses, how the L∞ box is projected onto valid input features, and how it budgets queries. AutoAttack is named as an additional empirical evaluator <xref ref-type="bibr" rid="ref-10">[10]</xref>, but the supplied record gives neither per-attack results nor the executable configuration needed to test transfer or masking.</p>
<p>Algorithm 1. Source-reported AAPO workflow (implementation to be verified).</p>
<p>Input: population N, generations T, attack budget ε, PGD steps K, restarts R, batch B 1. Initialize feasible decision candidates and operator credits.</p>
<p>2. For each generation and candidate, generate feasible PGD attacks on B records with R starts; average their observed losses.</p>
<p>3. Update operator credits from reported fitness changes and compute diversity indicators.</p>
<p>4. Propose a DE, PSO or Lévy-style trial, project onto feasible decision variables, and compare under a defined common attack batch.</p>
<p>5. Accept an improving trial according to the chosen finite attack score.</p>
<p>6. Stop at T or at the source&apos;s sustained diversity threshold; return the lowest scored candidate.</p>
<p>This sketch does not specify executable gradients for mixed decision variables, query budget Q, valid network-flow perturbations or common-random-number controls. Those must be supplied before reproducing the proposed algorithm.</p>
</sec>
<sec id="sec-17"><label>4.5</label><title>Complexity</title>
<p>If one candidate evaluation uses B inputs, R starts and K gradient steps, the inner loop entails O(NBRK) input-gradient steps per generation, each priced by the base classifier and input dimension. Treating d, the number of decision parameters, as the PGD gradient dimension conflates decision and input spaces. Source values N = 30, B = 64, R = 10, K = 100 and T = 300 imply 1,920,000 sample-level PGD steps per generation before trial rescoring and 576,000,000 such steps for a full 300-generation run, if every loop is executed as written. B samples may be evaluated in parallel mini-batches, so this is not a count of distinct accelerator kernels or wall-time units. These figures do not by themselves verify the reported 7.4- or 11.6-second generation times or 38-/58-minute totals. The 7×10⁴ claimed relative-cost factor also depends on actual update and backward-pass costs; hardware logs and code are required.</p>
</sec>
</sec>
<sec id="sec-18"><label>5</label><title>Experimental Setup</title>
<sec id="sec-19"><label>5.1</label><title>Datasets, Baselines, and Metrics</title>
<p>The source identifies CICIDS2017 <xref ref-type="bibr" rid="ref-9">[9]</xref> and MNIST as the evaluated datasets. It describes a chronological 70/15/15 split for network flows, a three-model CICIDS ensemble with weights and an alert threshold, and an MNIST classifier with per-class thresholds. These statements require indices, leakage checks, trained model states and preprocessing. The manuscript uses L∞ input budgets 0.05, 0.1 and 0.2, but gives no unit-scale convention for heterogeneous network-flow fields or categorical validity. Its stated decision dimension d ∈ {8,16} does not follow from three ensemble weights plus one threshold (four) and ten class thresholds (ten); any additional variables must be enumerated. The claimed UNSW-NB15 appendix is absent.</p>
<p>The supplied comparison names GA, PSO <xref ref-type="bibr" rid="ref-1">[1]</xref>, DE <xref ref-type="bibr" rid="ref-2">[2]</xref>, SHADE <xref ref-type="bibr" rid="ref-3">[3]</xref>, CMA-ES <xref ref-type="bibr" rid="ref-17">[17]</xref> and a Madry-PGD-trained model <xref ref-type="bibr" rid="ref-5">[5]</xref>. Baseline roles differ: adversarially trained classifier weights are not merely another decision-vector optimizer. Equal N and T cannot establish equal gradient calls or wall time when one baseline trains its classifier and another tunes thresholds. Clean and PGD-attack accuracies are retained in the source figures and tables as reported. Randomized smoothing <xref ref-type="bibr" rid="ref-8">[8]</xref> concerns a separately specified L2 smoothed classifier; its radius must be validated through class-probability bounds and cannot be directly compared with L∞ accuracy. Statistical units are left unresolved by the competing references to thirty seeds and eight problem instances.</p>
</sec>
<sec id="sec-20"><label>5.2</label><title>Seeds, Hardware, and Reproducibility</title>
<p>The source lists thirty seeds, an A100 GPU and library versions, but supplies no runnable repository, public deposit identifier, split indices, trained checkpoint or Docker image. These details are a recorded protocol rather than evidence that the reported execution was reproduced. A complete release must include the exact source code and environment lockfile, base models, preprocessing, feature-repair rules, full attacks, initial states, per-seed predictions, raw paired observations and generated figures. The stated release and Zenodo deposit remain unverified.</p>
</sec>
<sec id="sec-21"><label>5.3</label><title>Threat-Model Coverage Matrix</title>
<p>Checkmarks do not establish tested attack coverage or certification. The unknown-w, query-limited setting, AutoAttack configuration, L2 smoothing classifier and feature-domain validity need separate evidence; the matrix should be revised from executable evaluations before publication (<xref ref-type="table" rid="tab1">Table 1</xref>).</p>
<table-wrap id="tab1"><label>Table 1</label><caption><p>Original author&apos;s threat-coverage matrix, retained as a hypothesis map.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:5:60.5,306.8,537.1,407.9"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
</sec>
<sec id="sec-22"><label>6</label><title>Results and Statistical Analysis</title>
<sec id="sec-23"><label>6.1</label><title>Convergence under Adversarial Perturbation</title>
<p>The supplied <xref ref-type="fig" rid="fig2">Fig. 2</xref> depicts median attack-surrogate loss over thirty purported runs at ε = 0, 0.05, 0.1 and 0.2. Larger ε would weakly enlarge an identical exact inner feasible set for a fixed w and data, but the chart plots separately optimized approximate scores, so monotone visual ordering is a descriptive observation. The attribution of wider bands or slower decline to operator credits, landscape roughness and attack variance requires per-generation attack draws, credit trajectories and controlled alternatives. Source curves alone do not identify that mechanism.</p>
<fig id="fig2"><label>Figure 2</label><caption><p>Source-supplied MNIST convergence traces and interquartile bands for four L∞ budgets over reportedly thirty seeds.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:6:66,553,537.1,778.6"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>The source bitmap is retained. Neither exact worst-case loss nor the causal role of operator selection is established by these curves (<xref ref-type="fig" rid="fig2">Fig. 2</xref>).</p>
</sec>
<sec id="sec-24"><label>6.2</label><title>Baseline Comparison and Pareto Trade-off</title>
<p>In the source&apos;s MNIST summary at ε = 0.1, AAPO records robust accuracy 80.1% and the Madry-PGD-trained comparator 74.2%, a difference of 5.9 percentage points. The source charts show clean accuracy near 93.9% for AAPO, but the illustrated robust values for several other baselines do not reconcile with the increments in <xref ref-type="table" rid="tab2">Table 2</xref>. <xref ref-type="fig" rid="fig3">Figs. 3</xref> and 4 are therefore shown as original figures with an explicit data-provenance hold; their point clouds, bootstrap bars and Pareto line cannot establish a common benchmark comparison without the generating table and plot script. A Pareto frontier requires comparing the same operational objectives and compatible methods, not merely drawing a line through source markers.</p>
<fig id="fig3"><label>Figure 3</label><caption><p>Original clean and PGD-attack accuracy bars at ε = 0.1. AAPO 80.1% and Madry-PGD-train 74.2% imply 5.9 percentage points.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:6:66,133.4,537.1,359.3"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>For other comparators the bar heights disagree with <xref ref-type="table" rid="tab2">Table 2</xref>&apos;s stated gains; the original bitmap is retained for author reconciliation, not interpreted as validated statistics (<xref ref-type="fig" rid="fig3">Fig. 3</xref>).</p>
<fig id="fig4"><label>Figure 4</label><caption><p>Original clean-versus-PGD-attack scatter retained unchanged.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:7:66,553,537.1,778.2"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>Its comparator centers must be reconciled with <xref ref-type="fig" rid="fig3">Fig. 3</xref> and <xref ref-type="table" rid="tab2">Table 2</xref> using per-seed results. A drawn dashed line is not proof of a globally optimal multiobjective frontier (<xref ref-type="fig" rid="fig4">Fig. 4</xref>).</p>
</sec>
<sec id="sec-25"><label>6.3</label><title>Pairwise Statistical Significance</title>
<p><xref ref-type="table" rid="tab2">Table 2</xref> preserves six source-reported pairwise deltas, Cliff&apos;s δ, Hedges&apos; g, bootstrap intervals and Holm-adjusted p-values; its Madry comparator delta is +5.9 pp. The reported test unit is ambiguous: eight problem instances are named while thirty seeds also appear. With exactly eight untied independent paired differences and an exact two-sided signed-rank test, the smallest raw p-value is 2/2⁸ = 0.0078125, and a six-comparison Holm family cannot all have adjusted p-values below 0.01. Ties, an asymptotic approximation, pooling or a different observation unit might change the calculation; the raw paired data and code must resolve it. The source&apos;s effect-size labels do not establish an independent-domain or deployment advantage.</p>
<table-wrap id="tab2"><label>Table 2</label><caption><p>Source-reported AAPO–baseline pairwise summaries across eight stated problem instances and thirty mentioned seeds.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:7:63,237.5,537.1,340.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
<sec id="sec-26"><label>6.4</label><title>Friedman–Nemenyi Multi-Comparison</title>
<p>The source reports Friedman χ² = 31.4 and seven mean ranks of 1.25, 3.10, 3.85, 4.35, 4.95, 5.85 and 6.55 over eight stated blocks. These sum to 29.90; with seven algorithms, ranks within each complete block must sum to 28, and so must the mean ranks. The raw rank matrix or corrected values are necessary before recalculating Friedman significance. For seven algorithms and eight independent blocks, Demšar&apos;s two-sided Nemenyi q at α = 0.05 is 2.949, giving CD = 2.949√[7·8/(6·8)] ≈ 3.185 <xref ref-type="bibr" rid="ref-14">[14]</xref>. The source&apos;s CD = 1.94 is therefore incompatible with those stated units. The AAPO–Madry mean-rank gap of 1.85 does not exceed even that source CD. No all-baseline Nemenyi conclusion follows from the retained chart.</p>
<fig id="fig5"><label>Figure 5</label><caption><p>Original rank diagram retained unchanged for provenance.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:8:66,554.6,537.1,778.6"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>Its ranks sum to 29.90 rather than the required 28, and its 1.94 critical difference is not the standard two-sided Nemenyi value for seven methods and eight independent blocks (approximately 3.185). The plotted significance annotation is invalid pending source-rank reconstruction (<xref ref-type="fig" rid="fig5">Fig. 5</xref>).</p>
</sec>
<sec id="sec-27"><label>6.5</label><title>Cross-ε Generalisation and Certified Robustness</title>
<p><xref ref-type="table" rid="tab3">Table 3</xref> reports PGD-attack accuracies for AAPO and the Madry-PGD-trained comparator at three L∞ budgets; the observed differences are 4.5, 5.9 and 6.6 percentage points at ε = 0.05, 0.1 and 0.2, respectively. These source figures describe the tested finite attacks, conditional on common evaluation inputs and matching attack strength. They do not guarantee generalization to adaptive or higher-budget attackers. The source separately states 71.4% versus 65.2% certified accuracy at L2 radius 0.05 under σ = 0.25; neither a smoothed model specification nor class-probability bounds are provided, and no L∞ certificate follows from an L2 radius <xref ref-type="bibr" rid="ref-8">[8]</xref>.</p>
<table-wrap id="tab3"><label>Table 3</label><caption><p>Source-reported MNIST PGD-attack accuracy across three L∞ test budgets at a stated training budget of 0.1.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:8:66,264.1,537.1,328.8"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
<sec id="sec-28"><label>6.6</label><title>Ablation Study</title>
<p><xref ref-type="table" rid="tab4">Table 4</xref> retains the reported one-component-at-a-time ablations. Omitting the inner attack is associated with a 17.0 pp lower score, while omitting the operator schedule, Lévy operator or the dual-diversity stop rule is associated with 4.8, 3.1 and 1.4 pp lower scores. These contrasts do not sum to a causal decomposition; each changed configuration may interact with the others and have a different compute budget. The source also calls the reference setting both a single-island search and a multi-deme topology, and contrasts warm-start with random restarts without specifying how those restarts enter the previously described inner loop. A factorial or matched-budget ablation and code are needed before assigning distinct benefits.</p>
<table-wrap id="tab4"><label>Table 4</label><caption><p>Original AAPO ablation accuracies and differences at ε = 0.1.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:9:66,620.2,537.1,755.6"/><p content-type="note">This table is shown in the PDF version of the article.</p></table-wrap>
</sec>
<sec id="sec-29"><label>6.7</label><title>Morris Sensitivity Analysis</title>
<p><xref ref-type="fig" rid="fig6">Fig. 6</xref> reports source-assigned Morris μ* and σ values for eight hyperparameters and four outputs. Twenty trajectories across eight parameters require 20·(8+1) = 180 model evaluations in total for the standard one-at-a-time path design <xref ref-type="bibr" rid="ref-18">[18]</xref>, not 180 per hyperparameter. Each evaluation may itself include many population and PGD operations. The chart displays ε_train and K as large robust-accuracy effects, but parameter scaling, step size, trajectory generation, bootstrap variability and the output metric definitions are absent. μ* screens scaled elementary effects; σ mixes nonlinear and interaction contributions and does not isolate either mechanism. The reported ranking is descriptive until the design and raw effects are supplied.</p>
<fig id="fig6"><label>Figure 6</label><caption><p>Source-supplied Morris elementary-effects matrix for eight inputs and four outputs.</p></caption><graphic content-type="pdf-region" xlink:href="pdf-region:9:66,233.9,537.1,481.2"/><p content-type="note">This figure is shown in the PDF version of the article.</p></fig>
<p>Original numeric annotations and bitmap are retained. Twenty nine-point trajectories imply 180 whole-model evaluations; parameter ranges and raw elementary effects are needed to interpret magnitudes and interactions (<xref ref-type="fig" rid="fig6">Fig. 6</xref>) <xref ref-type="bibr" rid="ref-18">[18]</xref>.</p>
</sec>
<sec id="sec-30"><label>6.8</label><title>Suboptimality Bound</title>
<p>No certified optimization gap follows from this record. A longer AAPO run that improves the incumbent by at most a reported 0.6 percentage points on the inspected configurations cannot upper-bound all improvement still available in a nonconvex search space. Comparing finite PGD at 100 and 1000 steps on a subset likewise cannot bound the supremum of its gap from the exact inner maximum. Moreover, the source expression mixes an empirical score at the unknown true minimizer with a continued-search quantity without a justified decomposition or measurable global terms. The reported 1.8 pp is a sum of two local diagnostic values, not a valid bound on global suboptimality. A rigorous guarantee would need explicit assumptions, attack optimality bounds and a search certificate; the current paper makes no such claim.</p>
</sec>
</sec>
<sec id="sec-31"><label>7</label><title>Discussion</title>
<sec id="sec-32"><label>7.1</label><title>Why Population-Based Tuning Complements Adversarial Training</title>
<p>The reported MNIST <xref ref-type="table" rid="tab3">Table 3</xref> contrast suggests decision-parameter tuning merits further study alongside classifier adversarial training <xref ref-type="bibr" rid="ref-4">[4]</xref>. It does not isolate why AAPO differs: method, base checkpoint, optimizer budget, attack adaptation and threshold selection are all potential contributors. A simplex constraint is continuous and not by itself nondifferentiable; thresholded decisions or discrete rule ranks can cause nondifferentiability. The source does not establish that those components were actually optimized in each benchmark. A matched study with the same checkpoint and decision space could test the proposed complementarity.</p>
<p>A population can average noisy fitness differences, but averaging across candidates does not automatically regularize an attack approximation or improve statistical efficiency. Candidate evaluations can share data and attack draws. The source provides no variance comparison with a strong gradient-based decision-layer baseline and no per-gradient wall-time accounting. The rationale remains a plausible optimization hypothesis rather than an identified cause of the reported score differences.</p>
</sec>
<sec id="sec-33"><label>7.2</label><title>Robustness–Accuracy Trade-Off and Fairness Across Attack Budgets</title>
<p>Clean and attacked accuracy form a practical trade-off. A decision maker must also account for false alarms, attack misses, class prevalence and the operational cost of each threshold, because overall accuracy alone does not specify security utility. The supplied scatter uses source-inconsistent comparator values and cannot establish an empirical Pareto set. The optimizer returns a population, but no measured nondominated set or selection rule is reported; any operational choice would require calibrated, independently validated cost functions.</p>
<p>The three recorded test budgets show higher AAPO than Madry-PGD-train values under the specified finite PGD attack. This is a descriptive cross-budget comparison, not a guarantee against an adaptive attacker or an unseen feasible feature transformation. Gaussian smoothing may offer a separate L2 certificate if applied and validated on the actual deployed classifier <xref ref-type="bibr" rid="ref-8">[8]</xref>. The required threat set and validation protocol must be specified for any production claim.</p>
</sec>
<sec id="sec-34"><label>7.3</label><title>Reproducibility</title>
<p>The source lists seeds and software versions but no resolvable code, Zenodo record, image digest or downloadable container. A code release cannot be asserted on the supplied evidence. Reproduction requires the exact attacker and defender implementations, network-flow feasibility constraints, base-model weights, split indices, per-seed metrics, rank matrices, sensitivity trajectories, and bitmap-generation inputs <xref ref-type="bibr" rid="ref-10">[10]</xref>, <xref ref-type="bibr" rid="ref-12">[12]</xref>. Until these are supplied, the tabulated and figured outcomes remain author-reported observations.</p>
</sec>
</sec>
<sec id="sec-35"><label>8</label><title>Threats to Validity and Counterarguments</title>
<sec id="sec-36"><label>8.1</label><title>Scope of the Threat Model</title>
<p>The evaluated inner attack uses candidate-specific gradients and labels, whereas the stated deployment threat concerns unknown decision weights and restricted queries. Adaptive query-limited surrogate attacks are not tested <xref ref-type="bibr" rid="ref-16">[16]</xref>. Poisoning and compromise of training or optimization infrastructure fall outside this test-time evasion formulation <xref ref-type="bibr" rid="ref-7">[7]</xref>. The manuscript&apos;s original scope matrix cannot substitute for independent attacks on each threat category. The features of a feasible network packet must be specified before a CICIDS2017 L∞ experiment can be interpreted operationally.</p>
</sec>
<sec id="sec-37"><label>8.2</label><title>Methodological Threats</title>
<p>The source selects γ, Lévy scale, diversity bins and patience without releasing validation traces. Transferring those defaults from network flows to MNIST is an assertion needing code and split-level evidence. The listed sensitivity heatmap suggests that ε, K and R affect the reported outcomes, but cannot identify stable defaults without stated parameter ranges and matched compute. Runtime estimates need benchmark logs including PGD backward passes, trial rescoring and the attack hardware.</p>
</sec>
<sec id="sec-38"><label>8.3</label><title>Theoretical Caveats</title>
<p>The proposed population process has no demonstrated irreducible, aperiodic Markov-chain model or bounded discretization error for continuous and mixed decision variables. The diagnostic comparison at 100 versus 1000 PGD steps and the extra 100 outer generations do not certify an approximation or optimization gap. The no-free-lunch theorem <xref ref-type="bibr" rid="ref-19">[19]</xref> neither predicts this method&apos;s outcome nor licenses an unverifiable advantage; conclusions must remain conditional on the specified problems and measured attacks.</p>
</sec>
<sec id="sec-39"><label>8.4</label><title>Dual-Use and Ethical Considerations</title>
<p>Security research can aid both defense and attack. This work describes standard attack families for evaluation <xref ref-type="bibr" rid="ref-5">[5]</xref>, <xref ref-type="bibr" rid="ref-10">[10]</xref> and proposes tuning a defender&apos;s decision layer. An operator considering use would need feature-valid evasion tests, class-specific false-alarm and missed-attack costs, protected-group performance where relevant, and drift monitoring. The source does not supply a deployment study or evidence that periodic retuning preserves adversarial robustness.</p>
</sec>
</sec>
<sec id="sec-40"><label>9</label><title>Conclusion and Future Work</title>
<p>AAPO is a proposed population-based approach to tuning decision parameters using a finite PGD-attack score. The supplied <xref ref-type="table" rid="tab3">Table 3</xref> gives MNIST attacked accuracies of 80.1% for AAPO and 74.2% for the Madry-PGD-trained comparator at ε = 0.1, a 5.9 percentage-point difference. This is a reported benchmark contrast, not a reproduced guarantee. The restart-mean score is not the worst-case inner loss, seven source mean ranks do not form a valid complete rank matrix, the stated Nemenyi difference is incorrect for k = 7 and N = 8, and source figures disagree with tabulated comparator values. These unresolved issues prevent a claim of statistically established or certified superiority. The constructive contribution is a clearly scoped algorithmic proposal and a reproducible validation agenda for its decision-layer hypothesis.</p>
<p>A next study should release the base classifiers, exact algorithm and feasible input-space constraints; compare attack strengths under common budgets and both candidate-known and query-limited attacker models; supply all raw paired results, rank matrices and corrected figures; test equal-compute ablations and trajectory-based sensitivity; and treat L2 smoothing as a separately defined certificate. Those steps would establish whether the reported numerical advantage survives independent replication.</p>
</sec>
<sec id="sec-41"><title>Funding</title>
<p>This study did not receive any specific funding from public, commercial, or non-profit funding agencies.</p>
</sec>
<sec id="sec-42"><title>Data Availability</title>
<p>All data are included in the text.</p>
</sec>
<sec id="sec-43"><title>Conflict of Interest</title>
<p>The author declares that he does not have any conflict of interest.</p>
</sec>
<sec id="sec-44"><title>Consent for Publication</title>
<p>The author has given consent for the publication of this manuscript.</p>
</sec>
</body>
<back><ref-list><title>References</title>
<ref id="ref-1"><label>1</label><mixed-citation>Kennedy, J., &amp; Eberhart, R. (1995). Particle swarm optimization. Proceedings of icnn’95-international conference on neural networks (Vol. 4, pp. 1942–1948). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/ICNN.1995.488968">https://doi.org/10.1109/ICNN.1995.488968</ext-link></mixed-citation></ref>
<ref id="ref-2"><label>2</label><mixed-citation>Storn, R., &amp; Price, K. (1997). Differential evolution--a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization, 11(4), 341–359. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1023/A:1008202821328">https://doi.org/10.1023/A:1008202821328</ext-link></mixed-citation></ref>
<ref id="ref-3"><label>3</label><mixed-citation>Tanabe, R., &amp; Fukunaga, A. (2013). Success-history based parameter adaptation for differential evolution. 2013 IEEE congress on evolutionary computation (pp. 71–78). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/CEC.2013.6557555">https://doi.org/10.1109/CEC.2013.6557555</ext-link></mixed-citation></ref>
<ref id="ref-4"><label>4</label><mixed-citation>Goodfellow, I. J., Shlens, J., &amp; Szegedy, C. (2014). Explaining and harnessing adversarial examples. <ext-link ext-link-type="uri" xlink:href="https://arxiv.org/abs/1412.6572">https://arxiv.org/abs/1412.6572</ext-link></mixed-citation></ref>
<ref id="ref-5"><label>5</label><mixed-citation>Madry, A., Makelov, A., Schmidt, L., Tsipras, D., &amp; Vladu, A. (2017). Towards deep learning models resistant to adversarial attacks. <ext-link ext-link-type="uri" xlink:href="https://arxiv.org/abs/1706.06083">https://arxiv.org/abs/1706.06083</ext-link></mixed-citation></ref>
<ref id="ref-6"><label>6</label><mixed-citation>Carlini, N., &amp; Wagner, D. (2017). Towards evaluating the robustness of neural networks. 2017 IEEE symposium on security and privacy (SP) (pp. 39–57). IEEE. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/SP.2017.49">https://doi.org/10.1109/SP.2017.49</ext-link></mixed-citation></ref>
<ref id="ref-7"><label>7</label><mixed-citation>Biggio, B., Corona, I., Maiorca, D., Nelson, B., Šrndić, N., Laskov, P., ... &amp; Roli, F. (2013). Evasion attacks against machine learning at test time. Joint European conference on machine learning and knowledge discovery in databases (pp. 387-402). Berlin, Heidelberg: Springer Berlin Heidelberg. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-3-642-40994-3_25">https://doi.org/10.1007/978-3-642-40994-3_25</ext-link></mixed-citation></ref>
<ref id="ref-8"><label>8</label><mixed-citation>Cohen, J., Rosenfeld, E., &amp; Kolter, Z. (2019). Certified adversarial robustness via randomized smoothing. International conference on machine learning (pp. 1310–1320). PMLR. <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v97/cohen19c.html?utm_medium=email&amp;utm_source=transaction">https://proceedings.mlr.press/v97/cohen19c.html?utm_medium=email&amp;utm_source=transaction</ext-link></mixed-citation></ref>
<ref id="ref-9"><label>9</label><mixed-citation>Sharafaldin, I., Lashkari, A. H., &amp; Ghorbani, A. A. (2018). Toward generating a new intrusion detection dataset and intrusion traffic characterization. ICISSp, 1(2018), 108–116. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5220/0006639801080116">https://doi.org/10.5220/0006639801080116</ext-link></mixed-citation></ref>
<ref id="ref-10"><label>10</label><mixed-citation>Croce, F., &amp; Hein, M. (2020). Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks. International conference on machine learning (pp. 2206–2216). PMLR. <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v119/croce20b.html">https://proceedings.mlr.press/v119/croce20b.html</ext-link></mixed-citation></ref>
<ref id="ref-11"><label>11</label><mixed-citation>Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., &amp; Fergus, R. (2013). Intriguing properties of neural networks. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.48550/arXiv.1312.6199">https://doi.org/10.48550/arXiv.1312.6199</ext-link></mixed-citation></ref>
<ref id="ref-12"><label>12</label><mixed-citation>Athalye, A., Carlini, N., &amp; Wagner, D. (2018). Obfuscated gradients give a false sense of security: circumventing defenses to adversarial examples. International conference on machine learning (pp. 274–283). PMLR. <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v80/athalye18a.html">https://proceedings.mlr.press/v80/athalye18a.html</ext-link></mixed-citation></ref>
<ref id="ref-13"><label>13</label><mixed-citation>Tramèr, F., Kurakin, A., Papernot, N., Goodfellow, I., Boneh, D., &amp; McDaniel, P. (2017). Ensemble adversarial training: Attacks and defenses. <ext-link ext-link-type="uri" xlink:href="https://openreview.net/forum?id=rkZvSe-RZ">https://openreview.net/forum?id=rkZvSe-RZ</ext-link></mixed-citation></ref>
<ref id="ref-14"><label>14</label><mixed-citation>Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. Journal of machine learning research, 7(1), 1–30. <ext-link ext-link-type="uri" xlink:href="http://www.jmlr.org/papers/volume7/demsar06a/demsar06a.pdf">http://www.jmlr.org/papers/volume7/demsar06a/demsar06a.pdf</ext-link></mixed-citation></ref>
<ref id="ref-15"><label>15</label><mixed-citation>Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics, 6(2), 65–70. <ext-link ext-link-type="uri" xlink:href="https://www.jstor.org/stable/4615733">https://www.jstor.org/stable/4615733</ext-link></mixed-citation></ref>
<ref id="ref-16"><label>16</label><mixed-citation>Ilyas, A., Engstrom, L., Athalye, A., &amp; Lin, J. (2018). Black-box adversarial attacks with limited queries and information. International conference on machine learning (pp. 2137-2146). PMLR. <ext-link ext-link-type="uri" xlink:href="https://proceedings.mlr.press/v80/ilyas18a.html">https://proceedings.mlr.press/v80/ilyas18a.html</ext-link></mixed-citation></ref>
<ref id="ref-17"><label>17</label><mixed-citation>Hansen, N. (2006). The CMA evolution strategy: A comparing review. Towards a new evolutionary computation: Advances in the estimation of distribution algorithms, 75–102. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/3-540-32494-1_4">https://doi.org/10.1007/3-540-32494-1_4</ext-link></mixed-citation></ref>
<ref id="ref-18"><label>18</label><mixed-citation>Morris, M. D. (1991). Factorial sampling plans for preliminary computational experiments. Technometrics, 33(2), 161–174. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/00401706.1991.10484804">https://doi.org/10.1080/00401706.1991.10484804</ext-link></mixed-citation></ref>
<ref id="ref-19"><label>19</label><mixed-citation>Wolpert, D. H., &amp; Macready, W. G. (1997). No free lunch theorems for optimization. IEEE transactions on evolutionary computation, 1(1), 67–82. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1109/4235.585893">https://doi.org/10.1109/4235.585893</ext-link></mixed-citation></ref>
</ref-list></back>
</article>