Consistency warning with some constrained data sets

[nikohansen]

I get a consistency warning for CMA data sets AL1, AL2, AL4, for all 54 functions like

import cocopp

al_data = 1  # 1, 2, and 4 gives warnings, 3 is fine
dsl = cocopp.load('.*constrained/.*/al{}-cma.*'.format(al_data))

cocopp.genericsettings.warning_level = 9999  # number of warnings shown?
for ds in dsl:
    ds.consistency_check()

[...python3.12/site-packages/cocopp/pproc.py:1146](...): UserWarning: evals of DataSet(AL1-CMA-ES_Dufosse on f1 2-D) are not monotone in columns [ 1  2  3  4  5  6  7  8  9 10 11 12 13 14 15]
  warnings.warn("evals of {0} are not monotone in columns {1}".format(str(self), nonmonotone + 1))
[...python3.12/site-packages/cocopp/pproc.py:1149](...): UserWarning: DataSet(AL1-CMA-ES_Dufosse on f1 2-D) was not consistent
  warnings.warn("{0} was not consistent".format(str(self)))  # should rather be in the previous messages
[...python3.12/site-packages/cocopp/pproc.py:1146](...): UserWarning: evals of DataSet(AL1-CMA-ES_Dufosse on f2 2-D) are not monotone in columns [ 1  2  3  4  5  6  7  8  9 10 11 12 13 14 15]
  warnings.warn("evals of {0} are not monotone in columns {1}".format(str(self), nonmonotone + 1))
[...python3.12/site-packages/cocopp/pproc.py:1149](...): UserWarning: DataSet(AL1-CMA-ES_Dufosse on f2 2-D) was not consistent

[...]

Original observation:

dsd = cocopp.main('.*constrained/.*/al.*-cma.*')

produces this warning when run the first time

  downloading https://numbbo.github.io/data-archive/data-archive/bbob-constrained/2022/AL2-CMA-ES_Dufosse.tgz to /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL2-CMA-ES_Dufosse.tgz
  downloading https://numbbo.github.io/data-archive/data-archive/bbob-constrained/2022/AL4-CMA-ES_Dufosse.tgz to /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL4-CMA-ES_Dufosse.tgz
Post-processing (4 datasets, cocopp2.8.2.dev1+g7a6c672db.d20251203, Mon Dec 22 16:00:54 2025)
  Using 4 data sets:
    /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL1-CMA-ES_Dufosse.tgz
    /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL2-CMA-ES_Dufosse.tgz
    /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL3-CMA-ES_Dufosse.tgz
    /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/AL4-CMA-ES_Dufosse.tgz

Post-processing (2+)
  loading data...
    archive extracted to folder /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/.extracted_AL1-CMA-ES_Dufosse ...
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1146: UserWarning: evals of DataSet(AL1-CMA-ES_Dufosse on f1 2-D) are not monotone in columns [ 1  2  3  4  5  6  7  8  9 10 11 12 13 14 15]
  warnings.warn("evals of {0} are not monotone in columns {1}".format(str(self), nonmonotone + 1))
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1149: UserWarning: DataSet(AL1-CMA-ES_Dufosse on f1 2-D) was not consistent
  warnings.warn("{0} was not consistent".format(str(self)))  # should rather be in the previous messages
    archive extracted to folder /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/.extracted_AL2-CMA-ES_Dufosse ...
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1146: UserWarning: evals of DataSet(AL2-CMA-ES_Dufosse on f1 2-D) are not monotone in columns [ 1  2  3  4  5  6  7  8  9 10 11 12 13 14 15]
  warnings.warn("evals of {0} are not monotone in columns {1}".format(str(self), nonmonotone + 1))
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1149: UserWarning: DataSet(AL2-CMA-ES_Dufosse on f1 2-D) was not consistent
  warnings.warn("{0} was not consistent".format(str(self)))  # should rather be in the previous messages
    archive extracted to folder /Users/hansen/Library/Caches/cocopp/das/da/bbob-constrained/2022/.extracted_AL4-CMA-ES_Dufosse ...
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1146: UserWarning: evals of DataSet(AL4-CMA-ES_Dufosse on f1 2-D) are not monotone in columns [ 1  2  3  4  5  6  7  8  9 10 11 12 13 14 15]
  warnings.warn("evals of {0} are not monotone in columns {1}".format(str(self), nonmonotone + 1))
/Users/hansen/opt/anaconda3/envs/cocopp/lib/python3.12/site-packages/cocopp/pproc.py:1149: UserWarning: DataSet(AL4-CMA-ES_Dufosse on f1 2-D) was not consistent
  warnings.warn("{0} was not consistent".format(str(self)))  # should rather be in the previous messages
  done (Mon Dec 22 16:01:43 2025).
  Will generate output data in folder ppdata/constrained_AL1-C_AL2-C_AL3-C_AL4-C_122216h0143
    this might take several minutes.
ECDF graphs per noise group...
  done (Mon Dec 22 16:02:00 2025).
[...]

The warning can be produced again like

cocopp.genericsettings.warning_level = 99
for key in dsd:
    for ds in dsd[key]:
        ds.consistency_check()

We should try to understand how this warning comes about.

Originally posted by @nikohansen in #326