DPL-840 Populate missing sample fields in MLWH and consequently in CoTrack

[neilsycamore]

Request:
Would it be possible to have missing data corrected (with strong interest on having corrected the sample_data_received field) for the 9 samples? The identifiers of the samples affected are in the attached CSV
RT784027_identifiers.csv

Background:
As part of a Heron R&D test, the Heron/GLSP lab processed a series of non-consolidated negative plates with a few positives in them. They also processed a "normal" consolidated positive plate (BB-00044085) intended for the regular Heron pipeline work. The positives in both these plates were the same and therefore share the same root ID.

We have identified that some of the fields associated to the 9 samples from source plate BB-00044085 (like the plate_map_received, box_manifest_uploaded, box_scaned and sample_data_received) does not seem to have been populated on CoTrack. A co-worker from the GSU data engineering team has forwarded me a screenshot (attached below) showing a series of errors in the PSD pipeline processing the plate maps that the data engineer team put into RabbitMQ. We suspect that potentially the missing fields have not been set in MLWH and consequently missing on CoTrack as the samples had already been processed.

when(

        (f.col(""cherry_pick_completed"").isNotNull() | f.col(""cherry_pick_failed"").isNotNull()),

        f.greatest(""box_scanned"", ""plate_map_received"", ""box_manifest_uploaded"")).otherwise(



        f.when(f.col(""box_scanned"").isNotNull() & f.col(""plate_map_received"").isNotNull() & f.col(

            ""box_manifest_uploaded"").isNotNull(),

               f.greatest(""box_scanned"", ""plate_map_received"", ""box_manifest_uploaded"")).otherwise(

            f.lit(None)))

Main Contacts
Camilo G

Related:
Request raised via RT784027