Photoz bcnz - Revision history

Jcarrete at 14:30, 17 February 2020

2020-02-17T14:30:49Z

Jcarrete at 14:19, 17 February 2020

2020-02-17T14:19:51Z

Jcarrete: Created page with "Version parquet v29 I use a notebook to read and clean the data since there are wrong or weird values in the file: e.g. NaN values, odds > 1.e60, etc.. The notebook is calle..."

2020-02-17T08:12:49Z

Created page with "Version parquet v29 I use a notebook to read and clean the data since there are wrong or weird values in the file: e.g. NaN values, odds > 1.e60, etc.. The notebook is calle..."

New page

Version parquet v29

I use a notebook to read and clean the data since there are wrong or weird values in the file: e.g. NaN values, odds > 1.e60, etc..

The notebook is called:

PAUdm photoz parquet files.ipynb

I saved the file in csv format in order to ingest it into paudb.

@@ Line 1: / Line 1: @@
-==== Version parquet v29 =====
+==== Version parquet v29 ====
 I use a notebook to read and clean the data since there are wrong or weird values in the file: e.g. NaN values, odds > 1.e60, etc..
@@ Line 27: / Line 27: @@
 And also into CosmoHub:
      INSERT OVERWRITE TABLE cosmohub.paudm_photoz_bcnz_updated_v1_1 PARTITION (production_id=952) SELECT ref_id, zb, odds, pz_width, zb_mean, chi2, n_band, ebv, qz, best_run FROM jcarrete.paudm_photoz_bcnz_updated_v1_1_csv WHERE ref_id IS NOT NULL AND production_id = 952;