Production table - Revision history

Jcarrete at 16:16, 14 September 2020

2020-09-14T16:16:48Z

Jcarrete at 15:27, 14 September 2020

2020-09-14T15:27:37Z

Jcarrete: Created page with "To create the file for updating the productions: psql -U postgres -W -h db.pau.pic.es dm -c "COPY (SELECT * FROM production) TO stdout DELIMITER ',' CSV" | pv > paudm_pr..."

2020-02-17T14:48:35Z

Created page with "To create the file for updating the productions: psql -U postgres -W -h db.pau.pic.es dm -c "COPY (SELECT * FROM production) TO stdout DELIMITER ',' CSV" | pv > paudm_pr..."

New page

To create the file for updating the productions:

psql -U postgres -W -h db.pau.pic.es dm -c "COPY (SELECT * FROM production) TO stdout DELIMITER ',' CSV" | pv > paudm_production_datetime.csv

To remove the old version:

hdfs dfs -rm /user/jcarrete/data/paudm/production/*

Copy from local:

hdfs dfs -copyFromLocal /cephfs/pic.es/astro/scratch/jcarrete/sandbox/paudm_production_17_02_2020.csv /user/jcarrete/data/paudm/production/paudm_production_17_02_2020.csv

To update the table:

INSERT OVERWRITE TABLE cosmohub.paudm_production SELECT id, input_production, pipeline, release, software_version, job_id, comments, created FROM jcarrete.paudm_production_csv;

@@ Line 9: / Line 9: @@
 Copy from local:
-     hdfs dfs -copyFromLocal /cephfs/pic.es/astro/scratch/jcarrete/sandbox/paudm_production_datetime.csv  /user/jcarrete/data/paudm/production/paudm_production_datetime.csv
+     hdfs dfs -copyFromLocal /cephfs/pic.es/astro/scratch/jcarrete/sandbox/PAU/paudm_production_datetime.csv  /user/jcarrete/data/paudm/production/paudm_production_datetime.csv
 To update the table: