CANDELS 2018

From Public PIC Wiki
Revision as of 12:21, 11 October 2019 by Jcarrete (talk | contribs) (Created page with "== Data == I take the file from: > https://lerma.obspm.fr/huertas/form_CANDELS? I donwload the fits file: > gold_dimauro18_toshare.fits There is a notebook called: Ingest...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Data

I take the file from:

> https://lerma.obspm.fr/huertas/form_CANDELS?

I donwload the fits file:

> gold_dimauro18_toshare.fits

There is a notebook called: Ingesting CANDELS catalog.ipynb in my python_notebooks directory, where the fits file is converted into parquet. The field name FIELD is converted into a str field instead of a 10bit data type.

I move the parquet file to the hdfs path:

> /hdfs/user/jcarrete/data/candels/gold_dimauro18_toshare.pq

It is necessary to give permissions to the directory to create the external table afterwards.

I use the following README file to write the comments of the tables:

> https://drive.google.com/file/d/1V3KGnZ6wr_rINylKCWjRS7923DsEgUPA/view

And the paper where the catalog is decribed is the following:

> https://drive.google.com/file/d/1bS-AqEj6rGp5b2whlcI33Hm1yhuDj7Uy/view


SQL

This is the command used in beeline to create the external table: 

CREATE EXTERNAL TABLE jcarrete.candels_18_pq (
id int COMMENT 'ID from the CANDELS catalog',
ra double COMMENT 'RA',
dec double COMMENT 'DEC',
field string COMMENT 'FIELD',
b_t_m double COMMENT 'B_T_m, stellar mass bulge-to-total ratio, corrected as explained in the paper, fig.5. It is set to 0 (1) when the best profile is identified to be a pure disk (pure bulge)',
p_b double COMMENT 'probability for single sersic profile with n free',
p_d double COMMENT 'probability for Pure Exponential profile',
p_bd double COMMENT 'probability for Bulge+disk profile',
p_pb double COMMENT 'Pseudo-bulge + disk profile',
f_sph double COMMENT 'probability that the galaxy is a spheroid',
f_disk double COMMENT 'probability that the galaxy is a disk',
f_irr double COMMENT 'probability that the galaxy is irregular',
f_ps double COMMENT 'probability that the galaxy is a point spread function/star',
setup double COMMENT 'setup, used for the correction of "ambiguous" cases [see fig 5 in the paper]',
n_comp double COMMENT 'n_comp, number of components',
profile double COMMENT '1: Pure Sersic , 2: Pure Exponential , 3: Bulge+disk , 4: Pseudo-bulge + disk , 5: Unclassified , 6: Star',
n_profile double COMMENT 'if n_profile=1 more profiles are possible according to the probability threshold',
q_fit double COMMENT 'quality of the fit done comparing the total magnitude in the H band with the one from CANDELS',
mag_f435 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f606 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f775 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f814 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f850 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f105 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f125 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f160 double COMMENT 'Total Galfit result for the single sersic fit',
re_f435 double COMMENT 'Total Galfit result for the single sersic fit',
re_f606 double COMMENT 'Total Galfit result for the single sersic fit',
re_f775 double COMMENT 'Total Galfit result for the single sersic fit',
re_f814 double COMMENT 'Total Galfit result for the single sersic fit',
re_f850 double COMMENT 'Total Galfit result for the single sersic fit',
re_f105 double COMMENT 'Total Galfit result for the single sersic fit',
re_f125 double COMMENT 'Total Galfit result for the single sersic fit',
re_f160 double COMMENT 'Total Galfit result for the single sersic fit',
n_f435 double COMMENT 'Total Galfit result for the single sersic fit',
n_f606 double COMMENT 'Total Galfit result for the single sersic fit',
n_f775 double COMMENT 'Total Galfit result for the single sersic fit',
n_f814 double COMMENT 'Total Galfit result for the single sersic fit',
n_f850 double COMMENT 'Total Galfit result for the single sersic fit',
n_f105 double COMMENT 'Total Galfit result for the single sersic fit',
n_f125 double COMMENT 'Total Galfit result for the single sersic fit',
n_f160 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f435 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f606 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f775 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f814 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f850 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f105 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f125 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f160 double COMMENT 'Total Galfit result for the single sersic fit',
q_f435 double COMMENT 'Total Galfit result for the single sersic fit',
q_f606 double COMMENT 'Total Galfit result for the single sersic fit',
q_f775 double COMMENT 'Total Galfit result for the single sersic fit',
q_f814 double COMMENT 'Total Galfit result for the single sersic fit',
q_f850 double COMMENT 'Total Galfit result for the single sersic fit',
q_f105 double COMMENT 'Total Galfit result for the single sersic fit',
q_f125 double COMMENT 'Total Galfit result for the single sersic fit',
q_f160 double COMMENT 'Total Galfit result for the single sersic fit',
lmass double COMMENT 'Total log[mass/Msol]',
l68_lmass double COMMENT 'Total log[mass/Msol] lower estimation',
u68_lmass double COMMENT 'Total log[mass/Msol] upper estimation',
uv double COMMENT 'Total uv rest frame color',
vj double COMMENT 'Total vj rest frame color',
chi2 double COMMENT 'Total chi2 from the SED fitting',
mag_b_f435 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f606 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f775 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f814 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f850 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f105 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f125 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f160 double COMMENT 'Bulge result from the Galfit fit',
re_b_f435 double COMMENT 'Bulge result from the Galfit fit',
re_b_f606 double COMMENT 'Bulge result from the Galfit fit',
re_b_f775 double COMMENT 'Bulge result from the Galfit fit',
re_b_f814 double COMMENT 'Bulge result from the Galfit fit',
re_b_f850 double COMMENT 'Bulge result from the Galfit fit',
re_b_f105 double COMMENT 'Bulge result from the Galfit fit',
re_b_f125 double COMMENT 'Bulge result from the Galfit fit',
re_b_f160 double COMMENT 'Bulge result from the Galfit fit',
n_b_f435 double COMMENT 'Bulge result from the Galfit fit',
n_b_f606 double COMMENT 'Bulge result from the Galfit fit',
n_b_f775 double COMMENT 'Bulge result from the Galfit fit',
n_b_f814 double COMMENT 'Bulge result from the Galfit fit',
n_b_f850 double COMMENT 'Bulge result from the Galfit fit',
n_b_f105 double COMMENT 'Bulge result from the Galfit fit',
n_b_f125 double COMMENT 'Bulge result from the Galfit fit',
n_b_f160 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f435 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f606 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f775 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f814 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f850 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f105 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f125 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f160 double COMMENT 'Bulge result from the Galfit fit',
q_b_f435 double COMMENT 'Bulge result from the Galfit fit',
q_b_f606 double COMMENT 'Bulge result from the Galfit fit',
q_b_f775 double COMMENT 'Bulge result from the Galfit fit',
q_b_f814 double COMMENT 'Bulge result from the Galfit fit',
q_b_f850 double COMMENT 'Bulge result from the Galfit fit',
q_b_f105 double COMMENT 'Bulge result from the Galfit fit',
q_b_f125 double COMMENT 'Bulge result from the Galfit fit',
q_b_f160 double COMMENT 'Bulge result from the Galfit fit',
lmass_b double COMMENT 'Bulge log[mass/Msol]',
l68_lmass_b double COMMENT 'Bulge log[mass/Msol] lower estimation',
u68_lmass_b double COMMENT 'Bulge log[mass/Msol] upper estimation',
uv_b double COMMENT 'Bulge uv rest frame color',
err_uv_b double COMMENT 'Error in Bulge uv rest frame color',
vj_b double COMMENT 'Bulge vj rest frame color',
err_vj_b double COMMENT 'Error in Bulge vj rest frame color',
chi2_b double COMMENT 'Bulge chi2 from the SED fitting',
mag_d_f435 double COMMENT 'Disk result from the Galfit fit',
mag_d_f606 double COMMENT 'Disk result from the Galfit fit',
mag_d_f775 double COMMENT 'Disk result from the Galfit fit',
mag_d_f814 double COMMENT 'Disk result from the Galfit fit',
mag_d_f850 double COMMENT 'Disk result from the Galfit fit',
mag_d_f105 double COMMENT 'Disk result from the Galfit fit',
mag_d_f125 double COMMENT 'Disk result from the Galfit fit',
mag_d_f160 double COMMENT 'Disk result from the Galfit fit',
re_d_f435 double COMMENT 'Disk result from the Galfit fit',
re_d_f606 double COMMENT 'Disk result from the Galfit fit',
re_d_f775 double COMMENT 'Disk result from the Galfit fit',
re_d_f814 double COMMENT 'Disk result from the Galfit fit',
re_d_f850 double COMMENT 'Disk result from the Galfit fit',
re_d_f105 double COMMENT 'Disk result from the Galfit fit',
re_d_f125 double COMMENT 'Disk result from the Galfit fit',
re_d_f160 double COMMENT 'Disk result from the Galfit fit',
n_d_f435 double COMMENT 'Disk result from the Galfit fit',
n_d_f606 double COMMENT 'Disk result from the Galfit fit',
n_d_f775 double COMMENT 'Disk result from the Galfit fit',
n_d_f814 double COMMENT 'Disk result from the Galfit fit',
n_d_f850 double COMMENT 'Disk result from the Galfit fit',
n_d_f105 double COMMENT 'Disk result from the Galfit fit',
n_d_f125 double COMMENT 'Disk result from the Galfit fit',
n_d_f160 double COMMENT 'Disk result from the Galfit fit',
pa_d_f435 double COMMENT 'Disk result from the Galfit fit',
pa_d_f606 double COMMENT 'Disk result from the Galfit fit',
pa_d_f775 double COMMENT 'Disk result from the Galfit fit',
pa_d_f814 double COMMENT 'Disk result from the Galfit fit',
pa_d_f850 double COMMENT 'Disk result from the Galfit fit',
pa_d_f105 double COMMENT 'Disk result from the Galfit fit',
pa_d_f125 double COMMENT 'Disk result from the Galfit fit',
pa_d_f160 double COMMENT 'Disk result from the Galfit fit',
q_d_f435 double COMMENT 'Disk result from the Galfit fit',
q_d_f606 double COMMENT 'Disk result from the Galfit fit',
q_d_f775 double COMMENT 'Disk result from the Galfit fit',
q_d_f814 double COMMENT 'Disk result from the Galfit fit',
q_d_f850 double COMMENT 'Disk result from the Galfit fit',
q_d_f105 double COMMENT 'Disk result from the Galfit fit',
q_d_f125 double COMMENT 'Disk result from the Galfit fit',
q_d_f160 double COMMENT 'Disk result from the Galfit fit',
lmass_d double COMMENT 'Disk log[mass/Msol]',
l68_lmass_d double COMMENT 'Disk log[mass/Msol] lower estimation',
u68_lmass_d double COMMENT 'Disk log[mass/Msol] upper estimation',
uv_d double COMMENT 'Disk uv rest frame color',
err_uv_d double COMMENT 'Error in Disk uv rest frame color',
vj_d double COMMENT 'Disk vj rest frame color',
err_vj_d double COMMENT 'Error in Disk vj rest frame color',
chi2_d double COMMENT 'Disk chi2 from the SED fitting',
magberr_f160 double COMMENT 'Error',
magberr_f125 double COMMENT 'Error',
magberr_f105 double COMMENT 'Error',
magberr_f814 double COMMENT 'Error',
magberr_f850 double COMMENT 'Error',
magberr_f775 double COMMENT 'Error',
magberr_f606 double COMMENT 'Error',
magberr_f435 double COMMENT 'Error',
magderr_f160 double COMMENT 'Error',
magderr_f125 double COMMENT 'Error',
magderr_f105 double COMMENT 'Error',
magderr_f814 double COMMENT 'Error',
magderr_f850 double COMMENT 'Error',
magderr_f775 double COMMENT 'Error',
magderr_f606 double COMMENT 'Error',
magderr_f435 double COMMENT 'Error',
magerr_f160 double COMMENT 'Error',
magerr_f125 double COMMENT 'Error',
magerr_f105 double COMMENT 'Error',
magerr_f814 double COMMENT 'Error',
magerr_f850 double COMMENT 'Error',
magerr_f775 double COMMENT 'Error',
magerr_f606 double COMMENT 'Error',
magerr_f435 double COMMENT 'Error',
nberr_f160 double COMMENT 'Error',
nberr_f125 double COMMENT 'Error',
nberr_f105 double COMMENT 'Error',
nberr_f850 double COMMENT 'Error',
nberr_f814 double COMMENT 'Error',
nberr_f775 double COMMENT 'Error',
nberr_f606 double COMMENT 'Error',
nberr_f435 double COMMENT 'Error',
nderr_f160 double COMMENT 'Error',
nderr_f125 double COMMENT 'Error',
nderr_f105 double COMMENT 'Error',
nderr_f850 double COMMENT 'Error',
nderr_f814 double COMMENT 'Error',
nderr_f775 double COMMENT 'Error',
nderr_f606 double COMMENT 'Error',
nderr_f435 double COMMENT 'Error',
nerr_f160 double COMMENT 'Error',
nerr_f125 double COMMENT 'Error',
nerr_f105 double COMMENT 'Error',
nerr_f850 double COMMENT 'Error',
nerr_f814 double COMMENT 'Error',
nerr_f775 double COMMENT 'Error',
nerr_f606 double COMMENT 'Error',
nerr_f435 double COMMENT 'Error',
reberr_f160 double COMMENT 'Error',
reberr_f125 double COMMENT 'Error',
reberr_f105 double COMMENT 'Error',
reberr_f850 double COMMENT 'Error',
reberr_f814 double COMMENT 'Error',
reberr_f775 double COMMENT 'Error',
reberr_f606 double COMMENT 'Error',
reberr_f435 double COMMENT 'Error',
rederr_f160 double COMMENT 'Error',
rederr_f125 double COMMENT 'Error',
rederr_f105 double COMMENT 'Error',
rederr_f850 double COMMENT 'Error',
rederr_f814 double COMMENT 'Error',
rederr_f775 double COMMENT 'Error',
rederr_f606 double COMMENT 'Error',
rederr_f435 double COMMENT 'Error',
reerr_f160 double COMMENT 'Error',
reerr_f125 double COMMENT 'Error',
reerr_f105 double COMMENT 'Error',
reerr_f850 double COMMENT 'Error',
reerr_f814 double COMMENT 'Error',
reerr_f775 double COMMENT 'Error',
reerr_f606 double COMMENT 'Error',
reerr_f435 double COMMENT 'Error',
qberr_f160 double COMMENT 'Error',
qberr_f125 double COMMENT 'Error',
qberr_f105 double COMMENT 'Error',
qberr_f850 double COMMENT 'Error',
qberr_f814 double COMMENT 'Error',
qberr_f775 double COMMENT 'Error',
qberr_f606 double COMMENT 'Error',
qberr_f435 double COMMENT 'Error',
qderr_f160 double COMMENT 'Error',
qderr_f125 double COMMENT 'Error',
qderr_f105 double COMMENT 'Error',
qderr_f850 double COMMENT 'Error',
qderr_f814 double COMMENT 'Error',
qderr_f775 double COMMENT 'Error',
qderr_f606 double COMMENT 'Error',
qderr_f435 double COMMENT 'Error',
qerr_f160 double COMMENT 'Error',
qerr_f125 double COMMENT 'Error',
qerr_f105 double COMMENT 'Error',
qerr_f850 double COMMENT 'Error',
qerr_f814 double COMMENT 'Error',
qerr_f775 double COMMENT 'Error',
qerr_f606 double COMMENT 'Error',
qerr_f435 double COMMENT 'Error',
magbbias_f435 double COMMENT 'Bias',
magbbias_f606 double COMMENT 'Bias',
magbbias_f775 double COMMENT 'Bias',
magbbias_f814 double COMMENT 'Bias',
magbbias_f850 double COMMENT 'Bias',
magbbias_f105 double COMMENT 'Bias',
magbbias_f125 double COMMENT 'Bias',
magbbias_f160 double COMMENT 'Bias',
magdbias_f435 double COMMENT 'Bias',
magdbias_f606 double COMMENT 'Bias',
magdbias_f775 double COMMENT 'Bias',
magdbias_f814 double COMMENT 'Bias',
magdbias_f850 double COMMENT 'Bias',
magdbias_f105 double COMMENT 'Bias',
magdbias_f125 double COMMENT 'Bias',
magdbias_f160 double COMMENT 'Bias',
rebbias_f435 double COMMENT 'Bias',
rebbias_f606 double COMMENT 'Bias',
rebbias_f775 double COMMENT 'Bias',
rebbias_f814 double COMMENT 'Bias',
rebbias_f850 double COMMENT 'Bias',
rebbias_f105 double COMMENT 'Bias',
rebbias_f125 double COMMENT 'Bias',
rebbias_f160 double COMMENT 'Bias',
redbias_f435 double COMMENT 'Bias',
redbias_f606 double COMMENT 'Bias',
redbias_f775 double COMMENT 'Bias',
redbias_f814 double COMMENT 'Bias',
redbias_f850 double COMMENT 'Bias',
redbias_f105 double COMMENT 'Bias',
redbias_f125 double COMMENT 'Bias',
redbias_f160 double COMMENT 'Bias',
nbbias_f435 double COMMENT 'Bias',
nbbias_f606 double COMMENT 'Bias',
nbbias_f775 double COMMENT 'Bias',
nbbias_f814 double COMMENT 'Bias',
nbbias_f850 double COMMENT 'Bias',
nbbias_f105 double COMMENT 'Bias',
nbbias_f125 double COMMENT 'Bias',
nbbias_f160 double COMMENT 'Bias',
pabbias_f435 double COMMENT 'Bias',
pabbias_f606 double COMMENT 'Bias',
pabbias_f775 double COMMENT 'Bias',
pabbias_f814 double COMMENT 'Bias',
pabbias_f850 double COMMENT 'Bias',
pabbias_f105 double COMMENT 'Bias',
pabbias_f125 double COMMENT 'Bias',
pabdias_f435 double COMMENT 'Bias',
pabdias_f606 double COMMENT 'Bias',
pabdias_f775 double COMMENT 'Bias',
pabdias_f814 double COMMENT 'Bias',
pabdias_f850 double COMMENT 'Bias',
pabdias_f105 double COMMENT 'Bias',
pabdias_f125 double COMMENT 'Bias',
qbbias_f435 double COMMENT 'Bias',
qbbias_f606 double COMMENT 'Bias',
qbbias_f775 double COMMENT 'Bias',
qbbias_f814 double COMMENT 'Bias',
qbbias_f850 double COMMENT 'Bias',
qbbias_f105 double COMMENT 'Bias',
qbbias_f125 double COMMENT 'Bias',
qbbias_f160 double COMMENT 'Bias',
qdbias_f435 double COMMENT 'Bias',
qdbias_f606 double COMMENT 'Bias',
qdbias_f775 double COMMENT 'Bias',
qdbias_f814 double COMMENT 'Bias',
qdbias_f850 double COMMENT 'Bias',
qdbias_f105 double COMMENT 'Bias',
qdbias_f125 double COMMENT 'Bias',
qdbias_f160 double COMMENT 'Bias',
mtbias_f435 double COMMENT 'Bias',
mtbias_f606 double COMMENT 'Bias',
mtbias_f775 double COMMENT 'Bias',
mtbias_f814 double COMMENT 'Bias',
mtdias_f850 double COMMENT 'Bias',
mtbias_f105 double COMMENT 'Bias',
mtbias_f125 double COMMENT 'Bias',
mtbias_f160 double COMMENT 'Bias'
)
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe' 
STORED AS INPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat' 
OUTPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat'
LOCATION
  'hdfs://namenode01/user/jcarrete/data/candels/'
;

This is the cosmohub table: 

CREATE TABLE cosmohub.candels_18_c (
id int COMMENT 'ID from the CANDELS catalog',
ra double COMMENT 'RA',
dec double COMMENT 'DEC',
field string COMMENT 'FIELD',
b_t_m double COMMENT 'B_T_m, stellar mass bulge-to-total ratio, corrected as explained in the paper, fig.5. It is set to 0 (1) when the best profile is identified to be a pure disk (pure bulge)',
p_b double COMMENT 'probability for single sersic profile with n free',
p_d double COMMENT 'probability for Pure Exponential profile',
p_bd double COMMENT 'probability for Bulge+disk profile',
p_pb double COMMENT 'Pseudo-bulge + disk profile',
f_sph double COMMENT 'probability that the galaxy is a spheroid',
f_disk double COMMENT 'probability that the galaxy is a disk',
f_irr double COMMENT 'probability that the galaxy is irregular',
f_ps double COMMENT 'probability that the galaxy is a point spread function/star',
setup double COMMENT 'setup, used for the correction of "ambiguous" cases [see fig 5 in the paper]',
n_comp double COMMENT 'n_comp, number of components',
profile double COMMENT '1: Pure Sersic , 2: Pure Exponential , 3: Bulge+disk , 4: Pseudo-bulge + disk , 5: Unclassified , 6: Star',
n_profile double COMMENT 'if n_profile=1 more profiles are possible according to the probability threshold',
q_fit double COMMENT 'quality of the fit done comparing the total magnitude in the H band with the one from CANDELS',
mag_f435 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f606 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f775 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f814 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f850 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f105 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f125 double COMMENT 'Total Galfit result for the single sersic fit',
mag_f160 double COMMENT 'Total Galfit result for the single sersic fit',
re_f435 double COMMENT 'Total Galfit result for the single sersic fit',
re_f606 double COMMENT 'Total Galfit result for the single sersic fit',
re_f775 double COMMENT 'Total Galfit result for the single sersic fit',
re_f814 double COMMENT 'Total Galfit result for the single sersic fit',
re_f850 double COMMENT 'Total Galfit result for the single sersic fit',
re_f105 double COMMENT 'Total Galfit result for the single sersic fit',
re_f125 double COMMENT 'Total Galfit result for the single sersic fit',
re_f160 double COMMENT 'Total Galfit result for the single sersic fit',
n_f435 double COMMENT 'Total Galfit result for the single sersic fit',
n_f606 double COMMENT 'Total Galfit result for the single sersic fit',
n_f775 double COMMENT 'Total Galfit result for the single sersic fit',
n_f814 double COMMENT 'Total Galfit result for the single sersic fit',
n_f850 double COMMENT 'Total Galfit result for the single sersic fit',
n_f105 double COMMENT 'Total Galfit result for the single sersic fit',
n_f125 double COMMENT 'Total Galfit result for the single sersic fit',
n_f160 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f435 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f606 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f775 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f814 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f850 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f105 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f125 double COMMENT 'Total Galfit result for the single sersic fit',
pa_f160 double COMMENT 'Total Galfit result for the single sersic fit',
q_f435 double COMMENT 'Total Galfit result for the single sersic fit',
q_f606 double COMMENT 'Total Galfit result for the single sersic fit',
q_f775 double COMMENT 'Total Galfit result for the single sersic fit',
q_f814 double COMMENT 'Total Galfit result for the single sersic fit',
q_f850 double COMMENT 'Total Galfit result for the single sersic fit',
q_f105 double COMMENT 'Total Galfit result for the single sersic fit',
q_f125 double COMMENT 'Total Galfit result for the single sersic fit',
q_f160 double COMMENT 'Total Galfit result for the single sersic fit',
lmass double COMMENT 'Total log[mass/Msol]',
l68_lmass double COMMENT 'Total log[mass/Msol] lower estimation',
u68_lmass double COMMENT 'Total log[mass/Msol] upper estimation',
uv double COMMENT 'Total uv rest frame color',
vj double COMMENT 'Total vj rest frame color',
chi2 double COMMENT 'Total chi2 from the SED fitting',
mag_b_f435 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f606 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f775 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f814 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f850 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f105 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f125 double COMMENT 'Bulge result from the Galfit fit',
mag_b_f160 double COMMENT 'Bulge result from the Galfit fit',
re_b_f435 double COMMENT 'Bulge result from the Galfit fit',
re_b_f606 double COMMENT 'Bulge result from the Galfit fit',
re_b_f775 double COMMENT 'Bulge result from the Galfit fit',
re_b_f814 double COMMENT 'Bulge result from the Galfit fit',
re_b_f850 double COMMENT 'Bulge result from the Galfit fit',
re_b_f105 double COMMENT 'Bulge result from the Galfit fit',
re_b_f125 double COMMENT 'Bulge result from the Galfit fit',
re_b_f160 double COMMENT 'Bulge result from the Galfit fit',
n_b_f435 double COMMENT 'Bulge result from the Galfit fit',
n_b_f606 double COMMENT 'Bulge result from the Galfit fit',
n_b_f775 double COMMENT 'Bulge result from the Galfit fit',
n_b_f814 double COMMENT 'Bulge result from the Galfit fit',
n_b_f850 double COMMENT 'Bulge result from the Galfit fit',
n_b_f105 double COMMENT 'Bulge result from the Galfit fit',
n_b_f125 double COMMENT 'Bulge result from the Galfit fit',
n_b_f160 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f435 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f606 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f775 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f814 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f850 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f105 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f125 double COMMENT 'Bulge result from the Galfit fit',
pa_b_f160 double COMMENT 'Bulge result from the Galfit fit',
q_b_f435 double COMMENT 'Bulge result from the Galfit fit',
q_b_f606 double COMMENT 'Bulge result from the Galfit fit',
q_b_f775 double COMMENT 'Bulge result from the Galfit fit',
q_b_f814 double COMMENT 'Bulge result from the Galfit fit',
q_b_f850 double COMMENT 'Bulge result from the Galfit fit',
q_b_f105 double COMMENT 'Bulge result from the Galfit fit',
q_b_f125 double COMMENT 'Bulge result from the Galfit fit',
q_b_f160 double COMMENT 'Bulge result from the Galfit fit',
lmass_b double COMMENT 'Bulge log[mass/Msol]',
l68_lmass_b double COMMENT 'Bulge log[mass/Msol] lower estimation',
u68_lmass_b double COMMENT 'Bulge log[mass/Msol] upper estimation',
uv_b double COMMENT 'Bulge uv rest frame color',
err_uv_b double COMMENT 'Error in Bulge uv rest frame color',
vj_b double COMMENT 'Bulge vj rest frame color',
err_vj_b double COMMENT 'Error in Bulge vj rest frame color',
chi2_b double COMMENT 'Bulge chi2 from the SED fitting',
mag_d_f435 double COMMENT 'Disk result from the Galfit fit',
mag_d_f606 double COMMENT 'Disk result from the Galfit fit',
mag_d_f775 double COMMENT 'Disk result from the Galfit fit',
mag_d_f814 double COMMENT 'Disk result from the Galfit fit',
mag_d_f850 double COMMENT 'Disk result from the Galfit fit',
mag_d_f105 double COMMENT 'Disk result from the Galfit fit',
mag_d_f125 double COMMENT 'Disk result from the Galfit fit',
mag_d_f160 double COMMENT 'Disk result from the Galfit fit',
re_d_f435 double COMMENT 'Disk result from the Galfit fit',
re_d_f606 double COMMENT 'Disk result from the Galfit fit',
re_d_f775 double COMMENT 'Disk result from the Galfit fit',
re_d_f814 double COMMENT 'Disk result from the Galfit fit',
re_d_f850 double COMMENT 'Disk result from the Galfit fit',
re_d_f105 double COMMENT 'Disk result from the Galfit fit',
re_d_f125 double COMMENT 'Disk result from the Galfit fit',
re_d_f160 double COMMENT 'Disk result from the Galfit fit',
n_d_f435 double COMMENT 'Disk result from the Galfit fit',
n_d_f606 double COMMENT 'Disk result from the Galfit fit',
n_d_f775 double COMMENT 'Disk result from the Galfit fit',
n_d_f814 double COMMENT 'Disk result from the Galfit fit',
n_d_f850 double COMMENT 'Disk result from the Galfit fit',
n_d_f105 double COMMENT 'Disk result from the Galfit fit',
n_d_f125 double COMMENT 'Disk result from the Galfit fit',
n_d_f160 double COMMENT 'Disk result from the Galfit fit',
pa_d_f435 double COMMENT 'Disk result from the Galfit fit',
pa_d_f606 double COMMENT 'Disk result from the Galfit fit',
pa_d_f775 double COMMENT 'Disk result from the Galfit fit',
pa_d_f814 double COMMENT 'Disk result from the Galfit fit',
pa_d_f850 double COMMENT 'Disk result from the Galfit fit',
pa_d_f105 double COMMENT 'Disk result from the Galfit fit',
pa_d_f125 double COMMENT 'Disk result from the Galfit fit',
pa_d_f160 double COMMENT 'Disk result from the Galfit fit',
q_d_f435 double COMMENT 'Disk result from the Galfit fit',
q_d_f606 double COMMENT 'Disk result from the Galfit fit',
q_d_f775 double COMMENT 'Disk result from the Galfit fit',
q_d_f814 double COMMENT 'Disk result from the Galfit fit',
q_d_f850 double COMMENT 'Disk result from the Galfit fit',
q_d_f105 double COMMENT 'Disk result from the Galfit fit',
q_d_f125 double COMMENT 'Disk result from the Galfit fit',
q_d_f160 double COMMENT 'Disk result from the Galfit fit',
lmass_d double COMMENT 'Disk log[mass/Msol]',
l68_lmass_d double COMMENT 'Disk log[mass/Msol] lower estimation',
u68_lmass_d double COMMENT 'Disk log[mass/Msol] upper estimation',
uv_d double COMMENT 'Disk uv rest frame color',
err_uv_d double COMMENT 'Error in Disk uv rest frame color',
vj_d double COMMENT 'Disk vj rest frame color',
err_vj_d double COMMENT 'Error in Disk vj rest frame color',
chi2_d double COMMENT 'Disk chi2 from the SED fitting',
magberr_f160 double COMMENT 'Error',
magberr_f125 double COMMENT 'Error',
magberr_f105 double COMMENT 'Error',
magberr_f814 double COMMENT 'Error',
magberr_f850 double COMMENT 'Error',
magberr_f775 double COMMENT 'Error',
magberr_f606 double COMMENT 'Error',
magberr_f435 double COMMENT 'Error',
magderr_f160 double COMMENT 'Error',
magderr_f125 double COMMENT 'Error',
magderr_f105 double COMMENT 'Error',
magderr_f814 double COMMENT 'Error',
magderr_f850 double COMMENT 'Error',
magderr_f775 double COMMENT 'Error',
magderr_f606 double COMMENT 'Error',
magderr_f435 double COMMENT 'Error',
magerr_f160 double COMMENT 'Error',
magerr_f125 double COMMENT 'Error',
magerr_f105 double COMMENT 'Error',
magerr_f814 double COMMENT 'Error',
magerr_f850 double COMMENT 'Error',
magerr_f775 double COMMENT 'Error',
magerr_f606 double COMMENT 'Error',
magerr_f435 double COMMENT 'Error',
nberr_f160 double COMMENT 'Error',
nberr_f125 double COMMENT 'Error',
nberr_f105 double COMMENT 'Error',
nberr_f850 double COMMENT 'Error',
nberr_f814 double COMMENT 'Error',
nberr_f775 double COMMENT 'Error',
nberr_f606 double COMMENT 'Error',
nberr_f435 double COMMENT 'Error',
nderr_f160 double COMMENT 'Error',
nderr_f125 double COMMENT 'Error',
nderr_f105 double COMMENT 'Error',
nderr_f850 double COMMENT 'Error',
nderr_f814 double COMMENT 'Error',
nderr_f775 double COMMENT 'Error',
nderr_f606 double COMMENT 'Error',
nderr_f435 double COMMENT 'Error',
nerr_f160 double COMMENT 'Error',
nerr_f125 double COMMENT 'Error',
nerr_f105 double COMMENT 'Error',
nerr_f850 double COMMENT 'Error',
nerr_f814 double COMMENT 'Error',
nerr_f775 double COMMENT 'Error',
nerr_f606 double COMMENT 'Error',
nerr_f435 double COMMENT 'Error',
reberr_f160 double COMMENT 'Error',
reberr_f125 double COMMENT 'Error',
reberr_f105 double COMMENT 'Error',
reberr_f850 double COMMENT 'Error',
reberr_f814 double COMMENT 'Error',
reberr_f775 double COMMENT 'Error',
reberr_f606 double COMMENT 'Error',
reberr_f435 double COMMENT 'Error',
rederr_f160 double COMMENT 'Error',
rederr_f125 double COMMENT 'Error',
rederr_f105 double COMMENT 'Error',
rederr_f850 double COMMENT 'Error',
rederr_f814 double COMMENT 'Error',
rederr_f775 double COMMENT 'Error',
rederr_f606 double COMMENT 'Error',
rederr_f435 double COMMENT 'Error',
reerr_f160 double COMMENT 'Error',
reerr_f125 double COMMENT 'Error',
reerr_f105 double COMMENT 'Error',
reerr_f850 double COMMENT 'Error',
reerr_f814 double COMMENT 'Error',
reerr_f775 double COMMENT 'Error',
reerr_f606 double COMMENT 'Error',
reerr_f435 double COMMENT 'Error',
qberr_f160 double COMMENT 'Error',
qberr_f125 double COMMENT 'Error',
qberr_f105 double COMMENT 'Error',
qberr_f850 double COMMENT 'Error',
qberr_f814 double COMMENT 'Error',
qberr_f775 double COMMENT 'Error',
qberr_f606 double COMMENT 'Error',
qberr_f435 double COMMENT 'Error',
qderr_f160 double COMMENT 'Error',
qderr_f125 double COMMENT 'Error',
qderr_f105 double COMMENT 'Error',
qderr_f850 double COMMENT 'Error',
qderr_f814 double COMMENT 'Error',
qderr_f775 double COMMENT 'Error',
qderr_f606 double COMMENT 'Error',
qderr_f435 double COMMENT 'Error',
qerr_f160 double COMMENT 'Error',
qerr_f125 double COMMENT 'Error',
qerr_f105 double COMMENT 'Error',
qerr_f850 double COMMENT 'Error',
qerr_f814 double COMMENT 'Error',
qerr_f775 double COMMENT 'Error',
qerr_f606 double COMMENT 'Error',
qerr_f435 double COMMENT 'Error',
magbbias_f435 double COMMENT 'Bias',
magbbias_f606 double COMMENT 'Bias',
magbbias_f775 double COMMENT 'Bias',
magbbias_f814 double COMMENT 'Bias',
magbbias_f850 double COMMENT 'Bias',
magbbias_f105 double COMMENT 'Bias',
magbbias_f125 double COMMENT 'Bias',
magbbias_f160 double COMMENT 'Bias',
magdbias_f435 double COMMENT 'Bias',
magdbias_f606 double COMMENT 'Bias',
magdbias_f775 double COMMENT 'Bias',
magdbias_f814 double COMMENT 'Bias',
magdbias_f850 double COMMENT 'Bias',
magdbias_f105 double COMMENT 'Bias',
magdbias_f125 double COMMENT 'Bias',
magdbias_f160 double COMMENT 'Bias',
rebbias_f435 double COMMENT 'Bias',
rebbias_f606 double COMMENT 'Bias',
rebbias_f775 double COMMENT 'Bias',
rebbias_f814 double COMMENT 'Bias',
rebbias_f850 double COMMENT 'Bias',
rebbias_f105 double COMMENT 'Bias',
rebbias_f125 double COMMENT 'Bias',
rebbias_f160 double COMMENT 'Bias',
redbias_f435 double COMMENT 'Bias',
redbias_f606 double COMMENT 'Bias',
redbias_f775 double COMMENT 'Bias',
redbias_f814 double COMMENT 'Bias',
redbias_f850 double COMMENT 'Bias',
redbias_f105 double COMMENT 'Bias',
redbias_f125 double COMMENT 'Bias',
redbias_f160 double COMMENT 'Bias',
nbbias_f435 double COMMENT 'Bias',
nbbias_f606 double COMMENT 'Bias',
nbbias_f775 double COMMENT 'Bias',
nbbias_f814 double COMMENT 'Bias',
nbbias_f850 double COMMENT 'Bias',
nbbias_f105 double COMMENT 'Bias',
nbbias_f125 double COMMENT 'Bias',
nbbias_f160 double COMMENT 'Bias',
pabbias_f435 double COMMENT 'Bias',
pabbias_f606 double COMMENT 'Bias',
pabbias_f775 double COMMENT 'Bias',
pabbias_f814 double COMMENT 'Bias',
pabbias_f850 double COMMENT 'Bias',
pabbias_f105 double COMMENT 'Bias',
pabbias_f125 double COMMENT 'Bias',
pabdias_f435 double COMMENT 'Bias',
pabdias_f606 double COMMENT 'Bias',
pabdias_f775 double COMMENT 'Bias',
pabdias_f814 double COMMENT 'Bias',
pabdias_f850 double COMMENT 'Bias',
pabdias_f105 double COMMENT 'Bias',
pabdias_f125 double COMMENT 'Bias',
qbbias_f435 double COMMENT 'Bias',
qbbias_f606 double COMMENT 'Bias',
qbbias_f775 double COMMENT 'Bias',
qbbias_f814 double COMMENT 'Bias',
qbbias_f850 double COMMENT 'Bias',
qbbias_f105 double COMMENT 'Bias',
qbbias_f125 double COMMENT 'Bias',
qbbias_f160 double COMMENT 'Bias',
qdbias_f435 double COMMENT 'Bias',
qdbias_f606 double COMMENT 'Bias',
qdbias_f775 double COMMENT 'Bias',
qdbias_f814 double COMMENT 'Bias',
qdbias_f850 double COMMENT 'Bias',
qdbias_f105 double COMMENT 'Bias',
qdbias_f125 double COMMENT 'Bias',
qdbias_f160 double COMMENT 'Bias',
mtbias_f435 double COMMENT 'Bias',
mtbias_f606 double COMMENT 'Bias',
mtbias_f775 double COMMENT 'Bias',
mtbias_f814 double COMMENT 'Bias',
mtdias_f850 double COMMENT 'Bias',
mtbias_f105 double COMMENT 'Bias',
mtbias_f125 double COMMENT 'Bias',
mtbias_f160 double COMMENT 'Bias'
)
CLUSTERED BY ( 
  id) 
INTO 4 BUCKETS
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.ql.io.orc.OrcSerde' 
STORED AS INPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' 
OUTPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
;

And now the INSERT OVERWRITE command: 

INSERT OVERWRITE TABLE cosmohub.candels_18_c
SELECT * FROM jcarrete.candels_18_pq;

Statistics: 

ANALYZE TABLE cosmohub.candels_18_c COMPUTE STATISTICS;
ANALYZE TABLE cosmohub.candels_18_c COMPUTE STATISTICS FOR COLUMNS;


CosmoHub info

Retrieved from "http://pwiki.pic.es/index.php?title=CANDELS_2018&oldid=540"