Difference between revisions of "Spark on Hadoop"
Jump to navigation
Jump to search
Torradeflot (talk | contribs) (Created blank page) |
Torradeflot (talk | contribs) |
||
| Line 1: | Line 1: | ||
| + | = Monitoring you Spark jobs = | ||
| + | Spark jobs submitted to Yarn can be monitored through the web interface at http://hsrv02.pic.es:8088 | ||
| + | |||
| + | You need to have a VPN and Kerberos authentication configured in your browser if you want to access it. | ||
| + | |||
| + | == How to configure Kerberos authentication with Firefox == | ||
| + | |||
| + | Tested in a Ubuntu 22 server with Firefox installed with apt. Configuring Kerberos authentication with other browser & OS combinations may be differ or not be supported. | ||
| + | |||
| + | You need to have Kerberos client installed in your PC. | ||
| + | |||
| + | Update the "/etc/krb5.conf" file to contain PIC real: | ||
| + | |||
| + | |||
| + | [realms] | ||
| + | PIC.ES = { | ||
| + | kdc = ipa01.pic.es:88 | ||
| + | master_kdc = ipa01.pic.es:88 | ||
| + | admin_server = ipa01.pic.es:749 | ||
| + | kpasswd_server = ipa01.pic.es:464 | ||
| + | default_domain = pic.es | ||
| + | } | ||
| + | |||
| + | [domain_realm] | ||
| + | .pic.es = PIC.ES | ||
| + | pic.es = PIC.ES | ||
| + | hsrv03.pic.es = PIC.ES | ||
Revision as of 10:17, 8 May 2025
Monitoring you Spark jobs
Spark jobs submitted to Yarn can be monitored through the web interface at http://hsrv02.pic.es:8088
You need to have a VPN and Kerberos authentication configured in your browser if you want to access it.
How to configure Kerberos authentication with Firefox
Tested in a Ubuntu 22 server with Firefox installed with apt. Configuring Kerberos authentication with other browser & OS combinations may be differ or not be supported.
You need to have Kerberos client installed in your PC.
Update the "/etc/krb5.conf" file to contain PIC real:
[realms]
PIC.ES = {
kdc = ipa01.pic.es:88
master_kdc = ipa01.pic.es:88
admin_server = ipa01.pic.es:749
kpasswd_server = ipa01.pic.es:464
default_domain = pic.es
}
[domain_realm]
.pic.es = PIC.ES pic.es = PIC.ES hsrv03.pic.es = PIC.ES