https://pwiki.pic.es/index.php?action=history&feed=atom&title=Python_Jupyter 2026-05-15T10:54:12Z Revision history for this page on the wiki MediaWiki 1.35.14 https://pwiki.pic.es/index.php?title=Python_Jupyter&diff=385&oldid=prev 2019-04-01T13:25:28Z

<p>Created page with &quot;== Spark notebooks == In order to launch a Spark notebook, you can use the script at &lt;code&gt;/software/astro/scripts/spark_notebook.sh&lt;/code&gt;. Available arguments are: -e:...&quot;</p> <p><b>New page</b></p><div>== Spark notebooks ==<br /> <br /> In order to launch a Spark notebook, you can use the script at &lt;code&gt;/software/astro/scripts/spark_notebook.sh&lt;/code&gt;.<br /> <br /> Available arguments are:<br /> -e: name of python environment (in ~/env/)<br /> -c: spark executor cores (default: 5)<br /> -m: spark executor memory (default: 15G)<br /> -o: spark executor overhead memory (default: 7.5G)<br /> -n: number of executors (default: dynamic)<br /> -p: port to listen to, may be different if busy (default: 8888)<br /> -d: spark driver memory (default: 4G)<br /> -r: spark driver max result size (default: 2G)<br /> -g: whether to do enable python profiling (default: false)<br /> <br /> Example<br /> <br /> /software/astro/scripts/spark_notebook.sh -e mocks -n 20 -g</div>

Tallada