https://pwiki.pic.es/index.php?action=history&feed=atom&title=HowTo%3A_Clean_old_Billing_PostgreSQL_records 2026-04-26T08:42:30Z Revision history for this page on the wiki MediaWiki 1.35.14 https://pwiki.pic.es/index.php?title=HowTo:_Clean_old_Billing_PostgreSQL_records&diff=85&oldid=prev 2015-08-07T09:29:31Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:29, 7 August 2015</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l18" >Line 18:</td> <td colspan="2" class="diff-lineno">Line 18:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''storageinfo'''</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''storageinfo'''</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''hitinfo'''</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''hitinfo'''</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>:<del class="diffchange diffchange-inline">''</del>'''costinfo<del class="diffchange diffchange-inline">''</del>''' (not available in our current dCache instances)</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>:'''costinfo''' (not available in our current dCache instances)</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Delete information of these tables as follows:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Delete information of these tables as follows:</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from billinginfo where datestamp&lt;current_date-interval '6 months';</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from billinginfo where datestamp&lt;current_date-interval '6 months';</div></td></tr> </table>

Mcaubet https://pwiki.pic.es/index.php?title=HowTo:_Clean_old_Billing_PostgreSQL_records&diff=84&oldid=prev 2015-08-07T09:29:19Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:29, 7 August 2015</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l18" >Line 18:</td> <td colspan="2" class="diff-lineno">Line 18:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''storageinfo'''</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''storageinfo'''</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''hitinfo'''</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>:'''hitinfo'''</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>:''costinfo'' (not available in our current dCache instances)</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>:<ins class="diffchange diffchange-inline">'''</ins>''costinfo<ins class="diffchange diffchange-inline">'''</ins>'' (not available in our current dCache instances)</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Delete information of these tables as follows:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Delete information of these tables as follows:</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from billinginfo where datestamp&lt;current_date-interval '6 months';</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from billinginfo where datestamp&lt;current_date-interval '6 months';</div></td></tr> </table>

Mcaubet https://pwiki.pic.es/index.php?title=HowTo:_Clean_old_Billing_PostgreSQL_records&diff=83&oldid=prev 2015-08-07T09:29:03Z

<p></p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:29, 7 August 2015</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l25" >Line 25:</td> <td colspan="2" class="diff-lineno">Line 25:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from hitinfo    where datestamp&lt;current_date-interval '6 months';</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from hitinfo    where datestamp&lt;current_date-interval '6 months';</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from costinfo    where datestamp&lt;current_date-interval '6 months';</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  delete from costinfo    where datestamp&lt;current_date-interval '6 months';</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>:If needed, you can changes the number of months to be deleted from 6 to <del class="diffchange diffchange-inline">another </del>value.</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>:If needed, you can changes the number of months to be deleted from 6 to <ins class="diffchange diffchange-inline">a different </ins>value.</div></td></tr> </table>

Mcaubet https://pwiki.pic.es/index.php?title=HowTo:_Clean_old_Billing_PostgreSQL_records&diff=82&oldid=prev 2015-08-07T09:28:52Z

<p>Created page with &quot;= About billing = * Billing contains two ways in order to record all historic information: :* Logfiles located in: &#039;&#039;&#039;dcip.pic.es:/var/lib/dcache/billing/&#039;&#039;&#039; :* Database locat...&quot;</p> <p><b>New page</b></p><div>= About billing =<br /> * Billing contains two ways in order to record all historic information:<br /> :* Logfiles located in: '''dcip.pic.es:/var/lib/dcache/billing/'''<br /> :* Database located in: '''dcip.pic.es:/var/lib/pgsql/'''<br /> = Motivation =<br /> * Billing database use to grow very fast.<br /> * Sometimes, during a dCache upgrade (mostly on major release upgrades) a schema update is needed<br /> :* How much greater is the database much longer will be the schema update.<br /> * '''We need to decrease the database size by periodically deleting data'''<br /> :* Or '''otherwise we can startup a database from the scratch''' by moving the old database to a historic instance and running the schema update on a fresh billing database<br /> ::Please refer to '''[[HowTo: Reset Billing PostgreSQL]]''' if you decide to startup a database from a scratch by keeping a backup of the old database.<br /> <br /> = Deleting old information =<br /> * We can reduce the size of the billing database by deleting records from the last ''X'' months.<br /> * We should mostly delete information from the following tables:<br /> :'''billinginfo'''<br /> :'''doorinfo'''<br /> :'''storageinfo'''<br /> :'''hitinfo'''<br /> :''costinfo'' (not available in our current dCache instances)<br /> * Delete information of these tables as follows:<br /> delete from billinginfo where datestamp&lt;current_date-interval '6 months';<br /> delete from doorinfo where datestamp&lt;current_date-interval '6 months';<br /> delete from storageinfo where datestamp&lt;current_date-interval '6 months';<br /> delete from hitinfo where datestamp&lt;current_date-interval '6 months';<br /> delete from costinfo where datestamp&lt;current_date-interval '6 months';<br /> :If needed, you can changes the number of months to be deleted from 6 to another value.</div>

Mcaubet