Monitoring dCache with ELK

From Public PIC Wiki
Revision as of 15:16, 13 June 2022 by Eplanas (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

PIC & ELK (obsolete)

  • PIC has an ELK (ElasticSearch + LogStash + Kibana) service in order to monitor the different batch & storage services.
  • A Kibana4 Dashboard can be accessed in the following link: Kibana4

Monitoring Dashboards

Monitoring the number of transfers, stores, restores, removes & hits in time per VO

  • Link: dCache Statistics in Time per VO
  • In this Dashboard we can find how many stores and restores have run in the last X hours (default value is 15 minutes), as well as the amount of transfers and hits. Number of removed files is also shown.

Monitoring transfers

  • A plot showing information about moved data in the last X hours for the top 20 dCache pools. Here also is specified how many data has been moved by protocol and which protocols have been used per pool.
  • A plot showing information about moved data in the last X hours for all dCache pools. Here also is specified how many data has been moved by protocol and which protocols have been used per pool.
  • A stack plot showing the amount of data moved by DN.
  • A window with percentil statistics.

Transferred data by protocol

  • Link: dCache Transferred Bytes (Read & Writes) Dashboard
  • In this Dashboard we have several plots, basically showing the amount of data moved by each protocol.
  • A big plot is showing the amount of data moved by all protocols
  • We have also 2 plots showing the amount of data moved due to stores and restores.