Transferring data to/from PIC - Revision history

Torradeflot: /* Configuration (only once) */

2026-05-14T15:18:18Z

Configuration (only once)

Tallada at 15:27, 7 May 2026

2026-05-07T15:27:39Z

Tallada at 12:32, 7 May 2026

2026-05-07T12:32:05Z

Tallada: /* Usage */

2025-05-27T09:26:12Z

Usage

Tallada at 13:17, 5 June 2024

2024-06-05T13:17:40Z

Tallada: /* Obtaining a macaroon (for contacts) */

2024-06-04T09:21:30Z

Obtaining a macaroon (for contacts)

Tallada: Tallada moved page DCache webdav i dCacheView to Transferring data to/from PIC

2023-12-20T14:53:29Z

Tallada moved page DCache webdav i dCacheView to Transferring data to/from PIC

Tallada: /* How to provide data access to PIC massive storage (dCache) = */

2023-12-15T12:59:42Z

How to provide data access to PIC massive storage (dCache) =

Tallada at 12:59, 15 December 2023

2023-12-15T12:59:03Z

Show changes

Tallada at 11:24, 6 December 2023

2023-12-06T11:24:02Z

@@ Line 184: / Line 184: @@
 === Configuration (only once) ===
 Configure a <code>pic-dcache</code> account to retrieve tokens from PIC. Open the URL that will show and input the code provided (or just open the QR code displayed).
 After authenticating on the web browser, return to the terminal and input an encryption password twice. You'll need it when refreshing/reloading the <code>oidc-agent</code>.
-     $ oidc-gen -m --client-id oidc-agent --pub --flow=device \
+     $ oidc-gen -m --client-id dcache-view \
        --discovery-endpoint=https://idp.pic.es/realms/PIC/.well-known/openid-configuration \
        --scope="openid profile offline_access" --redirect-uri=edu.kit.data.oidc-agent:/ pic-dcache

@@ Line 48: / Line 48: @@
      E.g. https://example.com.
      Enter a value.
-     url>  https://door04.pic.es/PATH_TO_YOUR_STORAGE_SPACE
+     url>  https://webdav.pic.es/PATH_TO_YOUR_STORAGE_SPACE
      Option vendor.

@@ Line 91: / Line 91: @@
      Enter a value. Press Enter to leave empty.
      bearer_token> YOUR_MACAROON_TOKEN
 === Review settings ===
@@ Line 155: / Line 172: @@
 See rclone manual for more extensive documentation https://rclone.org/docs/
 == Obtaining a macaroon (for contacts) ==

@@ Line 144: / Line 144: @@
 When uploading data, we recommend using the following flags, where n_transfers can be up to 350 if transferring lots of small files
    --check-first -P --stats-one-line --transfers <n_transfers> --size-only
 See rclone manual for more extensive documentation https://rclone.org/docs/

@@ Line 48: / Line 48: @@
      E.g. https://example.com.
      Enter a value.
-     url>  https://webdav.pic.es/PATH_TO_YOUR_STORAGE_SPACE
+     url>  https://door04.pic.es/PATH_TO_YOUR_STORAGE_SPACE
      Option vendor.
@@ Line 104: / Line 104: @@
      Options:
      - type: webdav
-     - url: https://webdav.pic.es/PATH_TO_YOUR_STORAGE_SPACE
+     - url: https://door04.pic.es/PATH_TO_YOUR_STORAGE_SPACE
      - vendor: other
      - user: YOUR_PIC_USERNAME
@@ Line 156: / Line 156: @@
 $ curl -u ${USER} -X POST -H 'Content-Type: application/macaroon-request' \
 -d '{"caveats": ["activity:DOWNLOAD,LIST"], "validity": "P7D"}' \
-https://webdav.pic.es:8460/${RESTRICTED_PATH}
+https://door04.pic.es:8460/${RESTRICTED_PATH}
+{
      "macaroon": "MDA2MGxvY2F0aW",
      "uri": {
-         "targetWithMacaroon": "https://webdav.pic.es:8460/${RESTRICTED_PATH}?authz=MDA2MGxvY2F0aW",
+         "targetWithMacaroon": "https://door04.pic.es:8460/${RESTRICTED_PATH}?authz=MDA2MGxvY2F0aW",
-         "baseWithMacaroon": "https://webdav.pic.es:8460/?authz=MDA2MGxvY2F0aW",
+         "baseWithMacaroon": "https://door04.pic.es:8460/?authz=MDA2MGxvY2F0aW",
-         "target": "https://webdav.pic.es:8460/${RESTRICTED_PATH}",
+         "target": "https://door04.pic.es:8460/${RESTRICTED_PATH}",
-         "base": "https://webdav.pic.es:8460/"
+         "base": "https://door04.pic.es:8460/"
+     }
+}
@@ Line 174: / Line 174: @@
 $ curl -u ${USER} -X POST -H 'Content-Type: application/macaroon-request' \
 -d '{"validity": "P7D"}' \
-https://webdav.pic.es:8460/${RESTRICTED_PATH}
+https://door04.pic.es:8460/${RESTRICTED_PATH}
+{
      "macaroon": "MDA2MGxvY2F0aW",
      "uri": {
-         "targetWithMacaroon": "https://webdav.pic.es:8460/${RESTRICTED_PATH}?authz=MDA2MGxvY2F0aW",
+         "targetWithMacaroon": "https://door04.pic.es:8460/${RESTRICTED_PATH}?authz=MDA2MGxvY2F0aW",
-         "baseWithMacaroon": "https://webdav.pic.es:8460/?authz=MDA2MGxvY2F0aW",
+         "baseWithMacaroon": "https://door04.pic.es:8460/?authz=MDA2MGxvY2F0aW",
-         "target": "https://webdav.pic.es:8460/${RESTRICTED_PATH}",
+         "target": "https://door04.pic.es:8460/${RESTRICTED_PATH}",
-         "base": "https://webdav.pic.es:8460/"
+         "base": "https://door04.pic.es:8460/"
+     }
+}
 </pre>

← Older revision	Revision as of 14:53, 20 December 2023
(No difference)

← Older revision		Revision as of 12:59, 15 December 2023
Line 1:		Line 1:
−	= How to provide data access to PIC massive storage (dCache) ==	+	= How to provide data access to PIC massive storage (dCache) =

	== Requirements ==		== Requirements ==

@@ Line 8: / Line 8: @@
 ==== dCacheView frontend (optional) ====
-https://webdav-mice.pic.es:8470
+https://webdav.pic.es:8470
 ==== Authentication ====