Third Party Copy test summary

FTS SERVER fts.usatlas.bnl.gov

Thu Jan 26 16:22:17 CET 2023 - TEST HISTORY<

Green if Pull and Push tansfers have been completed successfully, Yellow if at least a Pull or a Push transfer have been completed successfully, Red if Pull and Push tansfers failed

DESTINATION

S O U R C E		CNAF-TMP-SE	DESY-TMP-SE	IN2P3CC-TMP-SE	KIT-TMP-SE	CESNET-TMP-SE	IPHC-TMP-SE	LAL-TMP-SE	Pisa-TMP-SE	ROMA3-TMP-SE	Frascati-TMP-SE	Napoli-TMP-SE	CYFRONET-TMP-SE	ULAKBIM-TMP-SE	KEK-DEV-TMP-SE	SIGNET-TMP-SE	Torino-TMP-SE	MPPMU-TMP-SE	HEPHY-TMP-SE	NTUCC-TMP-SE	UVic-TMP-SE-DCACHE	TAU-TMP-SE	BNL-TMP-SE	NDU-TMP-SE	Australia-SE	UNIMELB-TMP-SE	IHEP-TMP-SE
	CNAF-TMP-SE		Pull FINISHED		Pull FINISHED		Push FINISHED	Push FINISHED	Pull FINISHED	Push FINISHED		FINISEHD	Pull FINISHED	Pull FINISHED			Push FINISHED	Pull FINISHED	Pull FINISHED			Pull FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	Push FINISHED
	DESY-TMP-SE	Pull FINISHED		Pull FINISHED	Push FINISHED	Pull FINISHED			Pull FINISHED	Push FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	Pull FINISHED	FINISEHD	Pull FINISHED		Push FINISHED	FINISEHD	Pull FINISHED	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	FAILED
	IN2P3CC-TMP-SE	FINISEHD	Pull FINISHED		FINISEHD		FINISEHD		FINISEHD		FINISEHD	Pull FINISHED		Pull FINISHED		Pull FINISHED	FINISEHD	Push FINISHED	Push FINISHED		FINISEHD	FINISEHD	FINISEHD	FINISEHD		Pull FINISHED	FAILED
	KIT-TMP-SE	FINISEHD	Pull FINISHED	FINISEHD		FINISEHD	Pull FINISHED			FINISEHD	FINISEHD	FINISEHD		FINISEHD	FINISEHD	Pull FINISHED	Push FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD
	CESNET-TMP-SE	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED		Pull FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD		Push FINISHED	Pull FINISHED	FINISEHD	Pull FINISHED		Pull FINISHED	Pull FINISHED				Pull FINISHED		Pull FINISHED		Pull FINISHED	FAILED
	IPHC-TMP-SE	Pull FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED				FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	Pull FINISHED	FINISEHD	Push FINISHED	FINISEHD		Push FINISHED	FINISEHD	FINISEHD	Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	ERROR
	LAL-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Pull FINISHED		FINISEHD	Pull FINISHED	Push FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED	Push FINISHED	Pull FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED	FINISEHD	Pull FINISHED	Push FINISHED	Push FINISHED		Pull FINISHED	FINISEHD	ERROR
	Pisa-TMP-SE	FINISEHD	Pull FINISHED		Push FINISHED	FINISEHD				Pull FINISHED	FINISEHD			Pull FINISHED	FINISEHD	Push FINISHED		FINISEHD		Push FINISHED			Pull FINISHED	Push FINISHED	Pull FINISHED	Push FINISHED
	ROMA3-TMP-SE		Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED			Push FINISHED	Push FINISHED					FINISEHD		Pull FINISHED	Push FINISHED			FINISEHD			FAILED
	Frascati-TMP-SE		FINISEHD	Pull FINISHED	Push FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD			FINISEHD	FINISEHD	FINISEHD		FINISEHD		FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD				Pull FINISHED	FAILED
	Napoli-TMP-SE	Pull FINISHED	FINISEHD	Pull FINISHED	Push FINISHED	Push FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	FINISEHD		Pull FINISHED	FINISEHD	FINISEHD	FINISEHD		Pull FINISHED		FINISEHD	Pull FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	ERROR
	CYFRONET-TMP-SE	FINISEHD					Pull FINISHED	Pull FINISHED		Pull FINISHED	Push FINISHED			FINISEHD	Push FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED			FINISEHD	FINISEHD	Push FINISHED	Pull FINISHED	ERROR
	ULAKBIM-TMP-SE		Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED		Push FINISHED	Pull FINISHED		FINISEHD						Push FINISHED	FINISEHD	Push FINISHED						Pull FINISHED
	KEK-DEV-TMP-SE	Pull FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	FINISEHD			FINISEHD		Pull FINISHED		Push FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED		Pull FINISHED
	SIGNET-TMP-SE	FINISEHD			Pull FINISHED		Push FINISHED	Pull FINISHED	Push FINISHED	Push FINISHED		Push FINISHED		Push FINISHED			FINISEHD	Push FINISHED	Push FINISHED		Pull FINISHED						FAILED
	Torino-TMP-SE	Push FINISHED			Pull FINISHED			Push FINISHED	Push FINISHED		Push FINISHED	Push FINISHED	Pull FINISHED			Pull FINISHED			FAILED			Push FINISHED	Push FINISHED		FAILED
	MPPMU-TMP-SE	FINISEHD		Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Pull FINISHED		FINISEHD	Pull FINISHED	Pull FINISHED	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD		FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	FINISEHD		Pull FINISHED	FAILED
	HEPHY-TMP-SE	Pull FINISHED	Push FINISHED				Pull FINISHED	Pull FINISHED	Push FINISHED		Pull FINISHED		Pull FINISHED		FAILED	Push FINISHED	Pull FINISHED	Push FINISHED		Push FINISHED		Push FINISHED	FINISEHD	FAILED	FAILED	ERROR	Push FINISHED
	NTUCC-TMP-SE	FINISEHD	FINISEHD	Push FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD		Pull FINISHED	Pull FINISHED	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Pull FINISHED		Pull FINISHED			Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Pull FINISHED	FAILED
	UVic-TMP-SE-DCACHE			Pull FINISHED		Pull FINISHED	FINISEHD	Push FINISHED				Pull FINISHED	Push FINISHED	Pull FINISHED	Push FINISHED	Pull FINISHED	Push FINISHED		Push FINISHED	FAILED		Push FINISHED	Push FINISHED			Pull FINISHED
	TAU-TMP-SE		Push FINISHED		Push FINISHED				Push FINISHED	Push FINISHED		FINISEHD	FINISEHD	Push FINISHED	Push FINISHED		Push FINISHED						Push FINISHED	Push FINISHED	Push FINISHED		Push FINISHED
	BNL-TMP-SE			Pull FINISHED	FAILED	Pull FINISHED		Pull FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	Pull FINISHED			Pull FINISHED			Pull FINISHED		Pull FINISHED					Pull FINISHED	FAILED
	NDU-TMP-SE	Pull FINISHED			Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Pull FINISHED	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD		FINISEHD	Push FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	FINISEHD			Pull FINISHED	FAILED
	Australia-SE		Push FINISHED		Push FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED		FAILED	FAILED		Pull FINISHED				FAILED	Pull FINISHED	FAILED			Pull FINISHED		Pull FINISHED		FAILED
	UNIMELB-TMP-SE				Pull FINISHED	FINISEHD		Push FINISHED			Pull FINISHED		Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	FAILED		FAILED			FAILED		Pull FINISHED	FAILED
	IHEP-TMP-SE	Pull FINISHED		FAILED	FAILED	FAILED	ERROR	ERROR	FAILED	Pull FINISHED	FAILED	FAILED	FAILED	FAILED		FAILED	Pull FINISHED		FAILED	Pull FINISHED	Pull FINISHED	Pull FINISHED	FAILED	Pull FINISHED	Pull FINISHED	Pull FINISHED

PUSH TEST - DETAILS

DESTINATION

S
O
U
R
C
E

CNAF-TMP-SE

DESY-TMP-SE

IN2P3CC-TMP-SE

KIT-TMP-SE

CESNET-TMP-SE

IPHC-TMP-SE

LAL-TMP-SE

Pisa-TMP-SE

ROMA3-TMP-SE

Frascati-TMP-SE

Napoli-TMP-SE

CYFRONET-TMP-SE

ULAKBIM-TMP-SE

KEK-DEV-TMP-SE

SIGNET-TMP-SE

Torino-TMP-SE

MPPMU-TMP-SE

HEPHY-TMP-SE

NTUCC-TMP-SE

UVic-TMP-SE-DCACHE

TAU-TMP-SE

BNL-TMP-SE

NDU-TMP-SE

Australia-SE

UNIMELB-TMP-SE

IHEP-TMP-SE

CNAF-TMP-SE

Duration: 11 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 9 seconds

DESY-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 12 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 31 seconds

IN2P3CC-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 39 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 6 seconds

KIT-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 36 seconds

CESNET-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 7 seconds

IPHC-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 23 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

LAL-TMP-SE

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 8 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 45 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

Pisa-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 7 seconds

Duration: 5 seconds

Duration: 29 seconds

ROMA3-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 9 seconds

Duration: 3 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://dynafedtest.atlas.unimelb.edu.au:8443/myfed/test/TMP/belle/test/TPC/10MB-push-ROMA3-TMP-SE: The peer's certificate with subject's DN CN=dynafedtest.atlas.unimelb.edu.au,O=University of Melbourne,L=Carlton,ST=Victoria,C=AU,DC=DigiCert-Grid,DC=com was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

Frascati-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 2 seconds

Duration: 7 seconds

Duration: 5 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

Napoli-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 16 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 11 seconds

Duration: 4 seconds

Duration: 13 seconds

Duration: 35 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_01/belle/2023-01-26/10MB-push-Napoli-TMP-SE.1035515.1674745041?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-Napoli-TMP-SE&token=HCWV9RlotDiomr3Lz1AwR2kVJkg%3D%401674746041%401]\n

CYFRONET-TMP-SE

Duration: 4 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 15 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

ULAKBIM-TMP-SE

Duration: 4 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 13 seconds

Duration: 10 seconds

Duration: 11 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 0: Operation timed out after 300315 milliseconds with 0 out of 0 bytes received\n

KEK-DEV-TMP-SE

Duration: 5 seconds

Duration: 4 seconds

Duration: 7 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 11 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-KEK-DEV-TMP-SE: Write error: ssl=0x7f5a201ea3a8: I/O error during system call, Connection reset by peer

FINISHED

Duration: 4 seconds

FINISHED

Duration: 5 seconds

SIGNET-TMP-SE

Duration: 2 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 14 seconds

Duration: 3 seconds

Torino-TMP-SE

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SocketException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-Torino-TMP-SE: Connection reset by peer (Write failed)

FINISHED

Duration: 3 seconds

FINISHED

Duration: 2 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://dynafed02.heprc.uvic.ca:8443/dynafed/Melbourne/TMP/belle/test/TPC/10MB-push-Torino-TMP-SE: The peer's certificate with subject's DN CN=grid.objects.storage.unimelb.edu.au,O=University of Melbourne,L=Carlton,ST=Victoria,C=AU,DC=DigiCert-Grid,DC=com was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

MPPMU-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 9 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 5 seconds

HEPHY-TMP-SE

Duration: 2 seconds

Duration: 1 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 2 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Error when interacting with local filesystem: Transfer failed because no bytes have been received in 120 seconds.

FINISHED

Duration: 6 seconds

NTUCC-TMP-SE

Duration: 9 seconds

Duration: 22 seconds

Duration: 17 seconds

Duration: 14 seconds

Duration: 15 seconds

Duration: 11 seconds

Duration: 15 seconds

Duration: 28 seconds

Duration: 11 seconds

Duration: 8 seconds

Duration: 20 seconds

UVic-TMP-SE-DCACHE

Duration: 10 seconds

Duration: 7 seconds

Duration: 9 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 5 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: problem sending data: Certificate for doesn't match any of the subject alternative names: [john@hep1.phys.ntu.edu.tw]\n

FINISHED

Duration: 6 seconds

FINISHED

Duration: 3 seconds

TAU-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 10 seconds

Duration: 11 seconds

BNL-TMP-SE

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

NDU-TMP-SE

Duration: 6 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 10 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 77 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-NDU-TMP-SE: Write error: ssl=0x7f98200350b8: I/O error during system call, ????????????????

FINISHED

Duration: 4 seconds

Australia-SE

FINISHED

Duration: 24 seconds

FINISHED

Duration: 23 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Connection terminated abruptly; Status of TPC request unknown

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Connection terminated abruptly; Status of TPC request unknown

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Connection terminated abruptly; Status of TPC request unknown

UNIMELB-TMP-SE

Duration: 14 seconds

Duration: 15 seconds

Duration: 10 seconds

Duration: 16 seconds

Duration: 11 seconds

Duration: 14 seconds

Reason: DESTINATION [2] Result HTTP 404 : File not found after 1 attempts

FAILED

Reason: DESTINATION [2] Result HTTP 404 : File not found after 1 attempts

IHEP-TMP-SE

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd push). Last attempt: copy HTTP 403 : Permission refused

PULL TEST - DETAILS

DESTINATION

6 seconds 4 seconds 3 seconds 8 seconds 6 seconds 4 seconds 9 seconds 3 seconds 11 seconds 11 seconds 3 seconds 2 seconds 23 seconds 17 seconds 32 seconds

S
O
U
R
C
E

CNAF-TMP-SE

DESY-TMP-SE

IN2P3CC-TMP-SE

KIT-TMP-SE

CESNET-TMP-SE

IPHC-TMP-SE

LAL-TMP-SE

Pisa-TMP-SE

ROMA3-TMP-SE

Frascati-TMP-SE

Napoli-TMP-SE

CYFRONET-TMP-SE

ULAKBIM-TMP-SE

KEK-DEV-TMP-SE

SIGNET-TMP-SE

Torino-TMP-SE

MPPMU-TMP-SE

HEPHY-TMP-SE

NTUCC-TMP-SE

UVic-TMP-SE-DCACHE

TAU-TMP-SE

BNL-TMP-SE

NDU-TMP-SE

Australia-SE

UNIMELB-TMP-SE

IHEP-TMP-SE

CNAF-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 1 seconds

Duration: 3 seconds

Duration: 7 seconds

Duration: 9 seconds

Duration: 9 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 9 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

DESY-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 20 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 10 seconds

Duration: 17 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

IN2P3CC-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 35 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

KIT-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

CESNET-TMP-SE 7 seconds

Duration: 2 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 7 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 32 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 50 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

IPHC-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 35 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 8 seconds

Duration: 34 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

LAL-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 7 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 10 seconds

Duration: 3 seconds

Duration: 11 seconds

Duration: 10 seconds

Duration: 11 seconds

Duration: 33 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

Pisa-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 10 seconds

ROMA3-TMP-SE

Duration: 2 seconds

Duration: 7 seconds

Duration: 2 seconds

Duration: 1 seconds

Duration: 2 seconds

Duration: 2 seconds

Frascati-TMP-SE

Duration: 4 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 29 seconds

Duration: 3 seconds

Duration: 11 seconds

Duration: 4 seconds

Duration: 27 seconds

Napoli-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 7 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 14 seconds

Duration: 8 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 7 seconds

Duration: 8 seconds

Duration: 26 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

CYFRONET-TMP-SE

Duration: 3 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 3 seconds

Duration: 25 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 34 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

ULAKBIM-TMP-SE

FINISHED

Duration: 5 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 0: transfer closed with 10436608 bytes remaining to read\n

Duration: 2 seconds

Duration: 5 seconds

Duration: 7 seconds

Duration: 33 seconds

KEK-DEV-TMP-SE

Duration: 4 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 7 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 9 seconds

Duration: 5 seconds

Duration: 20 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 27 seconds

SIGNET-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

Torino-TMP-SE

FINISHED

Duration: 3 seconds

FINISHED

Duration: 3 seconds

FINISHED

Duration: 3 seconds

MPPMU-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 16 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 36 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

HEPHY-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Error fetching https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB?copy_mode=pull: 403 status code: 403, reason phrase: FORBIDDEN

FINISHED

Duration: 1 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: fst-7.eos.grid.vbc.ac.at:9001 failed to respond; redirects [https://fst-7.eos.grid.vbc.ac.at:9001/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB?encURI=%26cap.sym%3DTU8aiZKgP9JVwZSe2%2FtlKPrdWfk%3D%26cap.msg%3D3nbHSbN5UOFAk%2FeRkrrmP8ZgCi4h4ZJ20MdgUX3KcgxDGkgml3dGoB9L9aO1Jra%2BWFXLNMFOsA0Y6vTnyEEPkDIpvvMHCcUMAilAXJGkd0KiuRG7qAmQbaOhjQEtbvHcAnlzAgKRnJ5LuW29WjB84gdO%2BSG7v%2B0HASrMhJYtrT4mwdNmoN9LT%2ByH1Hxhnj%2BZ66Xt6KGXLzFCySPeGSGFpjdlr02LSi2JMaB2fvJyDWLi4Ss1ZELOiaak7l2yNwZ%2FMYdNcAYr%2

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: SocketTimeoutException while fetching https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB?copy_mode=pull: Read timed out

FINISHED

Duration: 1 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy could not be performed (status: 112): \n

FAILED

Reason: DESTINATION [2] Result HTTP 404 : File not found after 1 attempts

FAILED

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

NTUCC-TMP-SE

Duration: 11 seconds

Duration: 16 seconds

Duration: 10 seconds

Duration: 12 seconds

Duration: 16 seconds

Duration: 20 seconds

Duration: 10 seconds

Duration: 20 seconds

Duration: 16 seconds

Duration: 19 seconds

Duration: 9 seconds

Duration: 12 seconds

Duration: 22 seconds

Duration: 14 seconds

Duration: 15 seconds

Duration: 6 seconds

Duration: 9 seconds

Duration: 18 seconds

Duration: 35 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

UVic-TMP-SE-DCACHE

Duration: 4 seconds

Duration: 5 seconds

Duration: 10 seconds

Duration: 5 seconds

Duration: 45 seconds

Duration: 48 seconds

Duration: 22 seconds

TAU-TMP-SE

FINISHED

Duration: 3 seconds

FINISHED

Duration: 4 seconds

FAILED

Reason: TRANSFER [13] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy (Neon): SSL handshake failed: Connection timed out during SSL handshake

BNL-TMP-SE

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 9 seconds

Duration: 3 seconds

Duration: 15 seconds

NDU-TMP-SE

Duration: 5 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 9 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 9 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 7 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 26 seconds

Reason: TRANSFER [1] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: copy HTTP 403 : Permission refused

Australia-SE

Duration: 10 seconds

Duration: 44 seconds

Duration: 9 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: ConnectTimeoutException while fetching https://dynafed02.heprc.uvic.ca:8443/dynafed/Melbourne/TMP/belle/test/TPC/10MB?copy_mode=pull: Connect to grid.objects.storage.unimelb.edu.au:443 [grid.objects.storage.unimelb.edu.au/115.146.82.9] failed: SSL handshake timed out

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 0: Could not resolve host: grid.objects.storage.unimelb.edu.au\n

FINISHED

Duration: 12 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: SSLHandshakeException while fetching https://dynafed02.heprc.uvic.ca:8443/dynafed/Melbourne/TMP/belle/test/TPC/10MB?copy_mode=pull: The peer's certificate with subject's DN CN=grid.objects.storage.unimelb.edu.au,O=University of Melbourne,L=Carlton,ST=Victoria,C=AU,DC=DigiCert-Grid,DC=com was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

FINISHED

Duration: 13 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Error when interacting with local filesystem: Transfer failed because no bytes have been received in 120 seconds.

FINISHED

Duration: 10 seconds

FINISHED

Duration: 6 seconds

FAILED

Reason: DESTINATION [2] Result HTTP 404 : File not found after 1 attempts

UNIMELB-TMP-SE

Duration: 15 seconds

Duration: 23 seconds

Duration: 20 seconds

Duration: 12 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: SSLHandshakeException while fetching https://dynafedtest.atlas.unimelb.edu.au:8443/myfed/test/TMP/belle/test/TPC/10MB?copy_mode=pull: The peer's certificate with subject's DN CN=dynafedtest.atlas.unimelb.edu.au,O=University of Melbourne,L=Carlton,ST=Victoria,C=AU,DC=DigiCert-Grid,DC=com was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: SocketTimeoutException while fetching https://dynafedtest.atlas.unimelb.edu.au:8443/myfed/test/TMP/belle/test/TPC/10MB?copy_mode=pull: Read timed out

FINISHED

Duration: 9 seconds

IHEP-TMP-SE

FINISHED

Duration: 7 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: rejected GET: 403 Forbidden; redirects [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2022-09-15/10MB.17315.1663251495?token=a6phFDz%2FrYyr1lECKfTEFpbksjk%3D%401674745064%400&dav_sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB&dav_user=%2FDC%3Dorg%2FDC%3Dterena%2FDC%3Dtcs%2FC%3DIT%2FO%3DIstituto%20Nazionale%20di%20Fisica%20Nucleare%2FCN%3DSilvio%20Pardi%20spardi%40infn.it]\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 403: Found\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 403: Found\n

FINISHED

Duration: 5 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 403: Found\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: rejected GET: 403 Forbidden; redirects [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2022-09-15/10MB.17315.1663251495?token=RoXkeiiVg6gSWHPAEsdJx7OwWAg%3D%401674745073%400&dav_sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB&dav_user=%2FDC%3Dorg%2FDC%3Dterena%2FDC%3Dtcs%2FC%3DIT%2FO%3DIstituto%20Nazionale%20di%20Fisica%20Nucleare%2FCN%3DSilvio%20Pardi%20spardi%40infn.it]\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: Remote copy failed with status code 403: Found\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: rejected GET: 403 Forbidden; redirects [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2022-09-15/10MB.17315.1663251495?token=WibOIGRSPVbPlXqRcnvgr3FjKtQ%3D%401674745083%400&dav_sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB&dav_user=%2FDC%3Dorg%2FDC%3Dterena%2FDC%3Dtcs%2FC%3DIT%2FO%3DIstituto%20Nazionale%20di%20Fisica%20Nucleare%2FCN%3DSilvio%20Pardi%20spardi%40infn.it]\n

Duration: 6 seconds

Duration: 42 seconds

Duration: 6 seconds

Duration: 7 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd pull). Last attempt: Transfer failure: rejected GET: 403 Forbidden; redirects [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2022-09-15/10MB.17315.1663251495?token=m1FZYhcOEBu6P%2FFgD19eCNTHDl8%3D%401674745056%400&dav_sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB&dav_user=%2FDC%3Dorg%2FDC%3Dterena%2FDC%3Dtcs%2FC%3DIT%2FO%3DIstituto%20Nazionale%20di%20Fisica%20Nucleare%2FCN%3DSilvio%20Pardi%20spardi%40infn.it]\n

FINISHED

Duration: 7 seconds

FINISHED

Duration: 15 seconds

FINISHED

Duration: 36 seconds

Third Party Copy test summary

FTS SERVER fts.usatlas.bnl.gov

Thu Jan 26 16:22:17 CET 2023 - TEST HISTORY<

Green if Pull and Push tansfers have been completed successfully, Yellow if at least a Pull or a Push transfer have been completed successfully, Red if Pull and Push tansfers failed

DESTINATION

SOURCE

PUSH TEST - DETAILS

DESTINATION

SOURCE

PULL TEST - DETAILS

DESTINATION

SOURCE

S
O
U
R
C
E

S
O
U
R
C
E

S
O
U
R
C
E