Third Party Copy test summary

FTS SERVER fts.usatlas.bnl.gov

Sat Mar 25 18:31:07 CET 2023 - TEST HISTORY<

Green if Pull and Push tansfers have been completed successfully, Yellow if at least a Pull or a Push transfer have been completed successfully, Red if Pull and Push tansfers failed

DESTINATION

S O U R C E		CNAF-TMP-SE	DESY-TMP-SE	IN2P3CC-TMP-SE	KIT-TMP-SE	CESNET-TMP-SE	IPHC-TMP-SE	LAL-TMP-SE	Pisa-TMP-SE	ROMA3-TMP-SE	Frascati-TMP-SE	Napoli-TMP-SE	CYFRONET-TMP-SE	ULAKBIM-TMP-SE	KEK-DEV-TMP-SE	SIGNET-TMP-SE	Torino-TMP-SE	MPPMU-TMP-SE	HEPHY-TMP-SE	NTUCC-TMP-SE	UVic-TMP-SE-DCACHE	TAU-TMP-SE	BNL-TMP-SE	NDU-TMP-SE	UNIMELB-TMP-SE	IHEP-TMP-SE
	CNAF-TMP-SE		Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	Pull FINISHED	Pull FINISHED	Push FINISHED	Pull FINISHED	FAILED
	DESY-TMP-SE			FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FAILED
	IN2P3CC-TMP-SE	Push FINISHED	FINISEHD		FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	ERROR
	KIT-TMP-SE	FINISEHD	FINISEHD	FINISEHD		FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	ERROR
	CESNET-TMP-SE		FINISEHD	Pull FINISHED	Pull FINISHED		Push FINISHED	FINISEHD	FINISEHD	FINISEHD		Pull FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	ERROR
	IPHC-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED		FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	ERROR
	LAL-TMP-SE	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD		FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	ERROR
	Pisa-TMP-SE	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD		FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FAILED	FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED
	ROMA3-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD		FINISEHD	FINISEHD	Push FINISHED	FAILED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FAILED	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	Pull FINISHED	Push FINISHED
	Frascati-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD		Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED		FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	ERROR
	Napoli-TMP-SE	FINISEHD		FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD		FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FAILED
	CYFRONET-TMP-SE	FINISEHD	Push FINISHED		FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	FINISEHD	Pull FINISHED	Pull FINISHED	FINISEHD		FINISEHD	Pull FINISHED	Push FINISHED	Pull FINISHED	Pull FINISHED	FINISEHD	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Pull FINISHED	Push FINISHED	ERROR
	ULAKBIM-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD		FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FAILED	ERROR
	KEK-DEV-TMP-SE	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD		FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	Pull FINISHED	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD	Push FINISHED
	SIGNET-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD		FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	ERROR
	Torino-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Pull FINISHED	Push FINISHED	Push FINISHED		Push FINISHED	Pull FINISHED	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED
	MPPMU-TMP-SE	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD		FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	ERROR
	HEPHY-TMP-SE	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FAILED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD		Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	ERROR	Push FINISHED
	NTUCC-TMP-SE	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD		ERROR	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED
	UVic-TMP-SE-DCACHE	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	ERROR		FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED
	TAU-TMP-SE	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED		FINISEHD	FINISEHD	FINISEHD	Push FINISHED
	BNL-TMP-SE	Pull FINISHED	FAILED			Pull FINISHED	Pull FINISHED	Pull FINISHED		Pull FINISHED	Pull FINISHED		Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	Pull FINISHED	FAILED	Pull FINISHED	Pull FINISHED			Pull FINISHED		ERROR
	NDU-TMP-SE	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Push FINISHED	FINISEHD	FINISEHD	FAILED	Push FINISHED	Pull FINISHED	FINISEHD	FINISEHD		Push FINISHED	Push FINISHED
	UNIMELB-TMP-SE	FINISEHD	FINISEHD	FINISEHD	FINISEHD	FINISEHD	Pull FINISHED	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD	Push FINISHED	Push FINISHED	Push FINISHED	Push FINISHED	FINISEHD	FINISEHD	FINISEHD	FAILED	FINISEHD	FINISEHD	Push FINISHED	Push FINISHED	FINISEHD		Push FINISHED
	IHEP-TMP-SE	Pull FINISHED	ERROR	ERROR	ERROR	FAILED	ERROR	ERROR	Pull FINISHED	Pull FINISHED	FAILED	ERROR	ERROR	ERROR	FAILED	ERROR	Pull FINISHED	FAILED	Pull FINISHED	FAILED	FAILED	FAILED	ERROR	Pull FINISHED	Pull FINISHED

PUSH TEST - DETAILS

DESTINATION

2 seconds 5 seconds 4 seconds 8 seconds 3 seconds 3 seconds alert certificate expired target=_blank rel=noopener>

4 seconds 4 seconds 5 seconds alert certificate expired target=_blank rel=noopener>

2 seconds 3 seconds 2 seconds 10 seconds 5 seconds 3 seconds 3 seconds 6 seconds 12 seconds alert certificate expired target=_blank rel=noopener>

S
O
U
R
C
E

CNAF-TMP-SE

DESY-TMP-SE

IN2P3CC-TMP-SE

KIT-TMP-SE

CESNET-TMP-SE

IPHC-TMP-SE

LAL-TMP-SE

Pisa-TMP-SE

ROMA3-TMP-SE

Frascati-TMP-SE

Napoli-TMP-SE

CYFRONET-TMP-SE

ULAKBIM-TMP-SE

KEK-DEV-TMP-SE

SIGNET-TMP-SE

Torino-TMP-SE

MPPMU-TMP-SE

HEPHY-TMP-SE

NTUCC-TMP-SE

UVic-TMP-SE-DCACHE

TAU-TMP-SE

BNL-TMP-SE

NDU-TMP-SE

UNIMELB-TMP-SE

IHEP-TMP-SE

CNAF-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 16 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 1 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SocketException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-CNAF-TMP-SE: Connection reset by peer (Write failed)

FINISHED

Duration: 7 seconds

FINISHED

Duration: 4 seconds

FINISHED

Duration: 4 seconds

DESY-TMP-SE

Duration: 3 seconds

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

Duration:

IN2P3CC-TMP-SE alert certificate expired target=_blank rel=noopener>

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 11 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2023-03-26/10MB-push-IN2P3CC-TMP-SE.3306201.1679763553?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-IN2P3CC-TMP-SE&token=5aI6f14gYlUmXHmFZH5w0qYO%2Fao%3D%401679764553%401]\n

KIT-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 9 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 11 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_02/belle/2023-03-26/10MB-push-KIT-TMP-SE.3306222.1679763657?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-KIT-TMP-SE&token=wxPphaMom6LHbh4zRf7v58qqVVE%3D%401679764657%401]\n

CESNET-TMP-SE

Duration: 2 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 8 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 10 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 12 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2023-03-26/10MB-push-CESNET-TMP-SE.3306134.1679763326?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-CESNET-TMP-SE&token=WLa1uXWJeAFeBC%2B%2FeXm2XuKxBfc%3D%401679764326%401]\n

IPHC-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 10 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

LAL-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 9 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

Pisa-TMP-SE

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 8 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 7 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 63 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SocketException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-Pisa-TMP-SE: Connection reset by peer (Write failed)

FINISHED

Duration: 10 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://basilisk02.westgrid.ca:2880/belledisk/TMP/belle/test/TPC/DCACHE/10MB-push-Pisa-TMP-SE: null

Duration: 5 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 17 seconds

Duration: 10 seconds

ROMA3-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 0 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 18 seconds

Duration: 2 seconds

Duration: 18 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://torik1.ulakbim.gov.tr:443/dpm/ulakbim.gov.tr/home/belle/TMP/belle/test/TPC/10MB-push-ROMA3-TMP-SE: The peer's certificate with subject's DN CN=torik1.ulakbim.gov.tr,OU=TUBITAK-ULAKBIM,O=TRGrid,C=TR was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

Duration: 6 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-ROMA3-TMP-SE: Write error: ssl=0x7f4de403aad8: I/O error during system call, Connection reset by peer

Duration: 37 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://dynafed-belle2.atlas.unimelb.edu.au:8443/dynafed/TMP/belle/test/TPC/10MB-push-ROMA3-TMP-SE: The peer's certificate with subject's DN CN=dynafed-belle2.atlas.unimelb.edu.au,O=University of Melbourne,L=Carlton,ST=Victoria,C=AU,DC=DigiCert-Grid,DC=com was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

FINISHED

Duration: 10 seconds

Frascati-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 13 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 2 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 20 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

Napoli-TMP-SE

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 7 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 9 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 6 seconds

Duration: 14 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_01/belle/2023-03-26/10MB-push-Napoli-TMP-SE.3306237.1679763762?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-Napoli-TMP-SE&token=9v%2B9s52R91jjrYT2bc%2BueujH9fk%3D%401679764762%401]\n

CYFRONET-TMP-SE

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 9 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 14 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

ULAKBIM-TMP-SE

Duration: 3 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 8 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 12 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 7 seconds

Duration: 22 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 6 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 0: \n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Remote copy failed with status code 403: \n

KEK-DEV-TMP-SE

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 48 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 9 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 9 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-KEK-DEV-TMP-SE: Write error: ssl=0x7fe1ed432248: I/O error during system call, Connection reset by peer

FINISHED

Duration: 6 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://basilisk02.westgrid.ca:2880/belledisk/TMP/belle/test/TPC/DCACHE/10MB-push-KEK-DEV-TMP-SE: java.lang.NullPointerException

FINISHED

Duration: 6 seconds

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: NoHttpResponseException while pushing https://dcbldoor.sdcc.bnl.gov:443/pnfs/sdcc.bnl.gov/data/bellediskdata/TMP/belle/test/TPC/10MB-push-KEK-DEV-TMP-SE: dcbldoor.sdcc.bnl.gov:443 failed to respond

FINISHED

Duration: 2 seconds

FINISHED

Duration: 6 seconds

FINISHED

Duration: 5 seconds

SIGNET-TMP-SE

Duration: 1 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 15 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 22 seconds

Duration: 6 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 12 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_03/belle/2023-03-26/10MB-push-SIGNET-TMP-SE.3306276.1679763942?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-SIGNET-TMP-SE&token=NpsAAUdyav9dsWEZzw%2FZNbnRRwU%3D%401679764942%401]\n

Torino-TMP-SE

Duration: 2 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 22 seconds

Duration: 3 seconds

Duration: 9 seconds

Duration: 1 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://torik1.ulakbim.gov.tr:443/dpm/ulakbim.gov.tr/home/belle/TMP/belle/test/TPC/10MB-push-Torino-TMP-SE: The peer's certificate with subject's DN CN=torik1.ulakbim.gov.tr,OU=TUBITAK-ULAKBIM,O=TRGrid,C=TR was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

Duration: 5 seconds

Duration: 2 seconds

Duration: 6 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SocketException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-Torino-TMP-SE: Connection reset by peer (Write failed)

Duration: 38 seconds

Duration: 4 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 11 seconds

Duration: 10 seconds

MPPMU-TMP-SE

Duration: 3 seconds

Duration: 2 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 2 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 2 seconds

Duration: 13 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 11 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: rejected PUT: 403 Forbidden; redirections [https://dpmbelle01.ihep.ac.cn:443/storage/belle01_04/belle/2023-03-26/10MB-push-MPPMU-TMP-SE.3306229.1679763727?sfn=%2Fdpm%2Fihep.ac.cn%2Fhome%2Fbelle%2FTMP%2Fbelle%2Ftest%2FTPC%2F10MB-push-MPPMU-TMP-SE&token=MH%2FVSEbjTOgXlGqT76HIF7eUmt0%3D%401679764727%401]\n

HEPHY-TMP-SE

Duration: 8 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 7 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Reason: TRANSFER [5] DESTINATION OVERWRITE DavPosix::unlink HTTP 500 : Unexpected server error: 500 with url davs://torik1.ulakbim.gov.tr:443/dpm/ulakbim.gov.tr/home/belle/TMP/belle/test/TPC/10MB-push-HEPHY-TMP-SE

Duration: 8 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 8 seconds

Duration: 2 seconds

Duration: 2 seconds

Duration: 3 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Error when interacting with local filesystem: Transfer failed because no bytes have been received in 120 seconds.

FINISHED

Duration: 7 seconds

NTUCC-TMP-SE

Duration: 13 seconds

Duration: 21 seconds

Duration: 19 seconds

Duration: 19 seconds

Duration: 16 seconds

Duration: 34 seconds

Duration: 24 seconds

Duration: 16 seconds

Duration: 21 seconds

Duration: 23 seconds

Duration: 23 seconds

Duration: 21 seconds

Duration: 20 seconds

Duration: 12 seconds

Duration: 16 seconds

Duration: 20 seconds

Duration: 23 seconds

Duration: 17 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: problem sending data: javax.net.ssl.SSLException\n

Duration: 15 seconds

Duration: 9 seconds

Duration: 9 seconds

Duration: 18 seconds

Duration: 15 seconds

UVic-TMP-SE-DCACHE

Duration: 5 seconds

Duration: 7 seconds

Duration: 7 seconds

Duration: 6 seconds

Duration: 7 seconds

Duration: 42 seconds

Duration: 9 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 8 seconds

Duration: 7 seconds

Duration: 8 seconds

Duration: 9 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 7 seconds

Duration: 8 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: problem sending data: Certificate for doesn't match any of the subject alternative names: [john@hep1.phys.ntu.edu.tw]\n

Duration: 7 seconds

Duration: 3 seconds

Duration: 6 seconds

Duration: 9 seconds

Duration: 11 seconds

TAU-TMP-SE

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 3 seconds

Duration: 22 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 3 seconds

Duration: 5 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLHandshakeException while pushing https://torik1.ulakbim.gov.tr:443/dpm/ulakbim.gov.tr/home/belle/TMP/belle/test/TPC/10MB-push-TAU-TMP-SE: The peer's certificate with subject's DN CN=torik1.ulakbim.gov.tr,OU=TUBITAK-ULAKBIM,O=TRGrid,C=TR was rejected. The peer's certificate status is: FAILED The following validation errors were found:\n

Duration: 6 seconds

Duration: 3 seconds

Duration: 4 seconds

Duration: 4 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SocketException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-TAU-TMP-SE: Connection reset by peer (Write failed)

Duration: 9 seconds

Duration: 7 seconds

Duration: 3 seconds

Duration: 5 seconds

Duration: 14 seconds

Duration: 11 seconds

BNL-TMP-SE

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

FAILED

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: Failed to select pool: Request to [>PoolManager@dcblcore03Domain] timed out.\n

NDU-TMP-SE

Duration: 4 seconds

Duration: 5 seconds

Duration: 4 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 22 seconds

Duration: 9 seconds

Duration: 11 seconds

Duration: 5 seconds

Duration: 8 seconds

Duration: 5 seconds

Duration: 6 seconds

Duration: 9 seconds

Duration: 2 seconds

Duration: 5 seconds

Duration: 5 seconds

Duration: 5 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Transfer failure: SSLException while pushing https://eos.grid.vbc.ac.at:8443/eos/vbc/experiments/belle/TMP/belle/test/TPC/10MB-push-NDU-TMP-SE: Write error: ssl=0x7f973c0ea508: I/O error during system call, ????????????????

Duration: 12 seconds

Duration: 6 seconds

Duration: 3 seconds

Duration: 7 seconds

Duration: 6 seconds

UNIMELB-TMP-SE

Duration: 6 seconds

Duration: 8 seconds

Duration: 8 seconds

Duration: 8 seconds

Duration: 7 seconds

Reason: TRANSFER [5] TRANSFER ERROR: Copy failed (3rd push). Last attempt: Connection terminated abruptly; Status of TPC request unknown

Duration: 9 seconds

Duration: 15 seconds

Duration: 7 seconds

Duration: 9 seconds

Duration: 8 seconds

Duration: 9 seconds

Duration: 15 seconds

Duration: 5 seconds

Duration: 8 seconds

Duration: 7 seconds

Duration: 8 seconds

Reason: DESTINATION [2] Result HTTP 404 : File not found after 1 attempts

FINISHED

Duration: 132 seconds

Duration: 10 seconds

Duration: 8 seconds

Duration: 6 seconds

Duration: 5 seconds

Duration: 9 seconds

IHEP-TMP-SE

FAILED