TY  - CONF
AU  - Sedona, Rocco
AU  - Cavallaro, Gabriele
AU  - Jitsev, Jenia
AU  - Strube, Alexandre
AU  - Riedel, Morris
AU  - Book, Matthias
TI  - Scaling Up a Multispectral Resnet-50 to 128 GPUs
PB  - IEEE
M1  - FZJ-2021-01284
SP  - 1058 - 1061
PY  - 2020
AB  - Similarly to other scientific domains, Deep Learning (DL)holds great promises to fulfil the challenging needs of RemoteSensing (RS) applications. However, the increase in volume,variety and complexity of acquisitions that are carried outon a daily basis by Earth Observation (EO) missions generatesnew processing and storage challenges within operationalprocessing pipelines. The aim of this work is to show thatHigh-Performance Computing (HPC) systems can speed upthe training time of Convolutional Neural Networks (CNNs).Particular attention is put on the monitoring of the classificationaccuracy that usually degrades when using large batchsizes. The experimental results of this work show that thetraining of the model scales up to a batch size of 8,000, obtainingclassification performances in terms of accuracy in linewith those using smaller batch sizes.
T2  - 2020 IEEE International Geoscience and Remote Sensing Symposium
CY  - 26 Sep 2020 - 2 Oct 2020, Online event (Hawaii)
Y2  - 26 Sep 2020 - 2 Oct 2020
M2  - Online event, Hawaii
LB  - PUB:(DE-HGF)8
UR  - <Go to ISI:>//WOS:000664335301039
DO  - DOI:10.1109/IGARSS39084.2020.9324237
UR  - https://juser.fz-juelich.de/record/890968
ER  -