We perform Singular Value Decomposition (SVD) calculations on large datasets.
We modify the computation both by using fully precise and approximate methods, and by using both CPUs and GPUs.
In the end we compute an approximate SVD of 200GB of simulated data and using a mutli-GPU machine in 15-20 seconds.
Then we run this from a dataset stored in the cloud where we find that I/O is, predictably, a major bottleneck.
P. Breiding, and S. Timme. Mathematical Software -- ICMS 2018, volume 10931 of Lecture Notes in Computer Science, page 458--465. Cham, Springer, (2018)