BibSonomy bookmarks for /tag/Reproducibility

Reproducibility Report for ACM SIGMOD 2025 Paper: 'CRDV: Conflict-free Replicated Data Views'

scch — 2026-04-13T09:19:16+02:00

https://dl.acm.org/doi/abs/10.1145/3785021.3787996

MAKE | Free Full-Text | How Do Deep-Learning Framework Versions Affect the Reproducibility of Neural Network Models?

scch — 2023-09-18T15:49:30+02:00

In the last decade, industry’s demand for deep learning (DL) has increased due to its high performance in complex scenarios. Due to the DL method’s complexity, experts and non-experts rely on blackbox software packages such as Tensorflow and Pytorch. The frameworks are constantly improving, and new versions are released frequently. As a natural process in software development, the released versions contain improvements/changes in the methods and their implementation. Moreover, versions may be bug-polluted, leading to the model performance decreasing or stopping the model from working. The aforementioned changes in implementation can lead to variance in obtained results. This work investigates the effect of implementation changes in different major releases of these frameworks on the model performance. We perform our study using a variety of standard datasets. Our study shows that users should consider that changing the framework version can affect the model performance. Moreover, they should consider the possibility of a bug-polluted version before starting to debug source code that had an excellent performance before a version change. This also shows the importance of using virtual environments, such as Docker, when delivering a software product to clients.

Study of reproducibility issues points finger at the mice – Ars Technica

bshanks — 2022-07-05T17:26:42+02:00

https://arstechnica-com.cdn.ampproject.org/v/s/arstechnica.com/science/2022/05/some-reproducibility-problems-may-just-come-down-to-the-mice/?amp=1&amp_gsa=1&amp_js_v=a9&usqp=mq331AQIKAGwASCAAgM%3D#amp_tf=From%20%251%24s&aoh=16524244680780&csi=0&referrer=https%3A%2F%2Fwww.google.com&ampshare=https%3A%2F%2Farstechnica.com%2Fscience%2F2022%2F05%2Fsome-reproducibility-problems-may-just-come-down-to-the-mice%2F

Reproduced Papers

hangdong — 2022-05-22T10:50:34+02:00

https://reproducedpapers.org/

Datasets Publicly Available released by Francesco Lelli

francescolelli — 2022-02-17T12:23:29+01:00

Datasets Publicly Available is part of FAIR principles. We are trying to foster reproducibility and possible collaborations.

The Machine Learning Reproducibility Checklist

nosebrain — 2021-05-09T21:12:06+02:00

https://www.cs.mcgill.ca/~jpineau/ReproducibilityChecklist-v2.0.pdf

ReproducibilityChecklist-v2.0 - ReproducibilityChecklist-v2.0.pdf

annakrause — 2021-04-28T08:14:28+02:00

https://www.cs.mcgill.ca/~jpineau/ReproducibilityChecklist-v2.0.pdf

Reproducibility Checklist

dallmann — 2021-04-23T11:08:17+02:00

https://www.cs.mcgill.ca/~jpineau/ReproducibilityChecklist-v2.0.pdf

Additional results for: Performance Comparison of Neural and Non-Neural Approaches to Session-based Recommendation

dallmann — 2020-05-19T14:03:04+02:00

https://rn5l.github.io/session-rec/index.html

rn5l/session-rec: Python-based framework for building and evaluating session-based recommender systems.

dallmann — 2020-05-19T13:59:31+02:00

A framework for evaluating session recommendation algorithms, with many baselines.

New Ways to Think About Grief - TIME

schmidt2 — 2019-02-07T13:35:48+01:00

http://content.time.com/time/magazine/article/0,9171,2042372-2,00.html

Scientific Rigour and Reproducibility

blostben — 2018-08-15T15:39:24+02:00

Science moves forward by corroboration - when researchers verify others' results. Science advances faster when people waste less time pursuing false leads.

Challenges in irreproducible research

blostben — 2018-08-15T15:37:37+02:00

https://www.nature.com/collections/prbfkwmwvz/content/key-reads

Gradle 3.0: We Just Have Started - JavaLand 2017

schmidt2 — 2017-03-30T09:52:19+02:00

https://programm.javaland.eu/2017/talk.html#talk?talkId=529392