Skip to content
@webdataset

webdataset

High Performance I/O for Large Scale Deep Learning

Popular repositories

  1. webdataset webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    Python 2.2k 166

  2. tarp tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    Go 118 15

  3. WebDataset.jl WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    Julia 10 1

  4. wdsconversions wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    Jupyter Notebook 1 1

Repositories

Showing 4 of 4 repositories
  • webdataset Public

    A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

    webdataset/webdataset’s past year of commit activity
    Python 2,168 BSD-3-Clause 166 101 13 Updated Aug 13, 2024
  • WebDataset.jl Public

    A high performance I/O library for deep learning in Julia, based on the PyTorch WebDataset library

    webdataset/WebDataset.jl’s past year of commit activity
    Julia 10 MIT 1 0 48 Updated Jul 16, 2024
  • tarp Public

    Fast and simple stream processing of files in tar files, useful for deep learning, big data, and many other applications.

    webdataset/tarp’s past year of commit activity
    Go 118 15 6 3 Updated Dec 10, 2023
  • wdsconversions Public

    conversions of standard pytorch datasets to webdataset format

    webdataset/wdsconversions’s past year of commit activity
    Jupyter Notebook 1 1 0 0 Updated Aug 20, 2022

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…
-