dvc-data

DVC's data management subsystem

303 个版本 Python >=3.9

安装

pip install dvc-data

poetry add dvc-data

pipenv install dvc-data

conda install dvc-data

描述

DVC data

.. |PyPI| image:: https://img.shields.io/pypi/v/dvc-data.svg :target: https://pypi.org/project/dvc-data/ :alt: PyPI .. |Status| image:: https://img.shields.io/pypi/status/dvc-data.svg :target: https://pypi.org/project/dvc-data/ :alt: Status .. |Python Version| image:: https://img.shields.io/pypi/pyversions/dvc-data :target: https://pypi.org/project/dvc-data :alt: Python Version .. |License| image:: https://img.shields.io/pypi/l/dvc-data :target: https://opensource.org/licenses/Apache-2.0 :alt: License .. |Tests| image:: https://github.com/iterative/dvc-data/workflows/Tests/badge.svg :target: https://github.com/iterative/dvc-data/actions?workflow=Tests :alt: Tests .. |Codecov| image:: https://codecov.io/gh/iterative/dvc-data/branch/main/graph/badge.svg :target: https://app.codecov.io/gh/iterative/dvc-data :alt: Codecov .. |pre-commit| image:: https://img.shields.io/badge/pre--commit-enabled-brightgreen?logo=pre-commit&logoColor=white :target: https://github.com/pre-commit/pre-commit :alt: pre-commit .. |Black| image:: https://img.shields.io/badge/code%20style-black-000000.svg :target: https://github.com/psf/black :alt: Black

Features

TODO

Requirements

TODO

Installation

You can install DVC data via pip_ from PyPI_:

.. code:: console

$ pip install dvc-data

Usage

HashFile ^^^^^^^^

HashFile """"""""

Based on dvc-object's Object, this is an object that has a particular hash that can be used to verify its contents. Similar to git's ShaFile.

.. code:: python

from dvc_data.hashfile import HashFile

obj = HashFile("/path/to/file", fs, HashInfo("md5", "36eba1e1e343279857ea7f69a597324e")

HashFileDB """"""""""

Based on dvc-object's ObjectDB, but stores HashFile objects and so is able to verify their contents by their hash_info. Similar to git's ObjectStore.

.. code:: python

from dvc_data.hashfile import HashFileDB

odb = HashFileDB(fs, "/path/to/odb")

Index ^^^^^

Index """""

A trie-like structure that represents data files and directories.

.. code:: python

from dvc_data.index import DataIndex, DataIndexEntry

index = DataIndex()
index[("foo",)] = DataIndexEntry(hash_info=hash_info, meta=meta)

Storage """""""

A mapping that describes where to find data contents for index entries. Can be either ObjectStorage for HashFileDB-based storage or FileStorage for backup-like plain file storage.

.. code:: python

index.storage_map[("foo",)] = ObjectStorage(...)

Contributing

Contributions are very welcome. To learn more, see the Contributor Guide_.

License

Distributed under the terms of the Apache 2.0 license_, DVC data is free and open source software.

Issues

If you encounter any problems, please file an issue_ along with a detailed description.

.. _Apache 2.0 license: https://opensource.org/licenses/Apache-2.0 .. _PyPI: https://pypi.org/ .. _file an issue: https://github.com/iterative/dvc-data/issues .. _pip: https://pip.pypa.io/ .. github-only .. _Contributor Guide: CONTRIBUTING.rst

分类

Development Status :: 4 - Beta Programming Language :: Python :: 3 Programming Language :: Python :: 3.10 Programming Language :: Python :: 3.11 Programming Language :: Python :: 3.12 Programming Language :: Python :: 3.13 Programming Language :: Python :: 3.14 Programming Language :: Python :: 3.9

版本列表

3.18.3 2026-02-27

3.18.2 2026-01-08

3.18.1 2026-01-08

3.18.0 2026-01-07

3.17.0 2025-12-22

3.16.12 2025-08-18

3.16.11 2025-08-04

3.16.10 2025-04-29

3.16.9 2025-01-31

3.16.8 2025-01-14

3.16.7 2024-10-31

3.16.6 2024-09-25

3.16.5 2024-08-26

3.16.4 2024-08-19

3.16.3 2024-08-13

3.16.2 2024-08-13

3.16.1 2024-08-13

3.16.0 2024-08-12

3.15.2 2024-08-06

3.15.1 2024-03-23

3.15.0 2024-03-23

3.14.1 2024-03-07

3.14.0 2024-02-28

3.13.0 2024-02-15

3.12.0 2024-02-15

3.11.0 2024-02-08

3.10.0 2024-02-06

3.9.0 2024-01-25

3.8.0 2024-01-23

3.7.0 2024-01-04

3.6.0 2024-01-02

3.5.1 2023-12-30

3.5.0 2023-12-28

3.4.0 2023-12-27

3.3.0 2023-12-22

3.2.0 2023-12-22

3.1.1 2023-12-22

3.1.0 2023-12-20

3.0.1 2023-12-15

3.0.0 2023-12-15

2.25.0 2023-12-13

2.24.0 2023-12-13

2.23.1 2023-12-12

2.23.0 2023-12-11

2.22.6 2023-12-06

2.22.5 2023-12-06

2.22.4 2023-12-06

2.22.3 2023-11-29

2.22.2 2023-11-29

2.22.1 2023-11-27

2.22.0 2023-11-17

2.21.2 2023-11-14

2.21.1 2023-11-13

2.21.0 2023-11-13

2.20.0 2023-10-31

2.19.0 2023-10-26

2.18.2 2023-10-24

2.18.1 2023-10-04

2.18.0 2023-10-04

2.17.1 2023-09-28

2.17.0 2023-09-28

2.16.4 2023-09-27

2.16.3 2023-09-21

2.16.2 2023-09-20

2.16.1 2023-09-08

2.16.0 2023-09-07

2.15.4 2023-08-22

2.15.3 2023-08-22

2.15.2 2023-08-22

2.15.1 2023-08-17

2.15.0 2023-08-17

2.14.0 2023-08-16

2.13.1 2023-08-11

2.13.0 2023-08-11

2.12.2 2023-08-09

2.12.1 2023-08-07

2.12.0 2023-08-06

2.11.0 2023-08-04

2.10.1 2023-08-04

2.10.0 2023-08-04

2.9.1 2023-08-03

2.9.0 2023-08-02

2.8.1 2023-07-30

2.8.0 2023-07-27

2.7.1 2023-07-27

2.7.0 2023-07-27

2.6.0 2023-07-19

2.5.0 2023-07-09

2.4.1 2023-07-09

2.4.0 2023-07-09

2.3.3 2023-07-03

2.3.2 2023-07-02

2.3.1 2023-06-28

2.3.0 2023-06-21

2.2.0 2023-06-20

2.1.1 2023-06-20

2.1.0 2023-06-20

2.0.2 2023-06-18

2.0.1 2023-06-13

2.0.0 2023-06-13

1.11.0 2023-06-13

1.10.0 2023-06-12

1.9.0 2023-06-12

1.8.0 2023-06-12

1.7.0 2023-06-12

1.6.1 2023-06-12

1.6.0 2023-06-11

1.5.0 2023-06-11

1.4.0 2023-06-11

1.3.3 2023-06-11

1.3.2 2023-06-11

1.3.1 2023-06-10

1.3.0 2023-06-10

1.2.1 2023-06-10

1.2.0 2023-06-10

1.1.0 2023-06-09

1.0.3 2023-06-09

1.0.2 2023-06-09

1.0.1 2023-06-09

1.0.0 2023-06-09

0.56.0 2023-06-09

0.55.0 2023-06-07

0.54.3 2023-06-04

0.54.2 2023-06-01

0.54.1 2023-06-01

0.54.0 2023-06-01

0.53.0 2023-05-28

0.52.0 2023-05-18

0.51.0 2023-05-15

0.50.0 2023-05-14

0.49.1 2023-05-12

0.48.1 2023-05-08

0.48.0 2023-05-08

0.47.5 2023-05-06

0.47.4 2023-05-06

0.47.3 2023-05-05

0.47.2 2023-04-14

0.47.1 2023-04-01

0.47.0 2023-03-31

0.46.0 2023-03-26

0.45.1 2023-03-23

0.45.0 2023-03-23

0.44.1 2023-03-15

0.44.0 2023-03-15

0.43.0 2023-03-13

0.42.3 2023-03-10

0.42.2 2023-03-10

0.42.1 2023-03-02

0.42.0 2023-02-28

0.41.3 2023-02-20

0.41.2 2023-02-20

0.41.1 2023-02-20

0.41.0 2023-02-20

0.40.5 2023-02-20

0.40.4 2023-02-18

0.40.3 2023-02-14

0.40.2 2023-02-14

0.40.1 2023-02-12

0.40.0 2023-02-12

0.39.7 2023-02-10

0.39.6 2023-02-10

0.39.5 2023-02-10

0.39.4 2023-02-09

0.39.3 2023-02-09

0.39.2 2023-02-09

0.39.1 2023-02-09

0.39.0 2023-02-08

0.38.4 2023-02-08

0.38.3 2023-02-07

0.38.2 2023-02-07

0.38.1 2023-02-07

0.38.0 2023-02-07

0.37.8 2023-02-06

0.37.7 2023-02-06

0.37.6 2023-02-04

0.37.5 2023-02-03

0.37.4 2023-02-03

0.37.3 2023-02-01

0.37.2 2023-01-31

0.37.1 2023-01-31

0.37.0 2023-01-31

0.36.2 2023-01-26

0.36.1 2023-01-26

0.36.0 2023-01-25

0.35.4 2023-01-25

0.35.3 2023-01-24

0.35.2 2023-01-24

0.35.1 2023-01-20

0.35.0 2023-01-20

0.34.1 2023-01-19

0.34.0 2023-01-19

0.33.0 2023-01-17

0.32.0 2023-01-16

0.31.4 2023-01-16

0.31.3 2023-01-15

0.31.2 2023-01-15

0.31.1 2023-01-15

0.31.0 2023-01-15

0.30.2 2023-01-15

0.30.1 2023-01-15

0.30.0 2023-01-14

0.29.0 2023-01-11

0.28.6 2023-01-10

0.28.5 2023-01-05

0.28.4 2022-12-08

0.28.3 2022-12-01

0.28.2 2022-11-29

0.28.1 2022-11-28

0.28.0 2022-11-22

0.27.0 2022-11-21

0.26.0 2022-11-15

0.25.3 2022-11-04

0.25.2 2022-10-31

0.25.1 2022-10-29

0.25.0 2022-10-29

0.24.0 2022-10-24

0.23.0 2022-10-24

0.22.0 2022-10-20

0.21.0 2022-10-20

0.20.0 2022-10-18

0.19.0 2022-10-17

0.18.0 2022-10-13

0.17.1 2022-10-10

0.17.0 2022-10-07

0.16.0 2022-10-07

0.15.0 2022-10-07

0.14.0 2022-10-01

0.13.0 2022-09-25

0.12.0 2022-09-22

0.11.0 2022-09-20

0.10.1 2022-09-20

0.10.0 2022-09-16

0.9.0 2022-09-16

0.8.0 2022-09-14

0.7.1 2022-09-07

0.7.0 2022-09-07

0.6.3 2022-09-06

0.6.2 2022-09-06

0.6.1 2022-09-06

0.6.0 2022-09-06

0.5.3 2022-09-06

0.5.2 2022-09-06

0.5.1 2022-09-05

0.5.0 2022-09-01

0.4.1 2022-09-01

0.4.0 2022-08-31

0.3.0 2022-08-30

0.2.0 2022-08-25

0.1.23 2022-08-23

0.1.22 2022-08-20

0.1.21 2022-08-18

0.1.20 2022-08-18

0.1.19 2022-08-17

0.1.18 2022-08-17

0.1.17 2022-08-13

0.1.16 2022-08-13

0.1.15 2022-08-12

0.1.14 2022-08-09

0.1.13 2022-08-04

0.1.12 2022-08-04

0.1.11 2022-08-03

0.1.10 2022-08-03

0.1.9 2022-08-02

0.1.8 2022-08-01

0.1.7 2022-08-01

0.1.6 2022-07-28

0.1.5 2022-07-22

0.1.4 2022-07-21

0.1.3 2022-07-21

0.1.2 2022-07-21

0.1.1 2022-07-19

0.1.0 2022-07-19

0.0.31 2022-07-19

0.0.30 2022-07-19

0.0.29 2022-07-18

0.0.28 2022-07-18

0.0.27 2022-07-18

0.0.26 2022-07-17

0.0.25 2022-07-17

0.0.24 2022-07-15

0.0.23 2022-07-10

0.0.22 2022-07-10

0.0.21 2022-07-10

0.0.20 2022-07-08

0.0.19 2022-07-05

0.0.18 2022-07-03

0.0.17 2022-07-01

0.0.16 2022-06-29

0.0.15 2022-06-29

0.0.14 2022-06-26

0.0.13 2022-06-23

0.0.12 2022-06-21

0.0.11 2022-06-20

0.0.10 2022-06-19

0.0.9 2022-06-18

0.0.8 2022-06-17

0.0.7 2022-06-17

0.0.6 2022-06-14

0.0.5 2022-06-13

0.0.4 2022-06-12

0.0.3 2022-06-10

0.0.2 2022-05-21

0.0.1 2022-05-20