73 lines
2.1 KiB
ReStructuredText
73 lines
2.1 KiB
ReStructuredText
mindspore.parallel
|
||
==========================================================
|
||
|
||
mindspore.parallel提供了大量的自动并行接口，包括并行基础配置、模型加载与转换、函数式并行切分等。
|
||
|
||
模块导入方法如下：
|
||
|
||
.. code-block::
|
||
|
||
from mindspore import parallel
|
||
|
||
并行基础配置
|
||
----------------------------------------------------------------
|
||
|
||
.. mscnautosummary::
|
||
:toctree: parallel
|
||
:nosignatures:
|
||
:template: classtemplate.rst
|
||
|
||
mindspore.parallel.auto_parallel.AutoParallel
|
||
mindspore.parallel.distributed.DistributedDataParallel
|
||
mindspore.parallel.nn.GradAccumulation
|
||
mindspore.parallel.nn.MicroBatchInterleaved
|
||
mindspore.parallel.nn.Pipeline
|
||
mindspore.parallel.nn.PipelineGradReducer
|
||
|
||
|
||
模型加载与转换
|
||
----------------------------------------------------------------
|
||
|
||
.. mscnautosummary::
|
||
:toctree: parallel
|
||
:nosignatures:
|
||
:template: classtemplate.rst
|
||
|
||
mindspore.parallel.convert_checkpoints
|
||
mindspore.parallel.convert_checkpoint_by_rank
|
||
mindspore.parallel.load_distributed_checkpoint
|
||
mindspore.parallel.load_segmented_checkpoints
|
||
mindspore.parallel.rank_list_for_convert
|
||
mindspore.parallel.unified_safetensors
|
||
|
||
|
||
函数式并行切分
|
||
----------------------------------------------------------------
|
||
|
||
.. mscnautosummary::
|
||
:toctree: parallel
|
||
:nosignatures:
|
||
:template: classtemplate.rst
|
||
|
||
mindspore.parallel.function.reshard
|
||
mindspore.parallel.Layout
|
||
mindspore.parallel.shard
|
||
|
||
|
||
其他
|
||
----------------------------------------------------------------
|
||
|
||
.. mscnautosummary::
|
||
:toctree: parallel
|
||
:nosignatures:
|
||
:template: classtemplate.rst
|
||
|
||
mindspore.parallel.build_searched_strategy
|
||
mindspore.parallel.merge_pipeline_strategys
|
||
mindspore.parallel.parameter_broadcast
|
||
mindspore.parallel.restore_group_info_list
|
||
mindspore.parallel.sync_pipeline_shared_parameters
|
||
mindspore.parallel.strategy.enable_save_strategy_online
|
||
mindspore.parallel.strategy.get_strategy_metadata
|
||
mindspore.parallel.strategy.get_current_strategy_metadata
|
||
mindspore.parallel.strategy.clear_strategy_metadata |