chop.passes.graph#
Summary of MaseGraph Analysis Passes#
Pass Name |
Usage Example |
Summary |
---|---|---|
Initialize each node with the MaseMetadata, this needs to run first before adding any metadata |
||
Add metadata used for both software and hardware, this needs to run first before calling to add_software_metadata or add_hardware_metadata |
||
Add hardware-specific metadata, such as which hardware IPs to map and hardware parameters. Details see the pass page |
||
Add software-specific metadata, such as sparsity. Details see the pass page |
||
Generates a report for the graph analysis and prints out an over the model in a table. |
||
Generate a report on the hardware type of the nodes in the graph. |
||
Generate a report on the meta parameters of the nodes in the graph. |
||
Generate a report on the shape of the nodes in the graph. |
||
Generate a report on the type of the nodes in the graph. |
||
Perform profile statistics analysis on the given graph |
||
Calculate, on average, how many bits are spent on weights and activations |
||
Add natural sparsity metadata analysis pass to the given MaseGraph. |
||
This pass computes weight and activation sparsity based on pruning masks |
||
Provide hook information of the modules |
||
|
fill me |
Perform runtime analysis on the given graph (MaseGraph, TensorRT, ONNX models) |
fill me |
fill me |
|
fill me |
fill me |
|
fill me |
fill me |
|
fill me |
fill me |
- chop.passes.graph.analysis.add_metadata
- chop.passes.graph.analysis.autosharding
- chop.passes.graph.analysis.init_metadata
- chop.passes.graph.analysis.report
- chop.passes.graph.analysis.statistical_profiler.profile_statistics
- chop.passes.graph.analysis.verify.verify
- chop.passes.graph.calculate_avg_bits_mg_analysis_pass
- chop.passes.graph.pruning
- chop.passes.graph.analysis.runtime
Summary of MaseGraph Transform Passes#
Pass Name |
Usage Example |
Summary |
---|---|---|
Prune the given graph |
||
Remove all pruning hooks |
||
Apply quantization, check the further documentation below |
||
Summarizes the quantization with respect to the original graph |
||
Perform Conv-BN fusion on the given graph |
||
test_logicnets_fusion (DEV, Disabled) |
Perform LogicNets fusion on the given graph (DEV, Disabled) |
|
NA (DEV, Disabled) |
Convert MaseGraph to ONNX and annotate the relevant layers with sparsity information (DEV, Disabled) |
|
|
Emit the top-level model design in Verilog. |
|
|
Emit test bench and related files for simulation. |
|
|
Enumerate input parameters of the node and emit a ROM block with handshake interface for each parameter |
|
|
Emit the hardware components that generated from MLIR-HLS tools. |
|
|
Emit the hardware components that pre-defined in the mase internal library. |
|
Apply TensorRT fake quantization to the given graph for INT8 quantization calibration |
fille me |
|
Apply TensorRT calibration to the given graph for INT8 quantization |
fille me |
|
|
Apply TensorRT fine tune to the given graph for quantization aware training |
fille me |
Summary of MaseGraph Interface Passes#
Pass Name |
Usage Example |
Summary |
---|---|---|
fill me |
fill me |
|
fill me |
fill me |
|
|
fill me |
fill me |
|
fill me |
fill me |
Converts the given graph to a TensorRT engine model |
fill me |
|
Converts the given graph to a ONNXRuntime model |
fill me |