PR types

New features

PR changes

Others

Describe

add cost model for distributed program generated by auto parallel module

• estimate_cost(distributed_program, cluster, process_mesh, single_cost_data, batch_size): this function takes the distributed program, cluster model and other distributed settings as inputs and estimate the runtime of one iteration and static memory and peak memory consumption.