struct
TensorMap
Maps inputs and outputs to their respective names and can be used to supply and receive data to MAX Engine model.
This is the data type returned by
Model.execute()
, and
you can also use this type for the inputs you pass in (although execute()
also supports other formats for the input).
Implemented traits
AnyType
,
CollectionElement
,
Copyable
,
Movable
,
SizedRaising
,
Stringable
Methods
__init__
__init__(inout self: Self, ctx: CRuntimeContext, lib: DLHandle, owned session: InferenceSession)
Internal only. Use InferenceSession.new_tensor_map for external use.
Creates a new instance of tensor map.
Args:
- ctx (
CRuntimeContext
): Context of API. - lib (
DLHandle
): Handle to library. - session (
InferenceSession
): Copy of InferenceSession from which this instance was created.
__init__(inout self: Self, ptr: CTensorMap, lib: DLHandle, owned session: InferenceSession)
Internal only. Use InferenceSession.new_tensor_map for external use.
Creates a new instance of tensor map.
Args:
- ptr (
CTensorMap
): C API pointer of TensorMap. - lib (
DLHandle
): Handle to library. - session (
InferenceSession
): Copy of InferenceSession from which this instance was created.
__copyinit__
__copyinit__(inout self: Self, existing: Self)
Copy contructor for TensorMap.
Args:
- existing (
Self
): Instance of TensorMap to copy from.
__moveinit__
__moveinit__(inout self: Self, owned existing: Self)
Move contructor for TensorMap.
Args:
- existing (
Self
): Instance of TensorMap to move from.
__del__
__del__(owned self: Self)
Destructor for the tensor map.
borrow
borrow[type: DType](self: Self, key: String, value: Tensor[type])
Borrow the given tensor into the map at the key location. User needs to make sure tensor is alive for the duration of map.
Parameters:
- type (
DType
): DType of tensor being borrowed.
Args:
- key (
String
): Name of tensor in map. - value (
Tensor[type]
): Tensor to be held in map.
borrow[type: DType](self: Self, key: String, spec: TensorSpec, ptr: DTypePointer[type, 0])
Borrow the given pointer into the map at the key location. User needs to make sure the backing array is alive for the duration of map.
Parameters:
- type (
DType
): DType of tensor being borrowed.
Args:
- key (
String
): Name of tensor in map. - spec (
TensorSpec
): The tensor spec. This is the standard libraryTensorSpec
. - ptr (
DTypePointer[type, 0]
): The tensor pointer.
borrow(self: Self, key: String, value: EngineTensorView)
Borrow the given tensor view into the map at the key location. User needs to make sure tensor backing the view is alive for the duration of map.
Args:
- key (
String
): Name of tensor in map. - value (
EngineTensorView
): View of a tensor.
borrow(self: Self, key: String, value: EngineNumpyView)
Borrow the given numpy view into the map at the key location. User needs to make sure numpy array backing the view is alive for the duration of map.
Args:
- key (
String
): Name of numpy array in map. - value (
EngineNumpyView
): View of a numpy array.
borrow(self: Self, key: String, value: Value)
Borrow the given value into the map at the key location.
User needs to make sure value is alive for the duration of the map.
Args:
- key (
String
): Name of value in map. - value (
Value
): Value to insert into map.
get
get[type: DType](self: Self, key: String) -> Tensor[$0]
Gets the tensor / numpy array indicated by the key. The value is copied and returned to the user.
Parameters:
- type (
DType
): DType of tensor to be returned.
Args:
- key (
String
): Name of tensor / numpy array in the map.
Returns:
A copy of the tensor held by the map.
buffer
buffer[type: DType](self: Self, key: String) -> Buffer[$0, Dim(), 0]
Gets a buffer to the tensor pointed by the key.
Parameters:
- type (
DType
): DType of buffer to be returned.
Args:
- key (
String
): Name in TensorMap.
Returns:
Buffer of the tensor pointed by the key.
get_spec
get_spec(self: Self, key: String) -> TensorSpec
Gets the spec of the tensor pointed by the key.
Args:
- key (
String
): Name in TensorMap.
Returns:
Buffer of the tensor pointed by the key, as a TensorSpec
.
get_value
get_value(self: Self, key: String) -> Value
Gets the value pointed by the key.
Args:
- key (
String
): Name in TensorMap.
Returns:
Value
pointed by the key.
keys
keys(self: Self) -> List[String]
Returns all held keys.
Returns:
A list with all contained keys.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!
If you'd like to share more information, please report an issue on GitHub
😔 What went wrong?