For the complete Mojo documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /docs/manual/basics.md).
device_context
This module provides functionality for interacting with accelerators. In particular the DeviceContext struct, which represents a single stream of execution on a given accelerator. You can use this struct to allocate accelerator memory, copy data to and from the accelerator, and compile and execute functions on the accelerator.
Structs
-
CompletionFlag: Non-owning handle to an MLRTCompletionFlag. -
DefaultDeviceTypeEncoder: Provides a default implementation of theDeviceTypeEncodertrait. -
DeviceBuffer: Represents a block of device-resident storage. For GPU devices, a device buffer is allocated in the device's global memory. -
DeviceContext: Represents a single stream of execution on a particular accelerator (GPU). -
DeviceContextList: A fixed-size collection ofDeviceContextvalues. -
DeviceEvent: Represents a GPU event for synchronization between streams. -
DeviceExternalFunction: Represents an external device function loaded from PTX/SASS assembly. -
DeviceFunction: Represents a compiled device function for GPU execution. -
DeviceGraph: Represents an instantiated device graph that can be replayed. -
DeviceGraphBuilder: Builder for explicit device graph construction. -
DeviceGraphNode: A handle to a node in an under-construction device graph. -
DeviceMulticastBuffer: Represents a multicast memory object enables special memory operations to be broadcast across a group of devices. -
DevicePointer: A host-side representation of a pointer to device memory that resides within an owningDeviceBuffer. -
EventFlags: Provides flags for creating events. -
HostBuffer: Represents a block of host-resident storage. For GPU devices, a host buffer is allocated in the host's global memory. -
MetalDeviceTypeEncoder: Provides a Metal specific implementation of theDeviceTypeEncodertrait. -
StreamPriorityRange: Represents the range of valid stream priorities for a GPU device.