job#
Classes:
Scheduler target resources allocated for a job the scheduler at launch time. |
|
Specification for a CryoSPARC Job object. |
|
Record for when a user last accessed a job. |
|
Information about the workflow a job is part of. |
|
Details about a runtime error encountered during job execution. |
|
Details about a job tile image shown in the UI. |
- class AllocatedResources#
Scheduler target resources allocated for a job the scheduler at launch time.
Attributes:
Fixed compute resources allocated for this job.
For node targets, hostname of selected worker node.
Name of lane the job is queued to.
Type of allocated lane ("node" or "cluster")
Number of GPU tokens allocated for this job.
Listings of compute resources allocated for this job.
Allocated scheduler target full details.
- fixed: FixedResourceSlots#
Fixed compute resources allocated for this job.
- hostname: str#
For node targets, hostname of selected worker node.
- lane: str | None#
Name of lane the job is queued to.
- lane_type: str | None#
Type of allocated lane (“node” or “cluster”)
- licenses_acquired: int#
Number of GPU tokens allocated for this job.
- slots: ResourceSlots#
Listings of compute resources allocated for this job.
- target: SchedulerTarget | None#
Allocated scheduler target full details.
- class Job#
Specification for a CryoSPARC Job object. Access parameters, inputs and outputs from spec field.
Attributes:
Process ID number of main job process
Process ID number of job monitor process
Process ID numbers of worker processes spawned by main job process
Benchmarking data
list_of_timings}
List of build errors for this job.
Set of child job UIDs based on output connections.
Job this job was cloned from
When job finished
How many times this job was marked as completed
When this object was first created.
Job ID of job that created this job.
Object ID of user account that created this job.
True if the job has been marked as deleted.
True if the job is being deleted
Human-readable job markdown description.
When the model was last dumped to disk
Enable benchmarking for this job.
Runtime errors, limited to last 10 errors.
When job failed
If True, there's an error in the streamlog
If True, there's a warning in the streamlog
Last heartbeat received
Details about the active instance
Port assigned to a job's interactive server by operation system, only available after an interactive job enters waiting status.
Similar to is_final_result
Is the job part of an experiment?
Job and its anscestors is the final result and should not be deleted during data cleanup steps.
Job directory relative to project directory, usually the same as uid
Job directory size
Job directory last updated timestamp
Job signature created by licensing module
When job was killed
When a specific user last opened this job in the user interface
The version of CryoSPARC last dumped at
Time of last export of outputs
Time of last exported outputs location
Version of CryoSPARC this job was last exported from
When scheduler last tried to launch this job
When job initial monitor process starts
If True, a queued job will be launched even if parent connected jobs have not finished running yet.
number of (GPU) tokens required to run the job
Set of parent jobs UIDs based on input connections.
Queue priority set by user or default for system.
Progress log
Project unique ID, e.g., "P3".
Numeric part of the project UID.
GPU"
waiting_inputs, project_paused, actively_queued, launched
When added to the queue
ID of user account that queued this job.
hash of puid, juid, # tokens requested, job type and user for scheduler
database field is sometimes
Falsein older CryoSPARC jobs, cast validator prevents thisdatabase field is sometimes
Falsein older CryoSPARC jobs, cast validator prevents thisset at queue time based on params
If set, job can be cleared and requeued until this time without losing its place in the queue
Set by scheduler before launching
Developer job register to use (internal use only)
When job monitor process forks into main process
Job type-specific settings, including params, inputs, outputs, resources, etc.
List of user IDs who have starred this job.
When internal scheduler launches/submits
Job scheduling status, e.g., "building", "queued", "running".
Numeric representation of job status.
Tags associated with this job
Human-readable job title.
When job got confirmation from the licensing server to run
When job started waiting for tokens to become available
Job tile images in app
Job unique ID, e.g., "J42".
Numeric part of the job UID.
When this object was last modified.
Version of CryoSPARC that last ran this job
Version of CryoSPARC used to create this job
When job last went into waiting for interaction status
Information about workflow that job ran from, if any
List of workspace UIDs this job belongs to.
- PID_main: int | None#
Process ID number of main job process
- PID_monitor: int | None#
Process ID number of job monitor process
- PID_workers: List[int]#
Process ID numbers of worker processes spawned by main job process
- attach_status: Literal['attaching', 'complete', 'failed'] | None#
- bench: Dict[str, float | int | Dict[str, Any]]#
Benchmarking data
- bench_timings: Dict[str, List[Tuple[datetime, datetime | None]]]#
list_of_timings}
- Type:
Benchmark timing data in the form {key
- build_errors: List[JobBuildError]#
List of build errors for this job. Jobs cannot be queued or launched if there are build errors.
- children: List[str]#
Set of child job UIDs based on output connections.
- cloned_from: str | None#
Job this job was cloned from
- cluster_job_custom_vars: Dict[str, str]#
- cluster_job_id: str | None#
- cluster_job_monitor_event_id: str | None#
- cluster_job_monitor_last_run_at: datetime | None#
- cluster_job_monitor_retries: int#
- cluster_job_status: str | None#
- cluster_job_status_code: str | None#
- cluster_job_submission_script: str | None#
- completed_at: datetime | None#
When job finished
- completed_count: int#
How many times this job was marked as completed
- created_at: datetime#
When this object was first created. Imported objects such as projects and jobs will retain the created time from their original CryoSPARC instance.
- created_by_job_uid: str | None#
Job ID of job that created this job.
- created_by_user_id: str | None#
Object ID of user account that created this job.
- deleted: bool#
True if the job has been marked as deleted.
- deleted_at: datetime | None#
- deleting: bool#
True if the job is being deleted
- description: str#
Human-readable job markdown description.
- dumped_at: datetime | None#
When the model was last dumped to disk
- enable_bench: bool#
Enable benchmarking for this job. Used by extensive workflow
- failed_at: datetime | None#
When job failed
- has_error: bool#
If True, there’s an error in the streamlog
- has_warning: bool#
If True, there’s a warning in the streamlog
- heartbeat_at: datetime | None#
Last heartbeat received
- id: str#
- import_status: Literal['importing', 'complete', 'failed'] | None#
- imported_at: datetime | None#
- instance_information: InstanceInformation#
Details about the active instance
- interactive_port: int | None#
Port assigned to a job’s interactive server by operation system, only available after an interactive job enters waiting status.
- intermediate_results_size_bytes: int#
- intermediate_results_size_last_updated: datetime | None#
- is_ancestor_of_final_result: bool#
Similar to is_final_result
- is_experiment: bool#
Is the job part of an experiment?
- is_final_result: bool#
Job and its anscestors is the final result and should not be deleted during data cleanup steps.
- job_dir: str#
Job directory relative to project directory, usually the same as uid
- job_dir_size: int#
Job directory size
- job_dir_size_last_updated: datetime#
Job directory last updated timestamp
- job_sig: str | None#
Job signature created by licensing module
- killed_at: datetime | None#
When job was killed
- last_accessed: JobLastAccessed | None#
When a specific user last opened this job in the user interface
- last_dumped_version: str | None#
The version of CryoSPARC last dumped at
- last_exported_at: datetime | None#
Time of last export of outputs
- last_exported_location: str | None#
Time of last exported outputs location
- last_exported_version: str | None#
Version of CryoSPARC this job was last exported from
- last_intermediate_data_cleared_amount: int#
- last_intermediate_data_cleared_at: datetime | None#
- last_scheduled_at: datetime | None#
When scheduler last tried to launch this job
- launched_at: datetime | None#
When job initial monitor process starts
- no_check_inputs_ready: bool#
If True, a queued job will be launched even if parent connected jobs have not finished running yet.
- num_tokens: int#
number of (GPU) tokens required to run the job
- parents: List[str]#
Set of parent jobs UIDs based on input connections.
- priority: int#
Queue priority set by user or default for system. higher number = higher priority.
- progress: List[Dict[str, Any]]#
Progress log
- project_uid: str#
Project unique ID, e.g., “P3”.
- project_uid_num: int#
Numeric part of the project UID.
- queue_message: str | None#
GPU”
- Type:
e.g., “Waiting for resource in lane xxx
- queue_status: Literal['waiting_inputs', 'project_paused', 'actively_queued', 'launched', 'waiting_maintenance', 'waiting_licenses', 'waiting_resources'] | None#
waiting_inputs, project_paused, actively_queued, launched
- queued_at: datetime | None#
When added to the queue
- queued_by_user_id: str | None#
ID of user account that queued this job.
- queued_job_hash: int | None#
hash of puid, juid, # tokens requested, job type and user for scheduler
- queued_to_gpu: List[int] | None#
database field is sometimes
Falsein older CryoSPARC jobs, cast validator prevents this- Type:
NOTE
- queued_to_hostname: str | None#
database field is sometimes
Falsein older CryoSPARC jobs, cast validator prevents this- Type:
NOTE
- queued_to_lane: str | None#
set at queue time based on params
- requeue_windows_ends_at: datetime | None#
If set, job can be cleared and requeued until this time without losing its place in the queue
- resources_allocated: AllocatedResources | None#
Set by scheduler before launching
- run_as_user: str | None#
Developer job register to use (internal use only)
- running_at: datetime | None#
When job monitor process forks into main process
- starred_by: List[str]#
List of user IDs who have starred this job.
- started_at: datetime | None#
When internal scheduler launches/submits
- status: Literal['building', 'queued', 'launched', 'started', 'running', 'waiting', 'completed', 'killed', 'failed']#
Job scheduling status, e.g., “building”, “queued”, “running”.
- status_num: int#
Numeric representation of job status.
- tags: List[str]#
Tags associated with this job
- title: str#
Human-readable job title.
- tokens_acquired_at: datetime | None#
When job got confirmation from the licensing server to run
- tokens_requested_at: datetime | None#
When job started waiting for tokens to become available
- ui_tile_images: List[UiTileImage]#
Job tile images in app
- uid: str#
Job unique ID, e.g., “J42”.
- uid_num: int#
Numeric part of the job UID.
- updated_at: datetime#
When this object was last modified.
- version: str | None#
Version of CryoSPARC that last ran this job
- version_created: str | None#
Version of CryoSPARC used to create this job
- waiting_at: datetime | None#
When job last went into waiting for interaction status
- workflow: JobWorkflowInfo | None#
Information about workflow that job ran from, if any
- workspace_uids: List[str]#
List of workspace UIDs this job belongs to. Must have at least one item
- class JobLastAccessed#
Record for when a user last accessed a job.
Attributes:
Timestamp of the last access.
Username that last accessed the job.
- accessed_at: datetime#
Timestamp of the last access.
- name: str#
Username that last accessed the job.
- class JobWorkflowInfo#
Information about the workflow a job is part of.
Attributes:
- id: str#
- jobId: str#
- run: int#