Skip to main content

Ctrl+K

Site Navigation

Overview
Getting Started
User Guides
API Reference
Development
Migration Guides

GitHub
PyPI

Site Navigation

Overview
Getting Started
User Guides
API Reference
Development
Migration Guides

GitHub
PyPI

Section Navigation

Spark SQL
Pandas API on Spark
Structured Streaming
MLlib (DataFrame-based)
MLlib (DataFrame-based) for Spark Connect
Spark Streaming (Legacy)
MLlib (RDD-based)
Spark Core
Resource Management
Errors
Testing
- pyspark.testing.assertDataFrameEqual
- pyspark.testing.assertSchemaEqual

API Reference
Spark Core
pyspark.BarrierTaskContext.cpus

pyspark.BarrierTaskContext.cpus#

BarrierTaskContext.cpus()#

CPUs allocated to the task.

Returns

int: the number of CPUs.

previous

pyspark.BarrierTaskContext.barrier

next

pyspark.BarrierTaskContext.get

Copyright @ 2024 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.

Created using Sphinx 4.5.0.

Built with the PyData Sphinx Theme 0.13.3.