Aggregations and Grouping

Contents

Aggregations and Grouping#

Some operations such as the sum or the average of a column are called aggregations. Aggregations are operations that reduce the number of rows in a column.

For a full list of available aggregations, see: Aggregations.

Global Aggregations#

An aggregation can be applied on an entire DataFrame, for example to get the mean on a specific column:

import daft

df = daft.from_pydict({
    "class": ["a", "a", "b", "b"],
    "score": [10, 20., 30., 40],
})

df.mean("score").show()

+-----------+
|     score |
|   Float64 |
+===========+
|        25 |
+-----------+
(Showing first 1 rows)

Grouped Aggregations#

Aggregations can also be called on a “Grouped DataFrame”. For the above example, perhaps we want to get the mean “score” not for the entire DataFrame, but for each “class”.

Let’s run the mean of column “score” again, but this time grouped by “class”:

df.groupby("class").mean("score").show()

+---------+-----------+
| class   |     score |
| Utf8    |   Float64 |
+=========+===========+
| b       |        35 |
+---------+-----------+
| a       |        15 |
+---------+-----------+
(Showing first 2 rows)